00010000:00010000:2.0:1786015214.612422:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff538 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.612437:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff538 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.612452:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ff53f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.612458:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ff53f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.612464:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ff53f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.612470:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a0400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015214.612474:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ff53f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.612480:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ff53f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.612488:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x9fe5cc27 (ffff8b74938ba800) 00010000:00010000:2.0:1786015214.612491:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015214.612494:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ff53f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.612499:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ff53f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.612552:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff531 lrc: 1/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c0f expref: 19 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.612577:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8b749802e200) 00010000:00010000:2.0:1786015214.612580:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015214.612584:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff531 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c0f expref: 19 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.612595:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1200, rc 0) 00000100:00100000:2.0:1786015214.612703:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382c78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+18:15904:x1872772280280192:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1041us (1341us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015214.612713:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 491 00010000:00010000:2.0:1786015214.616355:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff54d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616381:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff54d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616396:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff54d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616414:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ff554 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616422:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ff554 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616427:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ff554 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616516:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff54d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616547:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff54d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616554:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff54d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616561:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015214.616566:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff54d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616575:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff54d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616590:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8b749802e200) 00010000:00010000:2.0:1786015214.616593:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015214.616599:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff54d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616606:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff54d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616625:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ff554 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616631:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ff554 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616638:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ff554 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616643:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015214.616652:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ff554 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616659:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ff554 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616667:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x9fe5cc27 (ffff8b74938ba000) 00010000:00010000:2.0:1786015214.616670:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015214.616674:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ff554 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616679:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ff554 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616730:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c4ff546 lrc: 1/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c16 expref: 19 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616743:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8b749802e200) 00010000:00010000:2.0:1786015214.616746:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015214.616750:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c4ff546 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c16 expref: 19 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015214.616941:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e7000, rc 0) 00000100:00100000:2.0:1786015214.617051:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+18:15904:x1872772280280320:12345-192.168.202.56@tcp:101:rm.0 Request processed in 2004us (2350us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015214.617062:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 492 00000100:00100000:2.0:1786015214.705645:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280280704 00000100:00100000:2.0:1786015214.705660:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280280704 00000100:00100000:2.0:1786015214.705725:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 122 00000100:00100000:2.0:1786015214.705735:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1872772280280704:12345-192.168.202.56@tcp:8:dd.0 00010000:00080000:2.0:1786015214.705857:0:6591:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:2.0:1786015214.705902:0:6591:0:(genops.c:1406:class_connect()) connect: client 60d0ccd6-6e87-411c-bc51-c64181e59585, cookie 0xb1a5ef690c4ff57e 00002000:00100000:2.0:1786015214.705919:0:6591:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 60d0ccd6-6e87-411c-bc51-c64181e59585/ffff8b738138e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786015214.705951:0:6591:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786015214.706135:0:6591:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1786015214.706196:0:6591:0:(import.c:65:import_set_state_nolock()) ffff8b7381388000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786015214.706300:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2350:x1872772280280704:12345-192.168.202.56@tcp:8:dd.0 Request processed in 564us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015214.706309:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 122 00000100:00100000:2.0:1786015214.710668:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280280832 00000100:00100000:2.0:1786015214.710684:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280280832 00000100:00100000:2.0:1786015214.754184:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280280960 00000100:00100000:2.0:1786015214.754200:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280280960 00002000:00100000:2.0:1786015214.754284:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (0->1048575) req@ffff8b74aa9af100 x1872772280280960/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:60/0 lens 488/0 e 0 to 0 dl 1786015225 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015214.754301:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aa9af100 with x1872772280280960 ext(0->1048575) 00002000:00010000:2.0:1786015214.754311:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74aa9af100 00000100:00100000:2.0:1786015214.768226:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304317056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015214.768353:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015214.770280:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304317056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015214.840675:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280280960:12345-192.168.202.56@tcp:4:dd.0 Request processed in 86048us (86716us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1786015214.840696:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 44 00002000:00100000:2.0:1786015214.840714:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (0->1048575) req@ffff8b74aa9af100 x1872772280280960/t4294967325(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:60/0 lens 488/448 e 0 to 0 dl 1786015225 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015214.840810:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aa9af100 with x1872772280280960 ext(0->1048575) 00002000:00010000:2.0:1786015214.840819:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74aa9af100 00000100:00100000:2.0:1786015214.940917:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 124 00000100:00100000:2.0:1786015214.940933:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280281216:12345-192.168.202.56@tcp:16:dd.0 00000100:00100000:2.0:1786015215.044322:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280281216:12345-192.168.202.56@tcp:16:dd.0 Request processed in 103374us (103800us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015215.044340:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 124 00000100:00100000:2.0:1786015215.119009:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280281600 00000100:00100000:2.0:1786015215.119030:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280281600 00000100:00100000:2.0:1786015215.119108:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 495 00000100:00100000:2.0:1786015215.119118:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+45:15912:x1872772280281600:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015215.119147:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015215.119185:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ff58c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7c2b expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015215.119306:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff593 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015215.119331:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff593 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015215.119356:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff593 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015215.119711:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1786015215.119717:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015215.119836:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff593 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015215.119876:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ff58c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c2b expref: 47 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015215.119900:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff593 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c2b expref: 46 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015215.119910:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74938ba500) 00010000:00010000:2.0:1786015215.119914:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015215.119917:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1a00, rc 0) 00000100:00100000:2.0:1786015215.119999:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+46:15912:x1872772280281600:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 882us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015215.120006:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 495 00000100:00100000:2.0:1786015215.123321:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:3.0:1786015215.129003:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7a00/0xb1a5ef690c4ff5cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.129021:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7a00/0xb1a5ef690c4ff5cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015215.129065:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1048576 00000004:00200000:3.0:1786015215.129070:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015215.129093:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7a00/0xb1a5ef690c4ff5cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.129106:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7a00/0xb1a5ef690c4ff5cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.129115:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c4ff5bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.129122:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c4ff5bd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.129128:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c4ff5bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.129134:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e7200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015215.129138:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c4ff5bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.129146:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c4ff5bd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.129159:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8b749802e200) 00010000:00010000:3.0:1786015215.129161:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015215.129177:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c4ff5bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.129194:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c4ff5bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.129208:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.129213:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff5c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.129219:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff5c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.129223:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015215.129226:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff5c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.129231:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff5c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.129237:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x9fe5cc27 (ffff8b74b0022b00) 00010000:00010000:3.0:1786015215.129239:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015215.129241:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff5c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.129246:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff5c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.129279:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c4ff5b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c39 expref: 49 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.129291:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7a00/0xb1a5ef690c4ff5cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c39 expref: 48 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.129304:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8b749802ef00) 00010000:00010000:3.0:1786015215.129307:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015215.129309:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e7a00, rc 0) 00000100:00100000:3.0:1786015215.129389:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+48:15912:x1872772280281856:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1147us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015215.129397:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 497 00000100:00100000:3.0:1786015215.133068:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280281984 00000100:00100000:3.0:1786015215.133081:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280281984 00000100:00100000:3.0:1786015215.133184:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 125 00000100:00100000:3.0:1786015215.133197:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+8:2354:x1872772280281984:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015215.133231:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015215.133261:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc3c3574/0xb1a5ef690c4ff5d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7c40 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015215.133353:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304317184:192.168.202.56@tcp:106: 00000100:00100000:3.0:1786015215.133596:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7490fa2000 going to sleep for 11 seconds 00002000:00010000:3.0:1786015215.150440:0:6592:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:3.0:1786015215.150454:0:6592:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb mtime: 0 -> 1786015214 00002000:00010000:3.0:1786015215.150457:0:6592:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb atime: 0 -> 1786015214 00002000:00010000:3.0:1786015215.150459:0:6592:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb ctime: 0 -> 1786015214 00002000:00010000:3.0:1786015215.150462:0:6592:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb blocks: 1 -> 2051 00000100:00100000:3.0:1786015215.150497:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304317184:192.168.202.56@tcp:106: 00010000:00010000:3.0:1786015215.150552:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc3c3574/0xb1a5ef690c4ff5d2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c40 expref: 9 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.150616:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc3c3574/0xb1a5ef690c4ff5d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c40 expref: 9 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015215.150634:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e7000, rc 0) 00000100:00100000:3.0:1786015215.150811:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+8:2354:x1872772280281984:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 17564us (17835us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015215.150824:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 125 00000100:00100000:3.0:1786015215.155003:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015215.155129:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280282112 00000100:00100000:2.0:1786015215.155144:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280282112 00000100:00100000:2.0:1786015215.155472:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 498 00000100:00100000:2.0:1786015215.155487:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+48:15912:x1872772280282112:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015215.155518:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015215.155546:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ff5d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7c47 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015215.155642:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0800/0xb1a5ef690c4ff5e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015215.155660:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0800/0xb1a5ef690c4ff5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015215.155914:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0800/0xb1a5ef690c4ff5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015215.156329:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1786015215.156335:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015215.156496:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0800/0xb1a5ef690c4ff5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015215.156539:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ff5d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c47 expref: 50 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015215.156561:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0800/0xb1a5ef690c4ff5e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c47 expref: 49 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015215.156572:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8b749802e200) 00010000:00010000:2.0:1786015215.156576:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015215.156580:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a0800, rc 0) 00000100:00100000:2.0:1786015215.157052:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+49:15912:x1872772280282112:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1564us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015215.157063:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 498 00000100:00100000:2.0:1786015215.162498:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015215.171577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000040:00080000:2.0:1786015216.110491:0:14084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015216.110506:0:14084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015216.111418:0:14084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015216.111437:0:14084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786015217.451914:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015217.729599:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015217.729651:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015217.729684:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015217.729723:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015217.729746:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015217.729790:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015217.729831:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280282624 00000100:00100000:2.0:1786015217.729845:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280282624 00000100:00100000:2.0:1786015217.729932:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 327 00000100:00100000:2.0:1786015217.729945:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280282624:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015217.730040:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280282624:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 97us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015217.730048:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 327 00000100:00100000:2.0:1786015217.730094:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280282880 00000100:00100000:2.0:1786015217.730097:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280282880 00000100:00100000:2.0:1786015217.730150:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280283008 00000100:00100000:2.0:1786015217.730153:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280283008 00000100:00100000:2.0:1786015217.730172:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280283264 00000100:00100000:2.0:1786015217.730175:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280283264 00000100:00100000:2.0:1786015217.730192:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 164 00000100:00100000:2.0:1786015217.730198:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+9:2352:x1872772280282880:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015217.730248:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+9:2352:x1872772280282880:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 49us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015217.730255:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 164 00000100:00100000:2.0:1786015217.730267:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 165 00000100:00100000:2.0:1786015217.730273:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+8:2352:x1872772280283008:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015217.730299:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+8:2352:x1872772280283008:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015217.730306:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 165 00000100:00100000:2.0:1786015217.730412:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 166 00000100:00100000:2.0:1786015217.730420:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2352:x1872772280283264:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015217.730448:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2352:x1872772280283264:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015217.730456:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 166 00000100:00100000:2.0:1786015217.730478:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280283136 00000100:00100000:2.0:1786015217.730482:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280283136 00000100:00100000:2.0:1786015217.730514:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280282752 00000100:00100000:2.0:1786015217.730518:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280282752 00000100:00100000:2.0:1786015217.730540:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 227 00000100:00100000:2.0:1786015217.730546:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+19:2352:x1872772280283136:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015217.730583:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+19:2352:x1872772280283136:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 37us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015217.730590:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 227 00000100:00100000:2.0:1786015217.730603:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 228 00000100:00100000:2.0:1786015217.730609:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+49:2352:x1872772280282752:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015217.730635:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+49:2352:x1872772280282752:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015217.730641:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 228 00000100:00080000:2.0:1786015217.732823:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786015217.732837:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015217.732841:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015217.837218:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304317440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015217.837326:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015217.837455:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304317440 00000100:00100000:3.0:1786015217.837467:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304317440 00000100:00100000:3.0:1786015217.837549:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1786015217.837561:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304317440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015217.837614:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015217.837683:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304317440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015217.837691:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1786015217.837745:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304317440:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786015217.837838:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786015218.475992:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015219.372912:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304317696:0@lo:400:kworker.0 00000100:00100000:3.0:1786015219.373018:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015219.373096:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304318208:0@lo:400:kworker.0 00000100:00100000:3.0:1786015219.373149:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015219.373188:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015219.373194:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304317824:0@lo:400:kworker.0 00000100:00100000:3.0:1786015219.373219:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015219.373264:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304318208 00000100:00100000:3.0:1786015219.373274:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304318208 00000100:00100000:2.0:1786015219.373902:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304317696 00000100:00100000:2.0:1786015219.373915:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304317696 00000100:00100000:2.0:1786015219.373960:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304317824 00000100:00100000:2.0:1786015219.373964:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304317824 00000100:00100000:2.0:1786015219.373987:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304318080 00000100:00100000:2.0:1786015219.373991:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304318080 00000100:00100000:2.0:1786015219.374010:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1786015219.374016:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304317696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015219.374070:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304317696:12345-0@lo:400:kworker.0 Request processed in 54us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015219.374077:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1786015219.374094:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1786015219.374101:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304317824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015219.374142:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304317824:12345-0@lo:400:kworker.0 Request processed in 41us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015219.374149:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1786015219.374169:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1786015219.374174:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304318080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015219.374209:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304318080:12345-0@lo:400:kworker.0 Request processed in 34us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015219.374216:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1786015219.374237:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304317952 00000100:00100000:2.0:1786015219.374241:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304317952 00000100:00100000:2.0:1786015219.374270:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1786015219.374277:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304317952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015219.374324:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304317952:12345-0@lo:400:kworker.0 Request processed in 47us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015219.374330:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1786015219.374380:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304317952:0@lo:400:kworker.0 00000100:00100000:2.0:1786015219.374391:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304318080:0@lo:400:kworker.0 00000100:00100000:3.0:1786015219.374699:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1786015219.374710:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304318208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015219.374756:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304318208:12345-0@lo:400:kworker.0 Request processed in 49us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015219.374786:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1786015219.374810:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786015219.374815:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015219.374818:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015219.374841:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304317824:0@lo:400:kworker.0 00000100:00100000:3.0:1786015219.374853:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304317696:0@lo:400:kworker.0 00000100:00100000:3.0:1786015219.374864:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304318208:0@lo:400:kworker.0 00010000:00010000:2.0:1786015219.504849:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015219.900794:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304318336 00000100:00100000:3.0:1786015219.900806:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304318336 00000100:00100000:3.0:1786015219.900868:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1786015219.900880:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304318336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015219.900949:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015219.901033:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304318336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015219.901042:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1786015219.901107:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304318336:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786015221.547998:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015222.573917:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786015222.647526:0:14281:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 8: Test default archive number ======== 07:20:21 (1786015221) 00000100:00100000:2.0:1786015222.854530:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015222.861686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015222.861726:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015222.861745:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015222.861783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015222.861859:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015222.861886:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280283904 00000100:00100000:2.0:1786015222.861897:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280283904 00000100:00100000:2.0:1786015222.861955:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280283520 00000100:00100000:2.0:1786015222.861959:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280283520 00000100:00100000:2.0:1786015222.861985:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 232 00000100:00100000:2.0:1786015222.861995:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+18:2354:x1872772280283904:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015222.862067:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+18:2354:x1872772280283904:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 74us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015222.862075:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 232 00000100:00100000:2.0:1786015222.862102:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 233 00000100:00100000:2.0:1786015222.862109:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+49:2354:x1872772280283520:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015222.862136:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+49:2354:x1872772280283520:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015222.862141:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 233 00000100:00100000:2.0:1786015222.862165:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280283648 00000100:00100000:2.0:1786015222.862168:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280283648 00000100:00100000:2.0:1786015222.862487:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280283776 00000100:00100000:2.0:1786015222.862504:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280283776 00000100:00100000:2.0:1786015222.862521:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280284032 00000100:00100000:2.0:1786015222.862523:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280284032 00000100:00100000:2.0:1786015222.862539:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 169 00000100:00100000:2.0:1786015222.862545:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+9:2354:x1872772280283648:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015222.862574:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+9:2354:x1872772280283648:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015222.862581:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 169 00000100:00100000:2.0:1786015222.862594:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 170 00000100:00100000:2.0:1786015222.862600:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+8:2354:x1872772280283776:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015222.862623:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+8:2354:x1872772280283776:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015222.862629:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 170 00000100:00100000:2.0:1786015222.862640:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 171 00000100:00100000:2.0:1786015222.862646:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2354:x1872772280284032:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015222.862666:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2354:x1872772280284032:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015222.862671:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 171 00000100:00080000:2.0:1786015222.862686:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015222.862690:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015222.862693:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015222.956053:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304318464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015222.956174:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015222.956376:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304318464 00000100:00100000:3.0:1786015222.956384:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304318464 00000100:00100000:3.0:1786015222.956448:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1786015222.956458:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304318464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015222.956494:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015222.956548:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304318464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015222.956555:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1786015222.956575:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015222.956613:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304318464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015223.146259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015223.152839:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015223.152914:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015223.153129:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280284416 00000100:00100000:2.0:1786015223.153142:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280284416 00000100:00100000:2.0:1786015223.153234:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 501 00000100:00100000:2.0:1786015223.153246:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+20:16513:x1872772280284416:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1786015223.153390:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+20:16513:x1872772280284416:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 145us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015223.153398:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 501 00000100:00100000:3.0:1786015223.174785:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+49:16514:x1872772280284672:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 2182us (7103us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015223.174795:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 502 00000100:00100000:2.0:1786015223.183299:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280284928 00000100:00100000:2.0:1786015223.183309:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280284928 00000100:00100000:2.0:1786015223.183382:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 503 00000100:00100000:2.0:1786015223.183393:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+49:16514:x1872772280284928:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:2.0:1786015223.183471:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015223.183505:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff593 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c2b expref: 49 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.183529:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74938ba500) 00010000:00010000:2.0:1786015223.183534:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015223.183898:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1800/0xb1a5ef690c4ff626 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.183914:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff50e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c01 expref: 18 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.183923:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1800/0xb1a5ef690c4ff626 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.189142:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff50e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c01 expref: 18 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.189173:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff50e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c01 expref: 18 pid: 7673 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015223.189265:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8979f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304318592:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015223.189506:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b73826a4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786015223.199729:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:2.0:1786015223.201533:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1800/0xb1a5ef690c4ff626 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.201543:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1800/0xb1a5ef690c4ff626 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.201576:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff62d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.201586:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff62d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.201595:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff62d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015223.202996:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 512 00010000:00010000:2.0:1786015223.203013:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1800/0xb1a5ef690c4ff626 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.203023:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1800/0xb1a5ef690c4ff626 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.203031:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1800/0xb1a5ef690c4ff626 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.203037:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015223.203042:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1800/0xb1a5ef690c4ff626 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.203050:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1800/0xb1a5ef690c4ff626 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.203065:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74938ba500) 00010000:00010000:2.0:1786015223.203081:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015223.203096:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1800/0xb1a5ef690c4ff626 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.203114:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1800/0xb1a5ef690c4ff626 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015223.203139:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c66b47e9 reply state 00000000c4fc1966 transno 4294967675 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff62d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015223.203149:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786015223.203255:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+50:16514:x1872772280284928:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 19860us (20151us total) trans 4294967675 rc 0/0 00000100:00100000:2.0:1786015223.203264:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 503 00000100:00100000:3.0:1786015223.220817:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280285184 00000100:00100000:3.0:1786015223.220828:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280285184 00000100:00100000:3.0:1786015223.220889:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 504 00000100:00100000:3.0:1786015223.220900:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+49:16515:x1872772280285184:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1786015223.220926:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015223.220950:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c4ff634 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7c63 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.221031:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c4ff63b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.221046:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c4ff63b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.221057:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c4ff63b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015223.221142:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1786015223.221146:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015223.221191:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c4ff63b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.221217:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c4ff634 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c63 expref: 51 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.221235:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c4ff63b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c63 expref: 50 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.221244:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022100) 00010000:00010000:3.0:1786015223.221247:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015223.221263:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e7000, rc 0) 00000100:00100000:3.0:1786015223.221397:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+50:16515:x1872772280285184:12345-192.168.202.56@tcp:101:bash.0 Request processed in 497us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015223.221405:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 504 00000100:00100000:3.0:1786015223.231491:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015223.231608:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280285312 00000100:00100000:2.0:1786015223.231622:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280285312 00000100:00100000:2.0:1786015223.231693:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 505 00000100:00100000:2.0:1786015223.231704:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+50:16515:x1872772280285312:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1786015223.231727:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015223.231750:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1800/0xb1a5ef690c4ff642 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7c6a expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.231865:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff649 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.231880:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff649 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.231894:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff649 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.231909:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff650 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.231942:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.231948:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232100:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0c00/0xb1a5ef690c4ff657 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232109:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0c00/0xb1a5ef690c4ff657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232117:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0c00/0xb1a5ef690c4ff657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015223.232152:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 512 00000004:00200000:2.0:1786015223.232157:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015223.232184:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0c00/0xb1a5ef690c4ff657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232197:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff649 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232203:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff649 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232209:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff649 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232215:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015223.232218:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff649 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232233:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff649 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232246:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022100) 00010000:00010000:2.0:1786015223.232249:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015223.232254:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff649 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232260:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff649 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232548:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232556:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff650 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232563:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff650 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232568:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a0200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015223.232570:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff650 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232576:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff650 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232584:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc1d08857 (ffff8b74938ba500) 00010000:00010000:2.0:1786015223.232586:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015223.232589:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff650 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232604:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff650 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232639:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1800/0xb1a5ef690c4ff642 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c6a expref: 52 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232653:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0c00/0xb1a5ef690c4ff657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c6a expref: 51 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.232660:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8b74938ba800) 00010000:00010000:2.0:1786015223.232662:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786015223.232664:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a0c00, rc 0) 00000100:00100000:2.0:1786015223.232734:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+51:16515:x1872772280285312:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1030us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015223.232741:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 505 00000100:00100000:2.0:1786015223.240663:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280285440 00000100:00100000:2.0:1786015223.240676:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280285440 00000100:00100000:2.0:1786015223.240752:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 506 00000100:00100000:2.0:1786015223.240798:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+51:16515:x1872772280285440:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1786015223.240824:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015223.240848:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff65e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7c71 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.240925:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff665 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.240941:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff665 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.240981:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff665 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.240999:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff66c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.241007:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff66c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.241015:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff66c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.241109:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff665 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.241117:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff665 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.241123:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff665 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.241129:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a0000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015223.241133:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff665 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.241141:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff665 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.241153:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8b74938ba800) 00010000:00010000:2.0:1786015223.241156:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015223.241160:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff665 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.241173:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff665 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.241187:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff66c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.241192:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff66c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.241198:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff66c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.241203:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015223.241206:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff66c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.241212:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff66c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.241219:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x70ee8377 (ffff8b74938ba200) 00010000:00010000:2.0:1786015223.241221:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015223.241225:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff66c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.241230:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff66c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.241280:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff65e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c71 expref: 52 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.241304:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8b74938ba800) 00010000:00010000:2.0:1786015223.241306:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015223.241310:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff65e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c71 expref: 52 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.241320:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a0600, rc 0) 00000100:00100000:2.0:1786015223.241391:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+51:16515:x1872772280285440:12345-192.168.202.56@tcp:101:bash.0 Request processed in 629us (936us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015223.241398:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 506 00000100:00100000:2.0:1786015223.274978:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280285696 00000100:00100000:2.0:1786015223.274990:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280285696 00000100:00100000:2.0:1786015223.275065:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 508 00000100:00100000:2.0:1786015223.275076:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+19:16516:x1872772280285696:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015223.275113:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015223.275144:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff681 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7c7f expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275280:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff688 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275299:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff688 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275313:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff688 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275330:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff68f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275345:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff68f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275352:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff68f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275475:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1800/0xb1a5ef690c4ff696 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275483:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1800/0xb1a5ef690c4ff696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275490:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1800/0xb1a5ef690c4ff696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015223.275524:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 512 00000004:00200000:2.0:1786015223.275528:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015223.275554:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1800/0xb1a5ef690c4ff696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275567:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff688 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275574:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff688 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275582:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff688 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275589:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015223.275594:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff688 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275608:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff688 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275621:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022100) 00010000:00010000:2.0:1786015223.275624:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015223.275628:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff688 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275634:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff688 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275649:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff68f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275655:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff68f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275660:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff68f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275665:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a0000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015223.275667:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff68f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275672:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff68f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275679:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc1d08857 (ffff8b74938ba200) 00010000:00010000:2.0:1786015223.275681:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015223.275684:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff68f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275699:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff68f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275736:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff681 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c7f expref: 21 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275749:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1800/0xb1a5ef690c4ff696 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c7f expref: 20 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.275756:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8b74938ba800) 00010000:00010000:2.0:1786015223.275810:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786015223.275815:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1800, rc 0) 00000100:00100000:2.0:1786015223.275881:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+20:16516:x1872772280285696:12345-192.168.202.56@tcp:101:rm.0 Request processed in 806us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015223.275889:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 508 00000100:00100000:2.0:1786015223.293812:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280285952 00000100:00100000:2.0:1786015223.293823:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280285952 00000100:00100000:2.0:1786015223.293896:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 510 00000100:00100000:2.0:1786015223.293907:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+20:16516:x1872772280285952:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015223.293928:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015223.293952:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff6b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7c8d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294024:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff6b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294038:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff6b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294064:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff6b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294106:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff6c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294113:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294120:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294184:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff6b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294191:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff6b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294198:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff6b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294204:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a0000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015223.294208:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff6b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294215:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff6b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294226:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8b74938ba800) 00010000:00010000:2.0:1786015223.294229:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015223.294234:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff6b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294248:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0000/0xb1a5ef690c4ff6b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294262:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294281:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff6c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294286:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff6c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294291:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015223.294294:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff6c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294299:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff6c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294306:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x70ee8377 (ffff8b74938ba200) 00010000:00010000:2.0:1786015223.294309:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015223.294311:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff6c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294317:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff6c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294353:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff6b2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c8d expref: 21 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294376:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8b74938ba800) 00010000:00010000:2.0:1786015223.294378:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015223.294383:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff6b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c8d expref: 21 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.294392:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a0600, rc 0) 00000100:00100000:2.0:1786015223.294463:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+20:16516:x1872772280285952:12345-192.168.202.56@tcp:101:rm.0 Request processed in 558us (820us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015223.294472:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 510 00000100:00100000:3.0:1786015223.313589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015223.344721:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015223.347711:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280286464 00000100:00100000:3.0:1786015223.347729:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280286464 00000100:00100000:3.0:1786015223.347816:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 513 00000100:00100000:3.0:1786015223.347829:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+20:16517:x1872772280286464:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015223.347854:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015223.348044:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c4ff6f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7ca2 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.348429:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff6f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.348447:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff6f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.348460:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff6f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.348477:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c4ff6ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.348483:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c4ff6ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.348489:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c4ff6ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786015223.349839:0:12526:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xb:0x0], index 0: 0 00010000:00010000:3.0:1786015223.350464:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179e00/0xb1a5ef690c4ff706 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.350479:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179e00/0xb1a5ef690c4ff706 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.350491:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179e00/0xb1a5ef690c4ff706 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.350530:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff6f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.350537:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff6f8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.350543:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff6f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.350550:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015223.350554:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff6f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.350562:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff6f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.350574:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8b74938ba800) 00010000:00010000:3.0:1786015223.350577:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015223.350581:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff6f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.350601:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff6f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015223.350617:0:12526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026c63081 reply state 00000000114b5737 transno 4294967676 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c4ff6ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015223.350628:0:12526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786015223.350667:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c4ff6f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ca2 expref: 23 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.350682:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179e00/0xb1a5ef690c4ff706 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ca2 expref: 22 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.350690:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff8b74b0022a00) 00010000:00010000:3.0:1786015223.350692:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015223.350695:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2179e00, rc 0) 00000100:00100000:3.0:1786015223.350836:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+23:16517:x1872772280286464:12345-192.168.202.56@tcp:101:cp.0 Request processed in 3009us (6125us total) trans 4294967676 rc 0/0 00000100:00100000:3.0:1786015223.350846:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 513 00000100:00100000:2.0:1786015223.355107:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280286592 00000100:00100000:2.0:1786015223.355120:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280286592 00000100:00100000:2.0:1786015223.355177:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 127 00000100:00100000:2.0:1786015223.355185:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1872772280286592:12345-192.168.202.56@tcp:8:cp.0 00010000:00080000:2.0:1786015223.355219:0:6591:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:2.0:1786015223.355249:0:6591:0:(genops.c:1406:class_connect()) connect: client 60d0ccd6-6e87-411c-bc51-c64181e59585, cookie 0xb1a5ef690c4ff714 00002000:00100000:2.0:1786015223.355260:0:6591:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 60d0ccd6-6e87-411c-bc51-c64181e59585/ffff8b738138f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786015223.355282:0:6591:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786015223.355435:0:6591:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786015223.355469:0:6591:0:(import.c:65:import_set_state_nolock()) ffff8b7381389000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786015223.355545:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2350:x1872772280286592:12345-192.168.202.56@tcp:8:cp.0 Request processed in 358us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015223.355553:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 127 00000100:00100000:3.0:1786015223.366081:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280286720 00000100:00100000:3.0:1786015223.366103:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280286720 00000100:00100000:3.0:1786015223.366198:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 128 00000100:00100000:3.0:1786015223.366209:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+6:0:x1872772280286720:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015223.366233:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015223.366257:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099602e2a/0xb1a5ef690c4ff71b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7ca9 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015223.366313:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786015223.366336:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1786015223.366341:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015223.366349:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099602e2a/0xb1a5ef690c4ff71b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ca9 expref: 7 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.366368:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000099602e2a/0xb1a5ef690c4ff71b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ca9 expref: 7 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.366381:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2178a00, rc 0) 00000100:00100000:3.0:1786015223.366453:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+7:0:x1872772280286720:12345-192.168.202.56@tcp:101:cp.0 Request processed in 247us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015223.366461:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 128 00000100:00080000:2.0:1786015223.369175:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015223.375108:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280286848 00000100:00100000:2.0:1786015223.375120:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280286848 00000100:00100000:2.0:1786015223.375166:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 129 00000100:00100000:2.0:1786015223.375183:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+7:16517:x1872772280286848:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015223.375202:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015223.375221:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec18bc08/0xb1a5ef690c4ff722 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7cb0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.375256:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000099602e2a/0xb1a5ef690c4ff71b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ca9 expref: 8 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.375272:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015223.375278:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015223.375283:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec18bc08/0xb1a5ef690c4ff722 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7cb0 expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.375318:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000099602e2a/0xb1a5ef690c4ff71b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ca9 expref: 8 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.375332:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000099602e2a/0xb1a5ef690c4ff71b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ca9 expref: 8 pid: 11384 timeout: 558 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015223.375347:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8979f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304318720:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015223.375439:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b73826a4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786015223.380589:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8979f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304318720:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015223.380631:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec18bc08/0xb1a5ef690c4ff722 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7cb0 expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.380670:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1600, rc 0) 00000100:00100000:2.0:1786015223.380739:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:16517:x1872772280286848:12345-192.168.202.56@tcp:101:cp.0 Request processed in 5564us (5912us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015223.380748:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 129 00000100:00100000:2.0:1786015223.393042:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280286976 00000100:00100000:2.0:1786015223.393053:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280286976 00010000:00010000:2.0:1786015223.393119:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000099602e2a/0xb1a5ef690c4ff71b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ca9 expref: 8 pid: 11384 timeout: 558 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015223.393196:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 165 00000100:00100000:2.0:1786015223.393207:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280286976:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015223.393225:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015223.393247:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000099602e2a/0xb1a5ef690c4ff71b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ca9 expref: 8 pid: 11384 timeout: 558 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.393261:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000099602e2a/0xb1a5ef690c4ff71b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ca9 expref: 8 pid: 11384 timeout: 558 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.393285:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099602e2a/0xb1a5ef690c4ff71b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ca9 expref: 8 pid: 11384 timeout: 558 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.393306:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015223.393311:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015223.393320:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec18bc08/0xb1a5ef690c4ff722 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7cb0 expref: 7 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.393342:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec18bc08/0xb1a5ef690c4ff722 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7cb0 expref: 7 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.393376:0:5780:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ec18bc08/0xb1a5ef690c4ff722 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7cb0 expref: 7 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015223.393392:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8979f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5780:1872772304318848:192.168.202.56@tcp:105: 00000100:00100000:2.0:1786015223.393476:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b73826a4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786015223.399702:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8979f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5780:1872772304318848:192.168.202.56@tcp:105: 00010000:00010000:2.0:1786015223.399724:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015223.399891:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280287232 00000100:00100000:3.0:1786015223.399898:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280287232 00000100:00100000:3.0:1786015223.399963:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 115 00000100:00100000:3.0:1786015223.399970:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+22:16517:x1872772280287232:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:2.0:1786015223.400133:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2353:x1872772280286976:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 6926us (7268us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015223.400143:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 165 00000100:00100000:3.0:1786015223.400308:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+23:16517:x1872772280287232:12345-192.168.202.56@tcp:35:cp.0 Request processed in 337us (745us total) trans 4294967677 rc 0/0 00000100:00100000:3.0:1786015223.400315:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 115 00000100:00100000:3.0:1786015223.476711:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280287488 00000100:00100000:3.0:1786015223.476722:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280287488 00000100:00100000:3.0:1786015223.476809:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 130 00000100:00100000:3.0:1786015223.476819:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+9:2352:x1872772280287488:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015223.476854:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015223.476873:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c4ff745 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7cbe expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015223.476927:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383948a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304318976:192.168.202.56@tcp:106: 00000100:00100000:3.0:1786015223.477009:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce1240 going to sleep for 11 seconds 00002000:00010000:3.0:1786015223.482651:0:11384:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size: 0 -> 1516 00002000:00010000:3.0:1786015223.482664:0:11384:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb mtime: 0 -> 1786015223 00002000:00010000:3.0:1786015223.482667:0:11384:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb atime: 0 -> 1786015223 00002000:00010000:3.0:1786015223.482669:0:11384:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb ctime: 0 -> 1786015223 00000100:00100000:3.0:1786015223.482701:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383948a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304318976:192.168.202.56@tcp:106: 00010000:00010000:3.0:1786015223.482746:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c4ff745 lrc: 1/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7cbe expref: 10 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.482802:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c4ff745 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7cbe expref: 10 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.482821:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2178000, rc 0) 00000100:00100000:3.0:1786015223.482912:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+9:2352:x1872772280287488:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 6093us (6357us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015223.482921:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 130 00010000:00010000:2.0:1786015223.596071:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015223.672684:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280288128 00000100:00100000:2.0:1786015223.672706:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280288128 00000100:00100000:2.0:1786015223.672833:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 517 00000100:00100000:2.0:1786015223.672846:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+24:16530:x1872772280288128:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015223.672897:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xc:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015223.673061:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+24:16530:x1872772280288128:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 217us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015223.673070:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 517 00000100:00100000:2.0:1786015223.683228:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015223.701550:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015223.701652:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015223.703015:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280288640 00000100:00100000:2.0:1786015223.703052:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280288640 00000100:00100000:2.0:1786015223.703123:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 132 00000100:00100000:2.0:1786015223.703133:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2352:x1872772280288640:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786015223.703185:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000047e21f60/0xb1a5ef690c4ff776 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.703220:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec18bc08/0xb1a5ef690c4ff722 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7cb0 expref: 6 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.703230:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015223.703235:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786015223.703239:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047e21f60/0xb1a5ef690c4ff776 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.703299:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec18bc08/0xb1a5ef690c4ff722 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7cb0 expref: 6 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.703317:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec18bc08/0xb1a5ef690c4ff722 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7cb0 expref: 6 pid: 6591 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015223.703337:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304319360:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015223.703419:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b73826a46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786015223.727405:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:3.0:1786015223.744601:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047e21f60/0xb1a5ef690c4ff776 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.744679:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047e21f60/0xb1a5ef690c4ff776 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.744734:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000047e21f60/0xb1a5ef690c4ff776 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.744744:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047e21f60/0xb1a5ef690c4ff776 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.744753:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047e21f60/0xb1a5ef690c4ff776 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.744813:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a0a00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015223.744819:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047e21f60/0xb1a5ef690c4ff776 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.744829:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047e21f60/0xb1a5ef690c4ff776 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.744857:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047e21f60/0xb1a5ef690c4ff776 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015223.744865:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047e21f60/0xb1a5ef690c4ff776 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015223.745036:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2352:x1872772280288640:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 41896us (43375us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015223.745049:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 132 00000100:00100000:3.0:1786015223.748910:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280289152 00000100:00100000:3.0:1786015223.748927:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280289152 00000100:00100000:3.0:1786015223.749016:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 519 00000100:00100000:3.0:1786015223.749028:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+24:16530:x1872772280289152:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786015223.749210:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+24:16530:x1872772280289152:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 184us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015223.749220:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 519 00000100:00100000:3.0:1786015223.791282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015223.799378:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280289920 00000100:00100000:2.0:1786015223.799394:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280289920 00000100:00100000:2.0:1786015223.799483:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 522 00000100:00100000:2.0:1786015223.799496:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+25:16530:x1872772280289920:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015223.799574:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xc:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015223.799751:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+25:16530:x1872772280289920:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 257us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015223.799786:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 522 00000100:00100000:3.0:1786015223.817426:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015223.833115:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015223.839698:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280290304 00000100:00100000:2.0:1786015223.839723:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280290304 00000100:00100000:2.0:1786015223.840090:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 523 00000100:00100000:2.0:1786015223.840106:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+25:16530:x1872772280290304:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1786015223.840236:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff799 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.840260:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ff78b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ce1 expref: 25 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.840270:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff799 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.840323:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ff78b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ce1 expref: 25 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015223.840341:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ff78b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ce1 expref: 25 pid: 7673 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015223.840358:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304319488:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015223.840507:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b73826a4540 going to sleep for 11 seconds 00000100:00100000:2.0:1786015223.872551:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000040:00080000:2.0:1786015224.392477:0:14332:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015224.392490:0:14332:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015224.392527:0:14332:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 12 count 2 00000040:00080000:2.0:1786015224.392536:0:14332:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015224.488834:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00080000:3.0:1786015224.489114:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015224.512378:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280291456 00000100:00100000:2.0:1786015224.512390:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280291456 00000100:00100000:2.0:1786015224.512464:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 117 00000100:00100000:2.0:1786015224.512476:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+54:16533:x1872772280291456:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1786015224.513122:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+55:16533:x1872772280291456:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 645us (827us total) trans 4294967682 rc 0/0 00000100:00100000:2.0:1786015224.513132:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 117 00000100:00100000:3.0:1786015225.008143:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304320384 00000100:00100000:3.0:1786015225.008159:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304320384 00000100:00100000:3.0:1786015225.008242:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1786015225.008252:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304320384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015225.008293:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015225.012028:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304320384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3766us (6851us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015225.012044:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00010000:3.0:1786015225.645013:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015226.674139:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015227.691942:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015227.983999:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015227.984062:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015227.984103:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015227.984125:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015227.984143:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015227.984160:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015227.984189:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015227.984217:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280291840 00000100:00100000:3.0:1786015227.984227:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280291840 00000100:00100000:3.0:1786015227.984277:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280292352 00000100:00100000:3.0:1786015227.984279:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280292352 00000100:00100000:3.0:1786015227.984290:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280291968 00000100:00100000:3.0:1786015227.984292:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280291968 00000100:00100000:3.0:1786015227.984304:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280292224 00000100:00100000:3.0:1786015227.984306:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280292224 00000100:00100000:3.0:1786015227.984320:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 174 00000100:00100000:3.0:1786015227.984329:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+9:2352:x1872772280291840:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015227.984401:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+9:2352:x1872772280291840:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 74us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015227.984409:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 174 00000100:00100000:3.0:1786015227.984426:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 175 00000100:00100000:3.0:1786015227.984433:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2352:x1872772280292352:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015227.984457:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2352:x1872772280292352:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015227.984463:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 175 00000100:00100000:3.0:1786015227.984473:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 176 00000100:00100000:3.0:1786015227.984478:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+8:2352:x1872772280291968:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015227.985003:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+8:2352:x1872772280291968:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 523us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015227.985010:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 176 00000100:00100000:3.0:1786015227.985024:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 177 00000100:00100000:3.0:1786015227.985031:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280292224:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015227.985065:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280292224:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 34us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015227.985071:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 177 00000100:00100000:3.0:1786015228.076333:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304320512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015228.076409:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015228.076621:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304320512 00000100:00100000:2.0:1786015228.076629:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304320512 00000100:00100000:2.0:1786015228.076685:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1786015228.076694:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304320512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015228.076733:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015228.076806:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304320512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015228.076814:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:2.0:1786015228.076996:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015228.077215:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304320512:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1786015228.636702:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:2.0:1786015229.612962:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304321024:0@lo:400:kworker.0 00000100:00100000:2.0:1786015229.613002:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015229.613075:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786015229.613084:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304320640:0@lo:400:kworker.0 00000100:00100000:3.0:1786015229.623157:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304321024 00000100:00100000:3.0:1786015229.623170:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304321024 00000100:00100000:2.0:1786015229.623241:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015229.623306:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304321152:0@lo:400:kworker.0 00000100:00100000:2.0:1786015229.623351:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015229.623388:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304321280 00000100:00100000:2.0:1786015229.623392:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304321280 00000100:00100000:3.0:1786015229.623889:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1786015229.623898:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304321024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015229.623943:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304321024:12345-0@lo:400:kworker.0 Request processed in 47us (10939us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015229.623949:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1786015229.624224:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1786015229.624233:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304321280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015229.624275:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304321280:12345-0@lo:400:kworker.0 Request processed in 44us (2571us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015229.624282:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1786015229.624326:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304321280:0@lo:400:kworker.0 00000100:00100000:2.0:1786015229.624356:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304320640:0@lo:400:kworker.0 00000100:00100000:2.0:1786015229.624366:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304321152:0@lo:400:kworker.0 00000100:00100000:2.0:1786015229.624377:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304321024:0@lo:400:kworker.0 00000100:00100000:2.0:1786015229.626919:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304320896:0@lo:400:kworker.0 00000100:00100000:2.0:1786015230.656649:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:3.0:1786015230.764304:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015231.789139:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015232.588459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00080000:2.0:1786015232.589987:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015232.607932:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015233.086175:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015233.086234:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015233.086265:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015233.086302:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280293760 00000100:00100000:2.0:1786015233.086304:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015233.086313:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280293760 00000100:00100000:2.0:1786015233.086327:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015233.086349:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015233.086378:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280294016 00000100:00100000:3.0:1786015233.086381:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280294016 00000100:00100000:2.0:1786015233.086391:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015233.086395:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280293632 00000100:00100000:3.0:1786015233.086397:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280293632 00000100:00100000:3.0:1786015233.086408:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280294144 00000100:00100000:2.0:1786015233.086408:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280293376 00000100:00100000:3.0:1786015233.086410:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280294144 00000100:00100000:2.0:1786015233.086411:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280293376 00000100:00100000:3.0:1786015233.086434:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 180 00000100:00100000:2.0:1786015233.086435:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 333 00000100:00100000:3.0:1786015233.086443:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+8:2351:x1872772280293760:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015233.086443:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280293376:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015233.086615:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280293376:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 172us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015233.086679:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 333 00000100:00100000:2.0:1786015233.086720:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 181 00000100:00100000:2.0:1786015233.086727:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2351:x1872772280294016:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015233.095491:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+8:2351:x1872772280293760:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 9035us (9242us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015233.095521:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 180 00000100:00100000:3.0:1786015233.095579:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 182 00000100:00100000:3.0:1786015233.095593:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+9:2351:x1872772280293632:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015233.095646:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+9:2351:x1872772280293632:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 59us (9318us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015233.095654:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 182 00000100:00100000:3.0:1786015233.095666:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 183 00000100:00100000:3.0:1786015233.095674:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2351:x1872772280294144:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015233.096450:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2351:x1872772280294144:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 771us (10052us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015233.096460:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 183 00000100:00080000:3.0:1786015233.096567:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015233.096574:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786015233.096577:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015233.101937:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2351:x1872772280294016:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 14737us (15198us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015233.101955:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 181 00000100:00100000:3.0:1786015233.196618:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304321536 00000100:00100000:3.0:1786015233.196626:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304321536 00000100:00100000:3.0:1786015233.196692:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1786015233.196702:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304321536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015233.196739:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015233.196812:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304321536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015233.196836:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1786015234.732850:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304321792:0@lo:400:kworker.0 00000100:00100000:3.0:1786015234.732922:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015234.733008:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304322304:0@lo:400:kworker.0 00000100:00100000:3.0:1786015234.733039:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015234.733071:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015234.733078:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304321920:0@lo:400:kworker.0 00000100:00100000:3.0:1786015234.733101:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015234.733134:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304322304 00000100:00100000:3.0:1786015234.733141:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304322304 00000100:00100000:3.0:1786015234.733212:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1786015234.733222:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304322304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015234.733274:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304322304:12345-0@lo:400:kworker.0 Request processed in 53us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015234.733281:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1786015234.733304:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304321792 00000100:00100000:3.0:1786015234.733307:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304321792 00000100:00100000:3.0:1786015234.733329:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304321920 00000100:00100000:3.0:1786015234.733332:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304321920 00000100:00100000:3.0:1786015234.733350:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1786015234.733355:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304321792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015234.733388:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304321792:12345-0@lo:400:kworker.0 Request processed in 31us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015234.733394:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1786015234.733404:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1786015234.733410:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304321920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015234.733463:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304321920:12345-0@lo:400:kworker.0 Request processed in 53us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015234.733469:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1786015234.733489:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015234.733494:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015234.733522:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304321920:0@lo:400:kworker.0 00000100:00100000:3.0:1786015234.733533:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304321792:0@lo:400:kworker.0 00000100:00100000:3.0:1786015234.733541:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304322304:0@lo:400:kworker.0 00000100:00100000:2.0:1786015234.733744:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381940a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304322048:0@lo:400:kworker.0 00000100:00100000:2.0:1786015234.733799:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015234.733830:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786015234.733836:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304321664:0@lo:400:kworker.0 00000100:00100000:2.0:1786015234.733864:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015234.733885:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304322176:0@lo:400:kworker.0 00000100:00100000:2.0:1786015234.733907:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015234.734696:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304321664:0@lo:400:kworker.0 00000100:00100000:2.0:1786015234.734710:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304322176:0@lo:400:kworker.0 00000100:00100000:3.0:1786015234.735110:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304322048 00000100:00100000:3.0:1786015234.735117:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304322048 00000100:00100000:3.0:1786015234.735165:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1786015234.735172:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304322048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015234.735236:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304322048:12345-0@lo:400:kworker.0 Request processed in 63us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015234.735242:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1786015234.735599:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381940a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304322048:0@lo:400:kworker.0 00010000:00010000:3.0:1786015234.860263:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015235.246474:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015235.248655:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304322432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015235.248779:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015235.248875:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304322432 00000100:00100000:3.0:1786015235.248886:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304322432 00000100:00100000:3.0:1786015235.248949:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1786015235.248959:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304322432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015235.249024:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015235.249078:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304322432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015235.249097:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1786015235.249161:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304322432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015238.206251:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015238.206309:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015238.206343:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015238.206384:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015238.206412:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015238.206431:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015238.206457:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015238.206485:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280294272 00000100:00100000:3.0:1786015238.206496:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280294272 00000100:00100000:3.0:1786015238.206546:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 335 00000100:00100000:3.0:1786015238.206557:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280294272:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015238.206632:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280294272:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 76us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015238.206640:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 335 00000100:00100000:3.0:1786015238.206669:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280295040 00000100:00100000:3.0:1786015238.206672:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280295040 00000100:00100000:3.0:1786015238.206689:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 187 00000100:00100000:3.0:1786015238.206694:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2354:x1872772280294912:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015238.206800:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 188 00000100:00100000:2.0:1786015238.206816:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+9:2354:x1872772280294528:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015238.206878:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2354:x1872772280294912:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015238.206886:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 187 00000100:00100000:3.0:1786015238.206901:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 189 00000100:00100000:3.0:1786015238.206907:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2354:x1872772280295040:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015238.218914:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+9:2354:x1872772280294528:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 12087us (12488us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015238.218930:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 188 00000100:00100000:3.0:1786015238.246548:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2354:x1872772280295040:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 39624us (40073us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015238.246567:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 189 00000100:00100000:2.0:1786015238.316606:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304322560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015238.316676:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015238.317496:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304322560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015238.720418:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280295424 00000100:00100000:3.0:1786015238.720442:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280295424 00002000:00100000:3.0:1786015238.720494:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x9:0x0] (0->1515) req@ffff8b7382d0e680 x1872772280295424/t0(0) o4->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:84/0 lens 2008/0 e 0 to 0 dl 1786015249 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015238.720508:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7382d0e680 with x1872772280295424 ext(0->1515) 00002000:00010000:3.0:1786015238.720518:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7382d0e680 00000100:00100000:3.0:1786015238.720541:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280295552 00000100:00100000:3.0:1786015238.720546:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280295552 00002000:00100000:3.0:1786015238.720570:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xb:0x0] (0->646) req@ffff8b74bf3b0380 x1872772280295552/t0(0) o4->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:84/0 lens 1136/0 e 0 to 0 dl 1786015249 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015238.720588:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74bf3b0380 with x1872772280295552 ext(0->646) 00002000:00010000:3.0:1786015238.720592:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74bf3b0380 00000001:00080000:3.0:1786015238.920392:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:3.0:1786015238.957911:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015239.854540:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304322944:0@lo:400:kworker.0 00000100:00100000:3.0:1786015239.854582:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015239.854843:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304322688 00000100:00100000:2.0:1786015239.854852:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304322688 00000100:00100000:2.0:1786015239.854910:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1786015239.855441:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74864ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304322688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015239.855484:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74864ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304322688:12345-0@lo:400:kworker.0 Request processed in 566us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015239.855491:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1786015239.855555:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304323072:0@lo:400:kworker.0 00000100:00100000:2.0:1786015239.855588:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015239.856069:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304322944:0@lo:400:kworker.0 00000100:00100000:3.0:1786015239.857039:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304323200 00000100:00100000:3.0:1786015239.857050:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304323200 00000100:00100000:3.0:1786015239.857104:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304322816 00000100:00100000:3.0:1786015239.857119:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304322816 00000100:00100000:3.0:1786015239.857141:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1786015239.857149:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304323200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015239.857234:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304323200:12345-0@lo:400:kworker.0 Request processed in 86us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015239.857242:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1786015239.857260:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1786015239.857279:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304322816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015239.857309:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304322816:12345-0@lo:400:kworker.0 Request processed in 44us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015239.857315:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1786015239.870270:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304323072:0@lo:400:kworker.0 00000001:02000400:3.0:1786015240.274143:0:14732:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool 00010000:00010000:3.0:1786015243.056017:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015243.329446:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280296320 00000100:00100000:3.0:1786015243.329458:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280296320 00000100:00100000:3.0:1786015243.329518:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280295936 00000100:00100000:3.0:1786015243.329955:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280295936 00000100:00100000:3.0:1786015243.330095:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 253 00000100:00100000:3.0:1786015243.330103:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+52:2354:x1872772280295936:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015243.330133:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+52:2354:x1872772280295936:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015243.330140:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 253 00000100:00100000:2.0:1786015243.330294:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280295808 00000100:00100000:2.0:1786015243.330300:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280295808 00000100:00100000:2.0:1786015243.330329:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 337 00000100:00100000:2.0:1786015243.330335:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74864ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280295808:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015243.330362:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74864ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280295808:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015243.330368:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 337 00000100:00100000:3.0:1786015243.437054:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786015243.437081:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304323584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015243.437152:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1786015244.332102:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015244.332114:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015244.332642:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015244.332655:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015244.973447:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7488259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304323840:0@lo:400:kworker.0 00000100:00100000:3.0:1786015244.973488:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015244.973525:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b748825ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304324352:0@lo:400:kworker.0 00000100:00100000:3.0:1786015244.973566:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015244.973592:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015244.973599:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b748825aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304323968:0@lo:400:kworker.0 00000100:00100000:3.0:1786015244.973624:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015244.973678:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304324224 00000100:00100000:3.0:1786015244.973685:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304324224 00000100:00100000:3.0:1786015244.973731:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304323840 00000100:00100000:3.0:1786015244.973735:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304323840 00000100:00100000:3.0:1786015244.973754:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304323968 00000100:00100000:3.0:1786015244.973757:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304323968 00000100:00100000:3.0:1786015244.973793:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1786015244.973800:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304324224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015244.973845:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304324224:12345-0@lo:400:kworker.0 Request processed in 45us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015244.973853:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1786015244.973870:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1786015244.973886:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304323840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015244.973923:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304323840:12345-0@lo:400:kworker.0 Request processed in 47us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015244.973930:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1786015244.973942:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1786015244.973948:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304323968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015244.973977:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304323968:12345-0@lo:400:kworker.0 Request processed in 30us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015244.973983:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1786015244.974003:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304324096 00000100:00100000:3.0:1786015244.974007:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304324096 00000100:00100000:3.0:1786015244.974041:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304324352 00000100:00100000:3.0:1786015244.974044:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304324352 00000100:00100000:3.0:1786015244.974081:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1786015244.974087:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304324096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015244.974121:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304324096:12345-0@lo:400:kworker.0 Request processed in 35us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015244.974128:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1786015244.974139:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1786015244.974144:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304324352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015244.975951:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304324352:12345-0@lo:400:kworker.0 Request processed in 1802us (2380us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015244.975961:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1786015245.486407:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304324480:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786015247.147963:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015247.620647:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015247.633228:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280296960 00000100:00100000:3.0:1786015247.633245:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280296960 00000100:00100000:3.0:1786015247.633314:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 530 00000100:00100000:3.0:1786015247.633327:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+52:17654:x1872772280296960:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:3.0:1786015247.633413:0:7673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015247.633455:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c4ff63b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c63 expref: 52 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.633478:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022100) 00010000:00010000:3.0:1786015247.633485:0:7673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015247.633938:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c4ff7f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.633964:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934a00/0xb1a5ef690c4ff67a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c78 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.633975:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c4ff7f4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.634025:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934a00/0xb1a5ef690c4ff67a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c78 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.634292:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934a00/0xb1a5ef690c4ff67a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c78 expref: 19 pid: 5794 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015247.634313:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1222680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304324608:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015247.634505:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748570a480 going to sleep for 11 seconds 00000100:00100000:3.0:1786015247.658835:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280297216 00000100:00100000:3.0:1786015247.658861:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280297216 00000100:00100000:3.0:1786015247.658944:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 531 00000100:00100000:3.0:1786015247.658956:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+52:17655:x1872772280297216:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1786015247.658992:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015247.659027:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c4ff802 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7cfd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.659116:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c4ff809 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.659135:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c4ff809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.659170:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c4ff809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015247.659254:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1786015247.659259:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 13 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015247.659292:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c4ff809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.659321:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c4ff802 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7cfd expref: 54 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.659339:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c4ff809 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7cfd expref: 53 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.659346:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:3.0:1786015247.659348:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015247.659351:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2178c00, rc 0) 00000100:00100000:3.0:1786015247.659432:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+53:17655:x1872772280297216:12345-192.168.202.56@tcp:101:bash.0 Request processed in 477us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015247.659439:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 531 00000100:00100000:3.0:1786015247.664307:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280297344 00000100:00100000:3.0:1786015247.664321:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280297344 00000100:00100000:3.0:1786015247.664398:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 532 00000100:00100000:3.0:1786015247.664411:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+53:17655:x1872772280297344:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1786015247.664442:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015247.664472:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c4ff810 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7d04 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.664595:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ff817 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.664613:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ff817 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.664626:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ff817 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.664647:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba800/0xb1a5ef690c4ff81e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.664654:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba800/0xb1a5ef690c4ff81e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.664660:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba800/0xb1a5ef690c4ff81e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.664878:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bba00/0xb1a5ef690c4ff825 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.664888:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bba00/0xb1a5ef690c4ff825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.664896:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bba00/0xb1a5ef690c4ff825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015247.664936:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x21:0x0]: returning size 512 00000004:00200000:3.0:1786015247.664941:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015247.664970:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bba00/0xb1a5ef690c4ff825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.664997:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ff817 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.665004:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ff817 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.665012:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ff817 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.665019:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819ba400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015247.665025:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ff817 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.665034:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ff817 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.665049:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:3.0:1786015247.665052:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015247.665058:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ff817 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.665064:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ff817 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.665079:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba800/0xb1a5ef690c4ff81e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.665086:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba800/0xb1a5ef690c4ff81e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.665093:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba800/0xb1a5ef690c4ff81e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.665104:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819ba800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015247.665108:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba800/0xb1a5ef690c4ff81e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.665114:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba800/0xb1a5ef690c4ff81e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.665123:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4f27b7ce (ffff8b74b0022c00) 00010000:00010000:3.0:1786015247.665126:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015247.665129:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba800/0xb1a5ef690c4ff81e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.665136:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba800/0xb1a5ef690c4ff81e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.665177:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c4ff810 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d04 expref: 55 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.665196:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bba00/0xb1a5ef690c4ff825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d04 expref: 54 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.665205:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8b74b0022100) 00010000:00010000:3.0:1786015247.665207:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786015247.665210:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bba00, rc 0) 00000100:00100000:3.0:1786015247.665291:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+54:17655:x1872772280297344:12345-192.168.202.56@tcp:101:bash.0 Request processed in 883us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015247.665300:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 532 00000100:00100000:3.0:1786015247.669359:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280297472 00000100:00100000:3.0:1786015247.669381:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280297472 00000100:00100000:3.0:1786015247.669457:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 533 00000100:00100000:3.0:1786015247.669470:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+54:17655:x1872772280297472:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1786015247.669501:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015247.669532:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ff82c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7d0b expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669625:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ff833 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669644:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ff833 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669658:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ff833 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669676:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff83a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669684:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff83a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669690:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff83a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669819:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ff833 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669829:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ff833 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669836:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ff833 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669860:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bbe00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015247.669866:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ff833 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669875:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ff833 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669892:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8b74b0022100) 00010000:00010000:3.0:1786015247.669896:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015247.669902:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ff833 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669909:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ff833 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669924:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff83a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669929:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff83a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669936:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff83a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669941:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819ba000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015247.669944:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff83a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669951:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff83a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669971:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x3953761c (ffff8b74b0022600) 00010000:00010000:3.0:1786015247.669974:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015247.669977:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff83a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.669983:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff83a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.670222:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ff82c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d0b expref: 55 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.670237:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8b74b0022100) 00010000:00010000:3.0:1786015247.670239:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015247.670243:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ff82c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d0b expref: 55 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.670254:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb800, rc 0) 00000100:00100000:3.0:1786015247.670418:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+54:17655:x1872772280297472:12345-192.168.202.56@tcp:101:bash.0 Request processed in 950us (1300us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015247.670428:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 533 00000100:00100000:2.0:1786015247.680505:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280297600 00000100:00100000:2.0:1786015247.680520:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280297600 00000100:00100000:2.0:1786015247.680598:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 534 00000100:00100000:2.0:1786015247.680609:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+19:17656:x1872772280297600:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015247.680640:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015247.680669:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff841 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7d12 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.680786:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ff848 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.680804:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ff848 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.680818:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ff848 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015247.680911:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1786015247.680916:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 13 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015247.680959:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ff848 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.680991:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff841 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d12 expref: 21 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.681012:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ff848 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d12 expref: 20 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.681049:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:2.0:1786015247.681053:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015247.681058:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a0a00, rc 0) 00000100:00100000:2.0:1786015247.681135:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+20:17656:x1872772280297600:12345-192.168.202.56@tcp:101:rm.0 Request processed in 527us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015247.681143:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 534 00000100:00100000:2.0:1786015247.694454:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280297856 00000100:00100000:2.0:1786015247.694470:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280297856 00000100:00100000:2.0:1786015247.694547:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 536 00000100:00100000:2.0:1786015247.694560:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+21:17656:x1872772280297856:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015247.694592:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015247.694623:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff86b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7d20 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.694714:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff872 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.694733:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff872 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.694747:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff872 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.694793:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff879 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.694802:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.694828:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.694924:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff872 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.694933:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff872 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.694940:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff872 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.694947:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015247.694952:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff872 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.694962:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff872 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.694976:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8b74b0022100) 00010000:00010000:2.0:1786015247.694979:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015247.694985:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff872 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.694992:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff872 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.695004:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.695010:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff879 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.695022:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.695028:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015247.695043:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.695051:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff879 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.695060:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x3953761c (ffff8b74938bae00) 00010000:00010000:2.0:1786015247.695062:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015247.695065:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff879 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.695071:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff879 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.695115:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff86b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d20 expref: 22 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.695127:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8b74b0022100) 00010000:00010000:2.0:1786015247.695129:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015247.695133:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff86b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d20 expref: 22 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.695143:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1600, rc 0) 00000100:00100000:2.0:1786015247.695224:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+21:17656:x1872772280297856:12345-192.168.202.56@tcp:101:rm.0 Request processed in 666us (894us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015247.695242:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 536 00010000:00010000:2.0:1786015247.729857:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c4ff8cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.729875:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c4ff8cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.729884:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c4ff8cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.729891:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381935e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015247.729897:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c4ff8cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.729907:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c4ff8cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.729927:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x3953761c (ffff8b7482d4bf00) 00010000:00010000:2.0:1786015247.729930:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015247.729935:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c4ff8cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.729942:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c4ff8cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015247.754378:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000032923b65/0xb1a5ef690c4ff8e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d4a expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015247.754420:0:5781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7488258e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1872772304324864:192.168.202.56@tcp:105: 00000100:00100000:1.0:1786015247.754498:0:5781:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1318d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786015247.767317:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015247.767365:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280299136 00000100:00100000:1.0:1786015247.767377:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280299136 00000100:00100000:1.0:1786015247.767472:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 119 00000100:00100000:1.0:1786015247.767483:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7487303850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+23:17657:x1872772280299136:12345-192.168.202.56@tcp:35:cp.0 00000001:00080000:1.0:1786015247.767890:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967687 00000100:00100000:1.0:1786015247.768016:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7487303850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+25:17657:x1872772280299136:12345-192.168.202.56@tcp:35:cp.0 Request processed in 533us (711us total) trans 4294967688 rc 0/0 00000100:00100000:1.0:1786015247.768024:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 119 00000020:00080000:1.0:1786015247.768030:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786015247.768268:0:5781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7488258e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1872772304324864:192.168.202.56@tcp:105: 00010000:00010000:1.0:1786015247.768294:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015247.768321:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2353:x1872772280298880:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 14209us (17152us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015247.768330:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 169 00000100:00100000:1.0:1786015247.811250:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015247.823463:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015247.823663:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280299392 00000100:00100000:3.0:1786015247.823679:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280299392 00000100:00100000:3.0:1786015247.823805:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 137 00000100:00100000:3.0:1786015247.823818:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+8:2354:x1872772280299392:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015247.823845:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015247.823881:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3a5f060/0xb1a5ef690c4ff90c lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7d58 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015247.823991:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1223800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304324992:192.168.202.56@tcp:106: 00000100:00100000:3.0:1786015247.824107:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748570a780 going to sleep for 11 seconds 00000100:00080000:1.0:1786015247.824665:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1786015247.831648:0:11384:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb size: 0 -> 1516 00002000:00010000:3.0:1786015247.831661:0:11384:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb mtime: 0 -> 1786015248 00002000:00010000:3.0:1786015247.831664:0:11384:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb atime: 0 -> 1786015247 00002000:00010000:3.0:1786015247.831666:0:11384:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb ctime: 0 -> 1786015248 00000100:00100000:3.0:1786015247.831704:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1223800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304324992:192.168.202.56@tcp:106: 00010000:00010000:3.0:1786015247.832576:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3a5f060/0xb1a5ef690c4ff90c lrc: 1/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d58 expref: 9 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.832624:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3a5f060/0xb1a5ef690c4ff90c lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d58 expref: 9 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015247.832642:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819ba000, rc 0) 00000100:00100000:2.0:1786015247.837658:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+8:2354:x1872772280299392:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 13822us (14190us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015247.837678:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 137 00000100:00100000:2.0:1786015247.843673:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015247.848942:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015247.849232:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280299648 00000100:00100000:2.0:1786015247.849265:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280299648 00000100:00100000:2.0:1786015247.849346:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 138 00000100:00100000:2.0:1786015247.849357:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+8:2353:x1872772280299648:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015247.849384:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015247.849515:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9e3925a/0xb1a5ef690c4ff921 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7d66 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015247.849606:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382c7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304325120:192.168.202.56@tcp:106: 00000100:00100000:2.0:1786015247.849727:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74af54b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786015247.853516:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382c7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304325120:192.168.202.56@tcp:106: 00010000:00010000:2.0:1786015247.853565:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c9e3925a/0xb1a5ef690c4ff921 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d66 expref: 9 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.853591:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9e3925a/0xb1a5ef690c4ff921 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d66 expref: 9 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015247.853603:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1000, rc 0) 00000100:00100000:2.0:1786015247.853673:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+8:2353:x1872772280299648:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 4317us (4746us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015247.853683:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 138 00000100:00100000:1.0:1786015247.866998:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015247.867326:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280299904 00000100:00100000:2.0:1786015247.867338:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280299904 00000100:00100000:2.0:1786015247.867487:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 543 00000100:00100000:2.0:1786015247.867498:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+56:17660:x1872772280299904:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:2.0:1786015247.867923:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].12, 136 off9824 00000100:00100000:2.0:1786015247.868071:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+56:17660:x1872772280299904:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 574us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015247.868078:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 543 00000100:00100000:3.0:1786015248.440302:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381943800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304325248:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015248.443283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015248.443341:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280300032 00000100:00100000:3.0:1786015248.443353:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280300032 00000100:00100000:3.0:1786015248.443420:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 544 00000100:00100000:3.0:1786015248.443432:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+25:17670:x1872772280300032:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015248.443478:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xd:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015248.443628:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+25:17670:x1872772280300032:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 198us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015248.443658:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 544 00000100:00100000:2.0:1786015248.454483:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015248.454539:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015248.454567:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015248.454789:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015248.454816:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015248.454837:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015248.454880:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015248.454921:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280300160 00000100:00100000:2.0:1786015248.454921:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280300544 00000100:00100000:3.0:1786015248.454934:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280300160 00000100:00100000:2.0:1786015248.454934:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280300544 00000100:00100000:3.0:1786015248.455000:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 339 00000100:00100000:3.0:1786015248.455012:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280300160:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015248.455114:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280300160:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 103us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015248.455122:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280300800 00000100:00100000:3.0:1786015248.455126:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 339 00000100:00100000:2.0:1786015248.455128:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280300800 00000100:00100000:2.0:1786015248.455151:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280300416 00000100:00100000:2.0:1786015248.455154:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280300416 00000100:00100000:2.0:1786015248.455187:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280300672 00000100:00100000:2.0:1786015248.455191:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280300672 00000100:00100000:2.0:1786015248.455210:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 198 00000100:00100000:2.0:1786015248.455219:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+8:2354:x1872772280300544:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015248.455259:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+8:2354:x1872772280300544:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 41us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015248.455267:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 198 00000100:00100000:2.0:1786015248.455286:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 199 00000100:00100000:2.0:1786015248.455295:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2354:x1872772280300800:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015248.455337:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 200 00000100:00100000:2.0:1786015248.455337:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2354:x1872772280300800:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 40us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015248.455350:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+9:2353:x1872772280300416:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015248.455368:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 199 00000100:00100000:3.0:1786015248.455382:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+9:2353:x1872772280300416:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 34us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015248.455388:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 201 00000100:00100000:3.0:1786015248.455398:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 200 00000100:00100000:2.0:1786015248.455402:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2353:x1872772280300672:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015248.455436:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2353:x1872772280300672:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015248.455444:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 201 00000100:00100000:2.0:1786015248.455831:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280300288 00000100:00100000:2.0:1786015248.455838:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280300288 00000100:00100000:2.0:1786015248.455889:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280301056 00000100:00100000:2.0:1786015248.455893:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280301056 00000100:00100000:2.0:1786015248.455919:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 257 00000100:00100000:2.0:1786015248.455926:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+56:2354:x1872772280300288:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015248.456038:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+56:2354:x1872772280300288:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 45us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015248.456048:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 257 00000100:00100000:2.0:1786015248.456065:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 545 00000100:00100000:2.0:1786015248.456071:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+25:17670:x1872772280301056:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015248.456085:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015248.456115:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ff928 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7d6d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786015248.456246:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786015248.456255:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ff92f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.456274:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ff92f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.456301:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ff92f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015248.456316:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xd:0x0]: returning size 1516 00010000:00010000:2.0:1786015248.456495:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ff928 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d6d expref: 28 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.456515:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ff92f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d6d expref: 27 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.456526:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8b7482d4b900) 00010000:00010000:2.0:1786015248.456530:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015248.456534:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1e00, rc 0) 00000100:00100000:2.0:1786015248.456562:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+27:17670:x1872772280301056:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 491us (2022us total) trans 4294967689 rc 0/0 00000100:00100000:2.0:1786015248.456569:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 545 00000100:00100000:3.0:1786015248.465478:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015248.465596:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015248.465670:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280301184 00000100:00100000:2.0:1786015248.465693:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280301184 00000100:00100000:2.0:1786015248.465791:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 139 00000100:00100000:2.0:1786015248.465807:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2351:x1872772280301184:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786015248.465884:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c4ff93d lrc: 3/1,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.465910:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000032923b65/0xb1a5ef690c4ff8e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d4a expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.465948:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015248.465953:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786015248.465958:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c4ff93d lrc: 4/1,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.466008:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000032923b65/0xb1a5ef690c4ff8e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d4a expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.466026:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000032923b65/0xb1a5ef690c4ff8e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d4a expref: 7 pid: 6590 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015248.466046:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304325376:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015248.466148:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74af54b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015248.470597:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280301312 00000100:00100000:1.0:1786015248.470619:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280301312 00000100:00100000:1.0:1786015248.471018:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:1.0:1786015248.471039:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+27:2353:x1872772280301312:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015248.471063:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015248.471098:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ff92f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d6d expref: 27 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015248.471124:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8b7482d4b900) 00010000:00010000:1.0:1786015248.471131:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015248.471214:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+26:2353:x1872772280301312:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 185us (5751us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015248.471223:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:1.0:1786015248.471419:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015248.471448:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280301440 00000100:00100000:1.0:1786015248.471454:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280301440 00002000:00100000:1.0:1786015248.471493:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xd:0x0] (0->1515) req@ffff8b74aa5a6d80 x1872772280301440/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:94/0 lens 2008/0 e 0 to 0 dl 1786015259 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015248.471504:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aa5a6d80 with x1872772280301440 ext(0->1515) 00010000:00010000:1.0:1786015248.471513:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000032923b65/0xb1a5ef690c4ff8e9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d4a expref: 8 pid: 6590 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015248.471533:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000032923b65/0xb1a5ef690c4ff8e9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d4a expref: 8 pid: 6590 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015248.471542:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b74aa5a6d80 00000100:00100000:1.0:1786015248.471567:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:1.0:1786015248.471575:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280301440:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:1.0:1786015248.472291:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280301440:12345-192.168.202.56@tcp:4:cp.0 Request processed in 713us (870us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1786015248.472299:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 2 00002000:00100000:1.0:1786015248.472307:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xd:0x0] (0->1515) req@ffff8b74aa5a6d80 x1872772280301440/t4294967328(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:94/0 lens 2008/448 e 0 to 0 dl 1786015259 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015248.472317:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aa5a6d80 with x1872772280301440 ext(0->1515) 00010000:00010000:1.0:1786015248.472325:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000032923b65/0xb1a5ef690c4ff8e9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d4a expref: 10 pid: 6590 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015248.472339:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000032923b65/0xb1a5ef690c4ff8e9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d4a expref: 10 pid: 6590 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015248.472348:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b74aa5a6d80 00000100:00100000:1.0:1786015248.472470:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304325376:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015248.472499:0:14547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c4ff93d lrc: 3/1,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015248.491205:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:3.0:1786015248.492351:0:14547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c4ff93d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015248.492365:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c4ff93d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015248.492399:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c4ff93d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015248.492410:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c4ff93d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015248.492427:0:14547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c4ff93d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015248.492433:0:14547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a0400 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015248.492437:0:14547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c4ff93d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015248.492444:0:14547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c4ff93d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015248.492453:0:14547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c4ff93d lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015248.492458:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c4ff93d lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015248.492519:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2351:x1872772280301184:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 26720us (26924us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015248.492526:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 139 00000100:00100000:1.0:1786015248.497752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015248.499593:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280301824 00000100:00100000:2.0:1786015248.499612:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280301824 00000100:00100000:2.0:1786015248.499726:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 546 00000100:00100000:2.0:1786015248.499737:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+26:17670:x1872772280301824:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015248.499916:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+26:17670:x1872772280301824:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 181us (2173us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015248.499926:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 546 00000100:00100000:2.0:1786015248.508336:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280301952 00000100:00100000:2.0:1786015248.508351:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280301952 00000100:00100000:2.0:1786015248.508421:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 140 00000100:00100000:2.0:1786015248.508433:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280301952:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015248.508469:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015248.508496:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bac81ac/0xb1a5ef690c4ff944 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7d74 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015248.508531:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 1516, mtime: 0x6a746e10, atime: 0x0, ctime: 0x6a746e10, blocks: 0x1 00010000:00010000:2.0:1786015248.508557:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1786015248.508562:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015248.508573:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bac81ac/0xb1a5ef690c4ff944 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d74 expref: 9 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.508593:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006bac81ac/0xb1a5ef690c4ff944 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d74 expref: 9 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.508610:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a0000, rc 0) 00000100:00100000:2.0:1786015248.508727:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280301952:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 296us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015248.508736:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 140 00000100:00100000:1.0:1786015248.512171:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015248.519360:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280302336 00000100:00100000:1.0:1786015248.519375:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280302336 00002000:00100000:1.0:1786015248.519448:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xd:0x0] (0->4095) req@ffff8b7381943100 x1872772280302336/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:94/0 lens 488/0 e 0 to 0 dl 1786015259 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015248.519463:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381943100 with x1872772280302336 ext(0->4095) 00002000:00010000:1.0:1786015248.519477:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7381943100 00000100:00100000:1.0:1786015248.519992:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:1.0:1786015248.520009:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280302336:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1786015248.520332:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280302336:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 328us (1095us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786015248.520341:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 51 00002000:00100000:1.0:1786015248.520350:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xd:0x0] (0->4095) req@ffff8b7381943100 x1872772280302336/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:94/0 lens 488/4536 e 0 to 0 dl 1786015259 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015248.520358:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381943100 with x1872772280302336 ext(0->4095) 00002000:00010000:1.0:1786015248.520362:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7381943100 00000100:00100000:2.0:1786015248.523884:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280302464 00000100:00100000:2.0:1786015248.523898:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280302464 00000100:00100000:2.0:1786015248.523970:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 548 00000100:00100000:2.0:1786015248.523982:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+26:17670:x1872772280302464:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015248.524011:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015248.524039:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff94b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7d7b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.524088:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff952 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.524112:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff952 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.524127:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff952 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.524251:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff94b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d7b expref: 28 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.524270:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff952 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d7b expref: 27 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.524280:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8b7482d4b900) 00010000:00010000:2.0:1786015248.524283:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015248.524287:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a0200, rc 0) 00000100:00100000:2.0:1786015248.524449:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+27:17670:x1872772280302464:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 470us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015248.524458:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 548 00000100:00100000:1.0:1786015248.529981:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015248.543740:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015248.548207:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280302976 00000100:00100000:2.0:1786015248.548230:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280302976 00000100:00100000:2.0:1786015248.548315:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 550 00000100:00100000:2.0:1786015248.548326:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+27:17670:x1872772280302976:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1786015248.548439:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff960 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.548459:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff952 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d7b expref: 27 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.548490:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff960 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.548532:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff952 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d7b expref: 27 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.548548:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff952 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d7b expref: 27 pid: 5796 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015248.548564:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304325504:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015248.548668:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74af54bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1786015248.553081:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304325504:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015248.553125:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff960 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015248.561018:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015248.561074:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280303104 00000100:00100000:2.0:1786015248.561088:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280303104 00010000:00010000:2.0:1786015248.561143:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff952 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d7b expref: 28 pid: 5796 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015248.561193:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 171 00000100:00100000:2.0:1786015248.561204:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748821d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+28:2353:x1872772280303104:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015248.561226:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015248.561235:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff952 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d7b expref: 28 pid: 5796 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.561261:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff952 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d7b expref: 28 pid: 5796 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.561290:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ff952 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d7b expref: 28 pid: 5796 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.561305:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8b7482d4b900) 00010000:00010000:2.0:1786015248.561311:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff960 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.561322:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff960 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.561331:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff960 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.561361:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015248.561430:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748821d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+27:2353:x1872772280303104:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 227us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015248.561439:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 171 00010000:00010000:2.0:1786015248.561602:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff960 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.561613:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff960 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.561956:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff960 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.561977:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff960 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.561984:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff960 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.561990:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a0600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015248.561996:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff960 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.562004:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff960 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.562017:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8b7482d4b900) 00010000:00010000:2.0:1786015248.562020:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015248.562024:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff960 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.562030:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ff960 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015248.562195:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+27:17670:x1872772280302976:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 13870us (14083us total) trans 4294967690 rc 0/0 00000100:00100000:2.0:1786015248.562205:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 550 00000040:00080000:1.0:1786015248.564516:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015248.564529:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015248.569365:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1786015248.569394:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015248.569859:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304325632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015248.573216:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015248.576443:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280303360 00000100:00100000:1.0:1786015248.576461:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280303360 00000100:00100000:1.0:1786015248.576557:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 120 00000100:00100000:1.0:1786015248.576571:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+27:17670:x1872772280303360:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015248.576961:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+28:17670:x1872772280303360:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 392us (3756us total) trans 4294967691 rc 0/0 00000100:00100000:1.0:1786015248.576971:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 120 00000100:00100000:3.0:1786015248.577170:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015248.975047:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015248.975109:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280303616 00000100:00100000:1.0:1786015248.975118:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280303616 00000100:00100000:1.0:1786015248.975194:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 551 00000100:00100000:1.0:1786015248.975205:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+56:17673:x1872772280303616:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015248.975226:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015248.975248:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c4ff967 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7d82 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015248.975361:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c4ff96e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015248.975376:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c4ff96e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015248.975390:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c4ff96e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015248.975404:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xd:0x0]: returning size 1516 00010000:00010000:1.0:1786015248.975532:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c4ff967 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d82 expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015248.975551:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c4ff96e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d82 expref: 58 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015248.975561:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8b7482d4b900) 00010000:00010000:1.0:1786015248.975564:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015248.975567:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6600, rc 0) 00000100:00100000:1.0:1786015248.975621:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+58:17673:x1872772280303616:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 418us (584us total) trans 4294967692 rc 0/0 00000100:00100000:1.0:1786015248.975628:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 551 00000100:00100000:1.0:1786015248.986472:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015248.986964:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280303744 00000100:00100000:2.0:1786015248.986975:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280303744 00000100:00100000:1.0:1786015248.987273:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015248.987977:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 552 00000100:00100000:2.0:1786015248.987990:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+58:17673:x1872772280303744:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:2.0:1786015248.988082:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff97c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.988100:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff97c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.988112:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff97c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.988144:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff97c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.988152:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff97c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.988160:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff97c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.988166:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015248.988171:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff97c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.988179:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff97c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.988193:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8b7482d4b900) 00010000:00010000:2.0:1786015248.988196:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786015248.988202:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff97c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015248.988209:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff97c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015248.988308:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+58:17673:x1872772280303744:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 320us (1845us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015248.988316:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 552 00000100:00100000:3.0:1786015248.989161:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280303872 00000100:00100000:3.0:1786015248.989172:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280303872 00000100:00100000:3.0:1786015248.989230:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:3.0:1786015248.989239:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+58:2351:x1872772280303872:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015248.989264:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015248.989357:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c4ff96e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d82 expref: 58 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015248.989373:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8b7482d4b900) 00010000:00010000:3.0:1786015248.989377:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015248.989421:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+57:2351:x1872772280303872:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 183us (2150us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015248.989428:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:2.0:1786015249.003002:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:1.0:1786015249.195979:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015250.098390:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304325760:0@lo:400:kworker.0 00000100:00100000:1.0:1786015250.098500:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015250.098614:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304325760 00000100:00100000:3.0:1786015250.098625:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304325760 00000100:00100000:3.0:1786015250.098703:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1786015250.098715:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304325760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015250.100999:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304325760:12345-0@lo:400:kworker.0 Request processed in 2275us (2487us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015250.102438:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1786015250.107289:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304325760:0@lo:400:kworker.0 00000100:00100000:3.0:1786015250.604925:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304326528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015250.604996:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015250.605082:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304326528 00000100:00100000:3.0:1786015250.605091:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304326528 00000100:00100000:3.0:1786015250.605136:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1786015250.605146:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304326528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015250.605181:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 56164352 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015250.605341:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304326528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 196us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015250.605350:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1786015250.605404:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304326528:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786015251.257406:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015253.296750:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015253.572693:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015253.572754:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015253.572820:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015253.572841:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015253.572860:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015253.572877:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015253.572915:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015253.573006:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280304256 00000100:00100000:3.0:1786015253.573018:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280304256 00000100:00100000:3.0:1786015253.573074:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 341 00000100:00100000:3.0:1786015253.573084:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280304256:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015253.573175:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280304256:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 92us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015253.573183:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 341 00000100:00100000:1.0:1786015253.573830:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280304512 00000100:00100000:1.0:1786015253.573837:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280304512 00000100:00100000:1.0:1786015253.573891:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280305024 00000100:00100000:1.0:1786015253.573895:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280305024 00000100:00100000:1.0:1786015253.573908:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280304640 00000100:00100000:1.0:1786015253.573911:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280304640 00000100:00100000:1.0:1786015253.573924:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280304896 00000100:00100000:1.0:1786015253.573927:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280304896 00000100:00100000:1.0:1786015253.573944:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 204 00000100:00100000:1.0:1786015253.573953:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+9:2351:x1872772280304512:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015253.574008:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+9:2351:x1872772280304512:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 55us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015253.574015:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 204 00000100:00080000:3.0:1786015253.574119:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015253.574123:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015253.574280:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 205 00000100:00100000:1.0:1786015253.574288:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2351:x1872772280305024:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015253.574333:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2351:x1872772280305024:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 47us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015253.574340:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 205 00000100:00100000:1.0:1786015253.574352:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 206 00000100:00100000:1.0:1786015253.574358:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+8:2351:x1872772280304640:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015253.574378:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+8:2351:x1872772280304640:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015253.574384:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 206 00000100:00100000:1.0:1786015253.574396:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 207 00000100:00100000:1.0:1786015253.574403:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2351:x1872772280304896:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015253.574423:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2351:x1872772280304896:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015253.574429:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 207 00000100:00100000:1.0:1786015253.574448:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280304768 00000100:00100000:1.0:1786015253.574453:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280304768 00000100:00100000:1.0:1786015253.574636:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 261 00000100:00100000:1.0:1786015253.574643:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+22:2351:x1872772280304768:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015253.574679:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+22:2351:x1872772280304768:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 36us (1859us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015253.574685:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 261 00000100:00080000:3.0:1786015253.579863:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015253.609088:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015253.609131:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280305152 00000100:00100000:1.0:1786015253.609141:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280305152 00000100:00100000:1.0:1786015253.612365:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 553 00000100:00100000:1.0:1786015253.612392:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+22:17140:x1872772280305152:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1786015253.612504:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+22:17140:x1872772280305152:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 119us (3426us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015253.612512:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 553 00000100:00100000:1.0:1786015253.631621:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015253.631670:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280305408 00000100:00100000:1.0:1786015253.631680:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280305408 00000100:00100000:1.0:1786015253.631757:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 122 00000100:00100000:1.0:1786015253.631782:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+22:17140:x1872772280305408:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015253.632334:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+23:17140:x1872772280305408:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 551us (721us total) trans 4294967694 rc 0/0 00000100:00100000:1.0:1786015253.632342:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 122 00000100:00100000:3.0:1786015253.679415:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304326656 00000100:00100000:3.0:1786015253.679673:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304326656 00000100:00100000:3.0:1786015253.679755:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1786015253.679786:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304326656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015253.679840:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 57868288 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015253.679937:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304326656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (3711us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015253.679945:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1786015253.679990:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1786015254.702651:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015254.702666:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015254.702713:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 13 count 2 00000040:00080000:3.0:1786015254.702727:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015255.215795:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304327168:0@lo:400:kworker.0 00000100:00100000:3.0:1786015255.215889:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015255.215974:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786015255.215981:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304326784:0@lo:400:kworker.0 00000100:00100000:3.0:1786015255.216014:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015255.216038:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304327296:0@lo:400:kworker.0 00000100:00100000:3.0:1786015255.216067:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015255.216097:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304326912:0@lo:400:kworker.0 00000100:00100000:3.0:1786015255.216123:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015255.216144:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304327424:0@lo:400:kworker.0 00000100:00100000:3.0:1786015255.216166:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015255.216185:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015255.216191:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304327040:0@lo:400:kworker.0 00000100:00100000:3.0:1786015255.216232:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015255.216275:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304327168 00000100:00100000:3.0:1786015255.216285:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304327168 00000100:00100000:3.0:1786015255.216350:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304327424 00000100:00100000:3.0:1786015255.216353:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304327424 00000100:00100000:3.0:1786015255.216381:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1786015255.216390:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304327168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015255.216454:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304327168:12345-0@lo:400:kworker.0 Request processed in 65us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015255.216462:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1786015255.216483:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1786015255.216489:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304327424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015255.216519:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304327424:12345-0@lo:400:kworker.0 Request processed in 30us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015255.216525:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1786015255.216551:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304326784 00000100:00100000:3.0:1786015255.216554:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304326784 00000100:00100000:3.0:1786015255.216579:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1786015255.216585:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304326784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015255.216618:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304326784:12345-0@lo:400:kworker.0 Request processed in 33us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015255.216624:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1786015255.216654:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304327296 00000100:00100000:3.0:1786015255.216658:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304327296 00000100:00100000:3.0:1786015255.216685:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304326912 00000100:00100000:3.0:1786015255.216688:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304326912 00000100:00100000:3.0:1786015255.216705:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304327040 00000100:00100000:3.0:1786015255.216706:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304327040 00000100:00100000:3.0:1786015255.216720:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1786015255.216726:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304327296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015255.216757:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304327296:12345-0@lo:400:kworker.0 Request processed in 31us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015255.216798:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1786015255.216810:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1786015255.216816:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304326912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015255.216846:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304326912:12345-0@lo:400:kworker.0 Request processed in 30us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015255.216852:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1786015255.216862:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1786015255.216868:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304327040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015255.216895:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304327040:12345-0@lo:400:kworker.0 Request processed in 27us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015255.216909:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1786015255.216943:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015255.216948:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015255.216950:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015255.218314:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304327040:0@lo:400:kworker.0 00000100:00100000:3.0:1786015255.218332:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304326912:0@lo:400:kworker.0 00000100:00100000:3.0:1786015255.218344:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304327424:0@lo:400:kworker.0 00000100:00100000:3.0:1786015255.218394:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304326784:0@lo:400:kworker.0 00000100:00100000:3.0:1786015255.218409:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304327296:0@lo:400:kworker.0 00000100:00100000:3.0:1786015255.218421:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304327168:0@lo:400:kworker.0 00000001:02000400:1.0:1786015255.228682:0:15228:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 9a: Multiple remote agents ============ 07:20:54 (1786015254) 00010000:00010000:1.0:1786015255.344423:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786015255.837935:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967694 is committed 00010000:00010000:2.0:1786015256.369295:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015257.388308:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015258.421340:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015258.692642:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280305536 00000100:00100000:3.0:1786015258.692648:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280305536 00000100:00100000:3.0:1786015258.692690:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 343 00000100:00100000:3.0:1786015258.692698:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280305536:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015258.692731:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280305536:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 35us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015258.692737:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 343 00000100:00100000:1.0:1786015258.803118:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786015258.803144:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304327680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015258.803217:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015258.803288:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304327680 00000100:00100000:1.0:1786015258.803298:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304327680 00000100:00100000:1.0:1786015258.803355:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1786015258.803363:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304327680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015258.803399:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 57868288 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015258.803447:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304327680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015258.803464:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1786015258.803484:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015258.803523:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304327680:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1786015258.834506:0:15327:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 10a: Archive a file =================== 07:20:57 (1786015257) 00000100:00100000:3.0:1786015259.236266:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015259.243961:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280306560 00000100:00100000:1.0:1786015259.243980:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280306560 00000100:00100000:1.0:1786015259.244074:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 554 00000100:00100000:1.0:1786015259.244086:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+22:18568:x1872772280306560:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015259.244108:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015259.244130:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c4ff983 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7d89 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.244466:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c4ff98a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.244482:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c4ff98a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.244496:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c4ff98a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.244513:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c4ff991 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.244521:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c4ff991 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.244527:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c4ff991 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015259.259840:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280306688 00000100:00100000:1.0:1786015259.259852:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280306688 00000100:00100000:1.0:1786015259.259908:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280306816 00000100:00100000:1.0:1786015259.259913:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280306816 00000100:00100000:2.0:1786015259.259981:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280306944 00000100:00100000:2.0:1786015259.259986:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280306944 00000100:00100000:1.0:1786015259.260110:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 556 00000100:00100000:1.0:1786015259.260122:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+55:18569:x1872772280306816:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015259.260133:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015259.260154:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff9a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7d90 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.260212:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ff9ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.260230:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ff9ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.260250:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ff9ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.260268:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ff9b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015259.260510:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:2.0:1786015259.260520:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+24:2354:x1872772280306944:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015259.260530:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015259.260550:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934600/0xb1a5ef690c4ff998 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d89 expref: 24 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.260565:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:2.0:1786015259.260570:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015259.260606:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+23:2354:x1872772280306944:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 88us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015259.260613:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 18 00010000:00010000:1.0:1786015259.260881:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ff9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.260892:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ff9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.261164:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ff9ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.261183:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ff9ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.261190:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ff9ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.261198:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf3b5600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015259.261203:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ff9ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.261209:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ff9ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.261219:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:1.0:1786015259.261222:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015259.261226:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ff9ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.261232:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ff9ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.261243:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ff9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.261249:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ff9b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.261255:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ff9b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.261260:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf3b4e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015259.261270:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ff9b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.261293:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ff9b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.261302:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd97ceb69 (ffff8b749802ed00) 00010000:00010000:1.0:1786015259.261305:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015259.261308:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ff9b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.261314:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ff9b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.261357:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff9a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d90 expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.261367:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:1.0:1786015259.261369:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015259.261373:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c4ff9a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d90 expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.261382:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6800, rc 0) 00000100:00100000:1.0:1786015259.261431:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+55:18569:x1872772280306816:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1312us (1672us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015259.261439:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 556 00000100:00100000:3.0:1786015259.274607:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280307200 00000100:00100000:3.0:1786015259.274618:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280307200 00000100:00100000:3.0:1786015259.274679:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 557 00000100:00100000:3.0:1786015259.274690:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916a0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+55:18569:x1872772280307200:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:3.0:1786015259.274802:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015259.274830:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c4ff809 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7cfd expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.274854:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:3.0:1786015259.274859:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015259.275339:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff9bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.275355:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ff848 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d12 expref: 22 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.275364:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff9bb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.275397:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ff848 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d12 expref: 22 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.275412:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ff848 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d12 expref: 22 pid: 12526 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015259.275428:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aad500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304327808:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015259.275573:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d2600 going to sleep for 11 seconds 00000100:00100000:1.0:1786015259.287209:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280307328 00000100:00100000:1.0:1786015259.287225:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280307328 00010000:00010000:1.0:1786015259.287279:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ff848 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d12 expref: 23 pid: 12526 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015259.287352:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 172 00000100:00100000:1.0:1786015259.287362:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+23:2353:x1872772280307328:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015259.287380:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015259.287387:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ff848 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d12 expref: 23 pid: 12526 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.287401:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ff848 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d12 expref: 23 pid: 12526 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.287426:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:1.0:1786015259.287432:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff9bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.287443:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff9bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.287451:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff9bb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.287472:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015259.287540:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+23:2353:x1872772280307328:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 180us (2835us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015259.287548:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 172 00010000:00010000:3.0:1786015259.288775:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ff848 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d12 expref: 22 pid: 12526 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015259.288799:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aad500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304327808:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015259.288823:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff9bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.288849:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff9bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.288856:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff9bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.288887:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ff9c2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.288900:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ff9c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.288910:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ff9c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015259.292921:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 512 00010000:00010000:3.0:1786015259.292943:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff9bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.292955:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff9bb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.292962:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff9bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.292968:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819ba000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015259.292973:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff9bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.292982:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff9bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.294074:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:3.0:1786015259.294079:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015259.294087:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff9bb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.294095:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ff9bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015259.294121:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ce5af10f reply state 000000006cc0b547 transno 4294967696 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ff9c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015259.294131:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015259.294364:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916a0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+56:18569:x1872772280307200:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 19671us (19869us total) trans 4294967696 rc 0/0 00000100:00100000:3.0:1786015259.294374:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 557 00010000:00010000:1.0:1786015259.319007:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ff9c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.319222:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ff9c2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.319856:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ff9c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.319863:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015259.319868:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ff9c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.319877:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ff9c2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.319895:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd97ceb69 (ffff8b74b0022200) 00010000:00010000:1.0:1786015259.319898:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015259.319904:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ff9c2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.319910:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ff9c2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015259.327667:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280307456 00000100:00100000:2.0:1786015259.327701:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280307456 00000100:00100000:2.0:1786015259.327840:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 558 00000100:00100000:2.0:1786015259.327856:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+55:18570:x1872772280307456:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:2.0:1786015259.327899:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015259.327942:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ff9c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7d97 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.328072:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff9d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.328091:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff9d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.328105:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff9d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015259.328193:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1786015259.328199:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 14 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015259.328235:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff9d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.328265:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ff9c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d97 expref: 57 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.328289:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff9d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d97 expref: 56 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.328300:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7485765200) 00010000:00010000:2.0:1786015259.328303:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015259.328321:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1c00, rc 0) 00000100:00100000:2.0:1786015259.328413:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+56:18570:x1872772280307456:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 561us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015259.328422:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 558 00000100:00100000:1.0:1786015259.337342:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280307840 00000100:00100000:1.0:1786015259.337359:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280307840 00000100:00100000:1.0:1786015259.337430:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280307584 00000100:00100000:1.0:1786015259.337433:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280307584 00000100:00100000:1.0:1786015259.337470:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 559 00000100:00100000:1.0:1786015259.337480:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+57:18570:x1872772280307840:12345-192.168.202.56@tcp:36:mkdir.0 00000100:00100000:3.0:1786015259.337544:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 560 00010000:00010000:1.0:1786015259.337550:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1786015259.337558:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+57:2353:x1872772280307584:12345-192.168.202.56@tcp:41:mkdir.0 00010000:00010000:1.0:1786015259.337587:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ff9d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d97 expref: 57 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000024:3.0:1786015259.337598:0:5795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 14680064 pending 0 free 2259943424 avail 2257846272 00010000:00010000:1.0:1786015259.337611:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7485765200) 00010000:00010000:1.0:1786015259.337639:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015259.337685:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+56:2353:x1872772280307584:12345-192.168.202.56@tcp:41:mkdir.0 Request processed in 131us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015259.337705:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 560 00000100:00100000:1.0:1786015259.338336:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+55:18570:x1872772280307840:12345-192.168.202.56@tcp:36:mkdir.0 Request processed in 846us (1938us total) trans 0 rc -17/-17 00000100:00100000:1.0:1786015259.338344:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 559 00000100:00100000:3.0:1786015259.341627:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280307968 00000100:00100000:3.0:1786015259.341639:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280307968 00000100:00100000:3.0:1786015259.341804:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 561 00000100:00100000:3.0:1786015259.341817:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+55:18570:x1872772280307968:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:3.0:1786015259.341841:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015259.341868:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba800/0xb1a5ef690c4ff9d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7d9e expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.341962:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ff9de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.341977:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ff9de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.341990:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ff9de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015259.342078:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1786015259.342084:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 14 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015259.342120:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ff9de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.342159:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba800/0xb1a5ef690c4ff9d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d9e expref: 57 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.342178:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ff9de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d9e expref: 56 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.342186:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:3.0:1786015259.342189:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015259.342193:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bbe00, rc 0) 00000100:00100000:3.0:1786015259.342268:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+56:18570:x1872772280307968:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 454us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015259.342275:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 561 00000100:00100000:3.0:1786015259.352070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015259.352222:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280308096 00000100:00100000:2.0:1786015259.352234:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280308096 00000100:00100000:2.0:1786015259.352310:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 562 00000100:00100000:2.0:1786015259.352322:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+56:18570:x1872772280308096:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:2.0:1786015259.352346:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015259.352369:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ff9e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7da5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.352444:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff9ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.352459:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff9ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.352470:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff9ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.352494:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff9f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.352501:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff9f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.352508:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff9f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353346:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff9fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353359:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff9fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353368:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff9fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015259.353426:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 512 00000004:00200000:2.0:1786015259.353431:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015259.353454:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff9fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353467:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff9ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353473:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff9ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353479:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff9ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353485:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015259.353489:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff9ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353497:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff9ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353510:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:2.0:1786015259.353512:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015259.353516:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff9ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353521:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ff9ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353617:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff9f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353634:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff9f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353640:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff9f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353645:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015259.353648:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff9f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353655:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff9f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353664:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd97ceb69 (ffff8b7485765f00) 00010000:00010000:2.0:1786015259.353667:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015259.353670:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff9f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353676:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ff9f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353715:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ff9e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7da5 expref: 58 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353866:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ff9fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7da5 expref: 57 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.353878:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8b7485765200) 00010000:00010000:2.0:1786015259.353880:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015259.353889:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1a00, rc 0) 00000100:00100000:2.0:1786015259.353957:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+57:18570:x1872772280308096:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 1636us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015259.353965:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 562 00000100:00100000:1.0:1786015259.358022:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:2.0:1786015259.367922:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c4ffa08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.367941:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c4ffa08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.367949:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c4ffa08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.367956:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381934800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015259.367961:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c4ffa08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.367969:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c4ffa08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.367987:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x43454b14 (ffff8b7482d4b100) 00010000:00010000:2.0:1786015259.367990:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015259.367996:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c4ffa08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.368003:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c4ffa08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015259.376962:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015259.377399:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280308480 00000100:00100000:3.0:1786015259.377423:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280308480 00000100:00100000:3.0:1786015259.377828:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 564 00000100:00100000:3.0:1786015259.377842:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+57:18571:x1872772280308480:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1786015259.377873:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015259.377899:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffa0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7dac expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.377964:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.377978:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.377989:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.378001:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379117:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379198:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379329:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba600/0xb1a5ef690c4ffa24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379340:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba600/0xb1a5ef690c4ffa24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379347:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba600/0xb1a5ef690c4ffa24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015259.379398:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 512 00000004:00200000:3.0:1786015259.379401:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015259.379426:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba600/0xb1a5ef690c4ffa24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379438:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379445:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa16 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379453:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379459:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819ba200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015259.379463:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379470:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379493:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:3.0:1786015259.379496:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015259.379501:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379507:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379521:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379536:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379542:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379546:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bac00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015259.379549:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379555:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379562:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd97ceb69 (ffff8b74b0022600) 00010000:00010000:3.0:1786015259.379564:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015259.379567:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379572:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379607:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffa0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7dac expref: 59 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379621:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba600/0xb1a5ef690c4ffa24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7dac expref: 58 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.379629:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8b74b0022400) 00010000:00010000:3.0:1786015259.379631:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786015259.379638:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819ba600, rc 0) 00000100:00100000:3.0:1786015259.379717:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+58:18571:x1872772280308480:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1879us (2774us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015259.379725:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 564 00000100:00100000:2.0:1786015259.394368:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280308608 00000100:00100000:2.0:1786015259.394385:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280308608 00000100:00100000:2.0:1786015259.394459:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 565 00000100:00100000:2.0:1786015259.394621:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+58:18571:x1872772280308608:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1786015259.394658:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015259.394682:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffa2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7db3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.394831:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa32 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.394847:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.394858:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.394875:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ffa39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.394882:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ffa39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.394889:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ffa39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.394960:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.394967:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa32 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.394974:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.394980:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015259.394991:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.394999:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa32 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.395087:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8b74b0022400) 00010000:00010000:2.0:1786015259.395091:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015259.395096:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.395102:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.395116:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ffa39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.395122:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ffa39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.395128:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ffa39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.395133:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a0200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015259.395137:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ffa39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.395215:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ffa39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.395226:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x4a7b05a0 (ffff8b7485765f00) 00010000:00010000:2.0:1786015259.395228:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015259.395237:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ffa39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.395243:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ffa39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.395283:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffa2b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7db3 expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.395294:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8b74b0022400) 00010000:00010000:2.0:1786015259.395297:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015259.395300:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffa2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7db3 expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.395310:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1600, rc 0) 00000100:00100000:2.0:1786015259.395450:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+58:18571:x1872772280308608:12345-192.168.202.56@tcp:101:bash.0 Request processed in 981us (5561us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015259.395460:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 565 00000100:00100000:2.0:1786015259.413910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015259.417693:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015259.417886:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280308864 00000100:00100000:3.0:1786015259.417899:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280308864 00000100:00100000:3.0:1786015259.417989:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 567 00000100:00100000:3.0:1786015259.418001:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+23:18572:x1872772280308864:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015259.418039:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015259.418065:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffa4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7dc1 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418277:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418295:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418307:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418323:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418330:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418336:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418454:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb400/0xb1a5ef690c4ffa63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418675:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb400/0xb1a5ef690c4ffa63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418683:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb400/0xb1a5ef690c4ffa63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015259.418721:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 512 00000004:00200000:3.0:1786015259.418725:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015259.418798:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb400/0xb1a5ef690c4ffa63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418812:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418819:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa55 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418826:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418833:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bac00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015259.418837:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418844:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418858:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:3.0:1786015259.418861:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015259.418866:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418884:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418898:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418904:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418909:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418925:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819ba200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015259.418929:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418935:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418944:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd97ceb69 (ffff8b74b0022600) 00010000:00010000:3.0:1786015259.418946:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015259.418949:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418955:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418987:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffa4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7dc1 expref: 25 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.418999:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb400/0xb1a5ef690c4ffa63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7dc1 expref: 24 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.419688:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8b74b0022400) 00010000:00010000:3.0:1786015259.419691:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786015259.419694:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb400, rc 0) 00000100:00100000:3.0:1786015259.420055:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+24:18572:x1872772280308864:12345-192.168.202.56@tcp:101:rm.0 Request processed in 2054us (2369us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015259.420065:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 567 00000100:00100000:1.0:1786015259.438566:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280308992 00000100:00100000:1.0:1786015259.438582:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280308992 00000100:00100000:2.0:1786015259.441700:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 568 00000100:00100000:2.0:1786015259.441718:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+24:18572:x1872772280308992:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015259.441751:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015259.441796:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ffa6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7dc8 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.441869:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.441885:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.441913:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.441944:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ffa78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.441952:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ffa78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.441959:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ffa78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.442040:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.442048:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa71 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.442055:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.442061:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015259.442065:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.442073:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa71 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.442085:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8b74b0022400) 00010000:00010000:2.0:1786015259.442088:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015259.442092:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.442105:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffa71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.442118:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ffa78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.442125:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ffa78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.442130:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ffa78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.442136:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a0600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015259.442139:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ffa78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.442224:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ffa78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.442233:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x4a7b05a0 (ffff8b7485765f00) 00010000:00010000:2.0:1786015259.442236:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015259.442239:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ffa78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.442245:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ffa78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.442281:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ffa6a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7dc8 expref: 25 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.442307:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8b74b0022400) 00010000:00010000:2.0:1786015259.442310:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015259.442314:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ffa6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7dc8 expref: 25 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.442324:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a0200, rc 0) 00000100:00100000:2.0:1786015259.442416:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+24:18572:x1872772280308992:12345-192.168.202.56@tcp:101:rm.0 Request processed in 701us (8101us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015259.442423:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 568 00000100:00100000:2.0:1786015259.450609:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015259.450709:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280309120 00000100:00100000:3.0:1786015259.450719:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280309120 00000100:00100000:3.0:1786015259.450823:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 569 00000100:00100000:3.0:1786015259.450834:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+24:18572:x1872772280309120:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015259.450857:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015259.450880:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffa7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7dcf expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.450965:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.450980:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.450992:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451084:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451095:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451122:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451324:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451333:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451339:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451346:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819ba200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015259.451351:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451358:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451373:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8b74b0022400) 00010000:00010000:3.0:1786015259.451376:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015259.451381:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451387:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffa86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451400:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451406:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451419:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451425:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bac00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015259.451428:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451435:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451442:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x4a7b05a0 (ffff8b74b0022600) 00010000:00010000:3.0:1786015259.451445:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015259.451447:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451453:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451876:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffa7f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7dcf expref: 25 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451889:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8b74b0022400) 00010000:00010000:3.0:1786015259.451891:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015259.451895:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffa7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7dcf expref: 25 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.451906:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819ba400, rc 0) 00000100:00100000:3.0:1786015259.452255:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+24:18572:x1872772280309120:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1420us (1653us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015259.452273:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 569 00000100:00100000:1.0:1786015259.493126:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015259.493311:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280309248 00000100:00100000:3.0:1786015259.493323:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280309248 00000100:00100000:3.0:1786015259.493391:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 570 00000100:00100000:3.0:1786015259.493402:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+24:18573:x1872772280309248:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015259.493427:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015259.493451:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffa94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7dd6 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493540:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa9b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493556:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493569:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493584:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffaa2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493591:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493599:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493669:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493697:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa9b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493704:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493712:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bac00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015259.493717:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493725:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493750:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8b74b0022400) 00010000:00010000:3.0:1786015259.493753:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015259.493759:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493807:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffa9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493822:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493829:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffaa2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493835:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffaa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493840:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819ba200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015259.493849:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffaa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493856:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffaa2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493865:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x4a7b05a0 (ffff8b74b0022600) 00010000:00010000:3.0:1786015259.493867:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015259.493870:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffaa2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493876:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffaa2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493914:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffa94 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7dd6 expref: 25 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493925:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8b74b0022400) 00010000:00010000:3.0:1786015259.493927:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015259.493931:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffa94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7dd6 expref: 25 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.493941:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819ba400, rc 0) 00000100:00100000:3.0:1786015259.494022:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+24:18573:x1872772280309248:12345-192.168.202.56@tcp:101:cp.0 Request processed in 621us (906us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015259.494030:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 570 00000100:00100000:2.0:1786015259.516219:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280309376 00000100:00100000:2.0:1786015259.516238:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280309376 00000100:00100000:2.0:1786015259.516316:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 571 00000100:00100000:2.0:1786015259.516327:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+24:18573:x1872772280309376:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015259.516350:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015259.516375:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ffaa9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7ddd expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516449:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffab0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516464:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffab0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516476:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffab0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516509:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffab7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516517:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516524:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516592:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffab0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516600:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffab0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516606:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffab0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516612:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015259.516617:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffab0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516625:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffab0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516637:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8b74b0022400) 00010000:00010000:2.0:1786015259.516640:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015259.516644:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffab0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516651:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffab0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516670:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516676:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffab7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516681:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffab7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516686:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015259.516688:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffab7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516693:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffab7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516700:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x4a7b05a0 (ffff8b7485765f00) 00010000:00010000:2.0:1786015259.516702:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015259.516705:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffab7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516710:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffab7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.516755:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ffaa9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ddd expref: 25 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.517052:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8b74b0022400) 00010000:00010000:2.0:1786015259.517055:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015259.517066:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0600/0xb1a5ef690c4ffaa9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ddd expref: 25 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.517076:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a0600, rc 0) 00000100:00100000:2.0:1786015259.517150:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+24:18573:x1872772280309376:12345-192.168.202.56@tcp:101:cp.0 Request processed in 824us (5063us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015259.517158:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 571 00000100:00100000:2.0:1786015259.529701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015259.529842:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280309632 00000100:00100000:3.0:1786015259.529852:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280309632 00000100:00100000:3.0:1786015259.529974:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 572 00000100:00100000:3.0:1786015259.529985:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+24:18573:x1872772280309632:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015259.530022:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015259.530046:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffabe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7de4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.530174:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffac5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.530189:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffac5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.530200:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffac5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.530215:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffacc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.530222:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffacc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.530229:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffacc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786015259.531023:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc:0x0], index 0: 0 00010000:00010000:3.0:1786015259.531195:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb600/0xb1a5ef690c4ffad3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.531207:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb600/0xb1a5ef690c4ffad3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.531217:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb600/0xb1a5ef690c4ffad3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.531268:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffac5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.531275:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffac5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.531282:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffac5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.531288:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bac00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015259.531292:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffac5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.531301:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffac5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.531314:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8b74b0022400) 00010000:00010000:3.0:1786015259.531317:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015259.531322:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffac5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.531328:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffac5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015259.531340:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000023c52be2 reply state 000000007fc8e1c5 transno 4294967698 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffacc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015259.531350:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786015259.531384:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffabe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7de4 expref: 27 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.531410:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb600/0xb1a5ef690c4ffad3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7de4 expref: 26 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.531418:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8b74b0022200) 00010000:00010000:3.0:1786015259.531420:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015259.531423:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb600, rc 0) 00000100:00100000:3.0:1786015259.531509:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+27:18573:x1872772280309632:12345-192.168.202.56@tcp:101:cp.0 Request processed in 1526us (1818us total) trans 4294967698 rc 0/0 00000100:00100000:3.0:1786015259.531518:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 572 00010000:00010000:2.0:1786015259.533204:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffacc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.533220:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffacc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.533227:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffacc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.533233:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015259.533238:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffacc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.533246:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffacc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.533261:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x4a7b05a0 (ffff8b74b0022600) 00010000:00010000:2.0:1786015259.533264:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015259.533268:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffacc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.533274:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffacc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015259.534684:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015259.534805:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280309760 00000100:00100000:1.0:1786015259.534817:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280309760 00000100:00100000:1.0:1786015259.534872:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 142 00000100:00100000:1.0:1786015259.534882:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+6:2354:x1872772280309760:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015259.534901:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015259.534932:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c4ffae1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7deb expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015259.534962:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786015259.534983:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1786015259.534989:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015259.534999:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c4ffae1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7deb expref: 7 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.535015:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c4ffae1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7deb expref: 7 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.535043:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf3b4e00, rc 0) 00000100:00100000:1.0:1786015259.535099:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2354:x1872772280309760:12345-192.168.202.56@tcp:101:cp.0 Request processed in 218us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015259.535106:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 142 00000100:00100000:1.0:1786015259.543127:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015259.551552:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015259.551659:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280310016 00000100:00100000:2.0:1786015259.551673:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280310016 00010000:00010000:2.0:1786015259.551746:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c4ffae1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7deb expref: 9 pid: 11384 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015259.551844:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 173 00000100:00100000:2.0:1786015259.551854:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280310016:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015259.551873:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015259.551899:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c4ffae1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7deb expref: 9 pid: 11384 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.551914:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c4ffae1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7deb expref: 9 pid: 11384 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.551951:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015259.551956:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015259.551964:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e43cee00/0xb1a5ef690c4ffae8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7df2 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.551974:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e43cee00/0xb1a5ef690c4ffae8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7df2 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.552018:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e43cee00/0xb1a5ef690c4ffae8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7df2 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015259.552056:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5782:1872772304328064:192.168.202.56@tcp:105: 00000100:00100000:2.0:1786015259.552145:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1786015259.572954:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5782:1872772304328064:192.168.202.56@tcp:105: 00010000:00010000:2.0:1786015259.572988:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015259.573060:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2353:x1872772280310016:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 21205us (21520us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015259.573071:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 173 00000100:00100000:3.0:1786015259.575128:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015259.575225:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280310272 00000100:00100000:1.0:1786015259.575236:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280310272 00000100:00100000:1.0:1786015259.575314:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 123 00000100:00100000:1.0:1786015259.575324:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+26:18573:x1872772280310272:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:1.0:1786015259.575702:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+27:18573:x1872772280310272:12345-192.168.202.56@tcp:35:cp.0 Request processed in 377us (582us total) trans 4294967699 rc 0/0 00000100:00100000:1.0:1786015259.575711:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 123 00000100:00100000:1.0:1786015259.664423:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015259.678334:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015259.682075:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280310528 00000100:00100000:2.0:1786015259.682091:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280310528 00000100:00100000:2.0:1786015259.682420:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 144 00000100:00100000:2.0:1786015259.682431:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+9:2351:x1872772280310528:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015259.682451:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015259.682479:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f82c565/0xb1a5ef690c4ffb0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e00 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015259.682542:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304328192:192.168.202.56@tcp:106: 00000100:00100000:2.0:1786015259.682660:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54ef00 going to sleep for 11 seconds 00002000:00010000:2.0:1786015259.694997:0:6592:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1786015259.695271:0:6592:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb mtime: 0 -> 1786015259 00002000:00010000:2.0:1786015259.695275:0:6592:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb atime: 0 -> 1786015259 00002000:00010000:2.0:1786015259.695278:0:6592:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb ctime: 0 -> 1786015259 00000100:00100000:2.0:1786015259.695306:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304328192:192.168.202.56@tcp:106: 00010000:00010000:2.0:1786015259.695345:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f82c565/0xb1a5ef690c4ffb0b lrc: 1/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e00 expref: 10 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.695392:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f82c565/0xb1a5ef690c4ffb0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e00 expref: 10 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.695406:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a0600, rc 0) 00000100:00100000:2.0:1786015259.696329:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+9:2351:x1872772280310528:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 13042us (17147us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015259.696343:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 144 00000100:00100000:3.0:1786015259.702753:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015259.703191:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280310656 00000100:00100000:2.0:1786015259.703208:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280310656 00000100:00100000:2.0:1786015259.703282:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 574 00000100:00100000:2.0:1786015259.703292:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+59:18576:x1872772280310656:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015259.703318:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015259.703341:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffb12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e07 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.703411:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffb19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.703426:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffb19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.703437:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffb19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015259.703513:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 512 00000004:00200000:2.0:1786015259.703517:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015259.703567:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffb19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.703595:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffb12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e07 expref: 61 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.703612:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1200/0xb1a5ef690c4ffb19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e07 expref: 60 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.703620:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8b74b0022400) 00010000:00010000:2.0:1786015259.703623:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015259.703626:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1200, rc 0) 00000100:00100000:2.0:1786015259.703693:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+60:18576:x1872772280310656:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 403us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015259.703700:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 574 00000100:00100000:3.0:1786015259.710063:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015259.710110:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280310784 00000100:00100000:2.0:1786015259.710121:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280310784 00000100:00100000:2.0:1786015259.710256:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 145 00000100:00100000:2.0:1786015259.710268:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+9:2354:x1872772280310784:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015259.710292:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015259.710314:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f82c565/0xb1a5ef690c4ffb20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e0e expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015259.710385:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304328320:192.168.202.56@tcp:106: 00000100:00100000:2.0:1786015259.710493:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1786015259.721964:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304328320:192.168.202.56@tcp:106: 00010000:00010000:2.0:1786015259.722079:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f82c565/0xb1a5ef690c4ffb20 lrc: 1/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e0e expref: 10 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.722121:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f82c565/0xb1a5ef690c4ffb20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e0e expref: 10 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.722135:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a0600, rc 0) 00000100:00100000:2.0:1786015259.722239:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+9:2354:x1872772280310784:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 11973us (12186us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015259.722249:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 145 00000100:00100000:3.0:1786015259.739255:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000040:00080000:3.0:1786015259.821517:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015259.821527:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015259.821562:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 14 count 3 00000040:00080000:3.0:1786015259.821569:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015259.821905:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aadc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304328448:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015259.824794:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d2300 going to sleep for 11 seconds 00000100:00100000:3.0:1786015259.834672:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015259.834826:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aadc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304328448:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015259.858027:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015259.866807:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015259.867652:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015259.867866:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280311680 00000100:00100000:1.0:1786015259.867872:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280311680 00000100:00100000:1.0:1786015259.867925:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:1.0:1786015259.867934:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+29:2353:x1872772280311680:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015259.867950:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015259.867975:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4ffb2e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e15 expref: 29 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.868453:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8b74b0022200) 00010000:00010000:1.0:1786015259.868458:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015259.868505:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+28:2353:x1872772280311680:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 572us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015259.868516:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:3.0:1786015259.871729:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015259.871904:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280311808 00000100:00100000:1.0:1786015259.871913:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280311808 00002000:00100000:1.0:1786015259.871969:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc:0x0] (0->157) req@ffff8b7383aae300 x1872772280311808/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:105/0 lens 648/0 e 0 to 0 dl 1786015270 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015259.871981:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7383aae300 with x1872772280311808 ext(0->157) 00010000:00010000:1.0:1786015259.871991:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e43cee00/0xb1a5ef690c4ffae8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7df2 expref: 8 pid: 14547 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.872008:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e43cee00/0xb1a5ef690c4ffae8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7df2 expref: 8 pid: 14547 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015259.872016:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b7383aae300 00000100:00100000:1.0:1786015259.872044:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:1.0:1786015259.872055:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280311808:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:2.0:1786015259.873462:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280311808:12345-192.168.202.56@tcp:4:cp.0 Request processed in 1402us (1738us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1786015259.873472:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 3 00002000:00100000:2.0:1786015259.873482:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc:0x0] (0->157) req@ffff8b7383aae300 x1872772280311808/t4294967324(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:105/0 lens 648/448 e 0 to 0 dl 1786015270 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015259.873490:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7383aae300 with x1872772280311808 ext(0->157) 00010000:00010000:2.0:1786015259.873499:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e43cee00/0xb1a5ef690c4ffae8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7df2 expref: 10 pid: 14547 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.873512:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e43cee00/0xb1a5ef690c4ffae8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7df2 expref: 10 pid: 14547 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015259.873519:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b7383aae300 00000100:00100000:3.0:1786015259.879046:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:1.0:1786015259.879688:0:14547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dfc0e6c3/0xb1a5ef690c4ffb3c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.879699:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfc0e6c3/0xb1a5ef690c4ffb3c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.879744:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dfc0e6c3/0xb1a5ef690c4ffb3c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.879752:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfc0e6c3/0xb1a5ef690c4ffb3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.879776:0:14547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfc0e6c3/0xb1a5ef690c4ffb3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.879784:0:14547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381935600 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015259.879789:0:14547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfc0e6c3/0xb1a5ef690c4ffb3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.879798:0:14547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfc0e6c3/0xb1a5ef690c4ffb3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.879810:0:14547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfc0e6c3/0xb1a5ef690c4ffb3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.879817:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfc0e6c3/0xb1a5ef690c4ffb3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015259.892463:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015259.907209:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015259.907285:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280312320 00000100:00100000:2.0:1786015259.907295:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280312320 00000100:00100000:2.0:1786015259.907360:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 147 00000100:00100000:2.0:1786015259.907372:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280312320:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015259.907480:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015259.907509:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f82c565/0xb1a5ef690c4ffb43 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e1c expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015259.907618:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 158, mtime: 0x6a746e1b, atime: 0x0, ctime: 0x6a746e1b, blocks: 0x1 00010000:00010000:2.0:1786015259.907653:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1786015259.907659:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015259.907748:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f82c565/0xb1a5ef690c4ffb43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e1c expref: 9 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.908005:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f82c565/0xb1a5ef690c4ffb43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e1c expref: 9 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015259.908023:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a0600, rc 0) 00000100:00100000:2.0:1786015259.908157:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280312320:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 786us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015259.908165:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 147 00000100:00100000:3.0:1786015259.920307:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015259.920581:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280312576 00000100:00100000:2.0:1786015259.920592:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280312576 00000100:00100000:2.0:1786015259.922380:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 579 00000100:00100000:2.0:1786015259.922414:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+28:18582:x1872772280312576:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015259.922560:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+28:18582:x1872772280312576:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 167us (2263us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015259.922567:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 579 00000100:00100000:1.0:1786015259.926347:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015259.926388:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280312704 00000100:00100000:1.0:1786015259.926412:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280312704 00002000:00100000:1.0:1786015259.926470:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc:0x0] (0->4095) req@ffff8b74aeba3100 x1872772280312704/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:105/0 lens 488/0 e 0 to 0 dl 1786015270 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015259.926481:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aeba3100 with x1872772280312704 ext(0->4095) 00002000:00010000:1.0:1786015259.926487:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74aeba3100 00000100:00100000:1.0:1786015259.926524:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:1.0:1786015259.926535:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280312704:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1786015259.926813:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280312704:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 277us (475us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786015259.926822:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 52 00002000:00100000:1.0:1786015259.926840:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc:0x0] (0->4095) req@ffff8b74aeba3100 x1872772280312704/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:105/0 lens 488/4536 e 0 to 0 dl 1786015270 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015259.926849:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aeba3100 with x1872772280312704 ext(0->4095) 00002000:00010000:1.0:1786015259.926853:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74aeba3100 00000100:00100000:1.0:1786015259.938347:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015259.939124:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280312832 00000100:00100000:3.0:1786015259.939137:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280312832 00000100:00100000:3.0:1786015259.939207:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 580 00000100:00100000:3.0:1786015259.939218:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+28:18582:x1872772280312832:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015259.940746:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015259.940802:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ffb4a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e23 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.940843:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffb51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.940856:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffb51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.940867:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffb51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.940988:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ffb4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e23 expref: 30 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.941007:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffb51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e23 expref: 29 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.941015:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8b74b0022200) 00010000:00010000:3.0:1786015259.941018:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786015259.941022:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb800, rc 0) 00000100:00100000:3.0:1786015259.941086:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+29:18582:x1872772280312832:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1870us (2748us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015259.941101:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 580 00000100:00100000:3.0:1786015259.946861:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015259.946949:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280312960 00000100:00100000:1.0:1786015259.946959:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280312960 00000100:00100000:1.0:1786015259.947021:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 581 00000100:00100000:1.0:1786015259.947031:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+29:18582:x1872772280312960:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786015259.947063:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786015259.947177:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+29:18582:x1872772280312960:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 147us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015259.947185:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 581 00000100:00100000:2.0:1786015259.958158:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015259.958316:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280313088 00000100:00100000:3.0:1786015259.958326:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280313088 00000100:00100000:3.0:1786015259.958450:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 148 00000100:00100000:3.0:1786015259.958463:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280313088:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015259.958510:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000034c21fbb/0xb1a5ef690c4ffb58 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.958530:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015259.958535:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015259.958541:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034c21fbb/0xb1a5ef690c4ffb58 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.958556:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034c21fbb/0xb1a5ef690c4ffb58 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.958591:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000034c21fbb/0xb1a5ef690c4ffb58 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.958600:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034c21fbb/0xb1a5ef690c4ffb58 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.958610:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034c21fbb/0xb1a5ef690c4ffb58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.958630:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819ba800 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015259.958635:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034c21fbb/0xb1a5ef690c4ffb58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.958644:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034c21fbb/0xb1a5ef690c4ffb58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.958673:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034c21fbb/0xb1a5ef690c4ffb58 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.958680:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034c21fbb/0xb1a5ef690c4ffb58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015259.958801:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280313088:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 339us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015259.958810:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 148 00000100:00100000:2.0:1786015259.961134:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015259.961330:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280313344 00000100:00100000:1.0:1786015259.961341:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280313344 00000100:00100000:1.0:1786015259.961414:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 582 00000100:00100000:1.0:1786015259.961424:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+29:18582:x1872772280313344:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786015259.961512:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffb5f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.961531:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffb51 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e23 expref: 29 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.961539:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffb5f lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.961578:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffb51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e23 expref: 29 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.961592:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffb51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e23 expref: 29 pid: 7673 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015259.961609:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304328704:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015259.965904:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786015259.972378:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015259.973978:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280313472 00000100:00100000:1.0:1786015259.973990:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280313472 00010000:00010000:1.0:1786015259.974042:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffb51 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e23 expref: 30 pid: 7673 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015259.974098:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 175 00000100:00100000:1.0:1786015259.974110:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748821c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+30:2354:x1872772280313472:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015259.974127:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015259.974134:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffb51 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e23 expref: 30 pid: 7673 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.974156:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffb51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e23 expref: 30 pid: 7673 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.974180:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8b74b0022200) 00010000:00010000:1.0:1786015259.974186:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffb5f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.974197:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffb5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.974205:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffb5f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015259.974227:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015259.974290:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748821c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+30:2354:x1872772280313472:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 183us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015259.974297:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 175 00010000:00010000:3.0:1786015259.977102:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffb51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e23 expref: 29 pid: 7673 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015259.977126:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304328704:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015259.977153:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffb5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.977191:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffb5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.977207:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffb5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.977431:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffb5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.977439:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffb5f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.977446:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffb5f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.977452:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf3b5600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015259.977456:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffb5f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.977464:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffb5f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.977481:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8b74b0022200) 00010000:00010000:3.0:1786015259.977485:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786015259.977490:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffb5f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015259.977496:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffb5f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015259.979015:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+29:18582:x1872772280313344:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 17585us (17883us total) trans 4294967701 rc 0/0 00000100:00100000:3.0:1786015259.979299:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 582 00000040:00080000:1.0:1786015259.981151:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015259.981159:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015259.981658:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1786015259.982251:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015259.988156:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280313728 00000100:00100000:1.0:1786015259.988169:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280313728 00000100:00100000:1.0:1786015259.988258:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 124 00000100:00100000:1.0:1786015259.988269:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+29:18582:x1872772280313728:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015259.988533:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+30:18582:x1872772280313728:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 265us (467us total) trans 4294967702 rc 0/0 00000100:00100000:1.0:1786015259.988556:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 124 00000100:00100000:3.0:1786015260.332086:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304329216:0@lo:400:kworker.0 00000100:00100000:3.0:1786015260.332164:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015260.332229:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786015260.332237:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304328832:0@lo:400:kworker.0 00000100:00100000:3.0:1786015260.332267:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015260.332291:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304329344:0@lo:400:kworker.0 00000100:00100000:3.0:1786015260.332315:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015260.332340:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304328960:0@lo:400:kworker.0 00000100:00100000:3.0:1786015260.332361:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015260.332375:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304329472:0@lo:400:kworker.0 00000100:00100000:3.0:1786015260.332393:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015260.332408:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015260.332412:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304329088:0@lo:400:kworker.0 00000100:00100000:3.0:1786015260.332429:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015260.332459:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304329216 00000100:00100000:3.0:1786015260.332466:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304329216 00000100:00100000:3.0:1786015260.332520:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304329472 00000100:00100000:3.0:1786015260.332523:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304329472 00000100:00100000:3.0:1786015260.332551:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1786015260.332560:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304329216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015260.332615:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304329216:12345-0@lo:400:kworker.0 Request processed in 56us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015260.332622:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1786015260.332643:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1786015260.332649:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304329472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015260.332683:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304329472:12345-0@lo:400:kworker.0 Request processed in 35us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015260.332705:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1786015260.332739:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304328832 00000100:00100000:3.0:1786015260.332744:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304328832 00000100:00100000:3.0:1786015260.332798:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1786015260.332805:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304328832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015260.332838:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304328832:12345-0@lo:400:kworker.0 Request processed in 34us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015260.332845:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1786015260.332872:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304329344 00000100:00100000:3.0:1786015260.332876:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304329344 00000100:00100000:3.0:1786015260.332899:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304328960 00000100:00100000:3.0:1786015260.332902:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304328960 00000100:00100000:3.0:1786015260.332916:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304329088 00000100:00100000:3.0:1786015260.332918:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304329088 00000100:00100000:3.0:1786015260.332932:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1786015260.332938:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304329344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015260.332971:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304329344:12345-0@lo:400:kworker.0 Request processed in 33us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015260.332977:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1786015260.332990:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1786015260.332995:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304328960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015260.333022:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304328960:12345-0@lo:400:kworker.0 Request processed in 27us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015260.333028:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1786015260.333040:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1786015260.333046:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304329088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015260.333085:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304329088:12345-0@lo:400:kworker.0 Request processed in 38us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015260.333091:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:3.0:1786015260.333121:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015260.333126:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015260.333128:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015260.333161:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304328832:0@lo:400:kworker.0 00000100:00100000:3.0:1786015260.333175:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304329344:0@lo:400:kworker.0 00000100:00100000:3.0:1786015260.333184:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304329216:0@lo:400:kworker.0 00000100:00100000:3.0:1786015260.333218:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304329088:0@lo:400:kworker.0 00000100:00100000:3.0:1786015260.333228:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304328960:0@lo:400:kworker.0 00000100:00100000:3.0:1786015260.333236:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304329472:0@lo:400:kworker.0 00010000:00010000:2.0:1786015260.461019:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015260.753799:0:15376:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015260.753812:0:15376:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015260.753869:0:15376:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 14 count 3 00000040:00080000:2.0:1786015260.753876:0:15376:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015260.847311:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304329600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015260.847396:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015260.847482:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304329600 00000100:00100000:3.0:1786015260.847490:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304329600 00000100:00100000:3.0:1786015260.847538:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1786015260.847548:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304329600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015260.847583:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 54460416 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015260.847634:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304329600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015260.847641:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1786015260.847694:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304329600:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1786015260.931967:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967700 is committed 00000001:00080000:1.0:1786015260.932007:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967697 is committed 00000001:00080000:1.0:1786015260.932017:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967702 is committed 00000100:00100000:3.0:1786015261.230395:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00080000:3.0:1786015261.230892:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015261.242820:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280314112 00000100:00100000:3.0:1786015261.242830:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280314112 00000100:00100000:3.0:1786015261.242914:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 583 00000100:00100000:3.0:1786015261.242926:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+58:18605:x1872772280314112:12345-192.168.202.56@tcp:101:diff.0 00010000:00010000:3.0:1786015261.242947:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015261.242973:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffb6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e31 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015261.243081:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bae00/0xb1a5ef690c4ffb74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015261.243097:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bae00/0xb1a5ef690c4ffb74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015261.243112:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bae00/0xb1a5ef690c4ffb74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015261.243125:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 158 00010000:00010000:3.0:1786015261.243315:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffb6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e31 expref: 61 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015261.243334:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bae00/0xb1a5ef690c4ffb74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e31 expref: 60 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015261.243344:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8b74b0022200) 00010000:00010000:3.0:1786015261.243347:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015261.243350:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bae00, rc 0) 00000100:00100000:3.0:1786015261.243428:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+60:18605:x1872772280314112:12345-192.168.202.56@tcp:101:diff.0 Request processed in 505us (740us total) trans 4294967703 rc 0/0 00000100:00100000:3.0:1786015261.243436:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 583 00000100:00080000:1.0:1786015261.245158:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015261.252732:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015261.252845:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015261.254209:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280314240 00000100:00100000:2.0:1786015261.254221:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280314240 00002000:00100000:2.0:1786015261.254266:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc:0x0] (0->4095) req@ffff8b74aeba2d80 x1872772280314240/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:107/0 lens 488/0 e 0 to 0 dl 1786015272 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015261.254278:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aeba2d80 with x1872772280314240 ext(0->4095) 00002000:00010000:2.0:1786015261.254283:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74aeba2d80 00000100:00100000:2.0:1786015261.254312:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:2.0:1786015261.254319:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41677fca-39fb-471c-b582-96bce6540a36+10:2354:x1872772280314240:12345-192.168.202.56@tcp:3:diff.0 00000100:00100000:2.0:1786015261.254560:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41677fca-39fb-471c-b582-96bce6540a36+10:2354:x1872772280314240:12345-192.168.202.56@tcp:3:diff.0 Request processed in 240us (1848us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786015261.254567:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 53 00002000:00100000:2.0:1786015261.254574:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc:0x0] (0->4095) req@ffff8b74aeba2d80 x1872772280314240/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:107/0 lens 488/4536 e 0 to 0 dl 1786015272 ref 1 fl Complete:/600/0 rc 4096/4096 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015261.254582:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aeba2d80 with x1872772280314240 ext(0->4095) 00002000:00010000:2.0:1786015261.254585:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74aeba2d80 00000100:00100000:1.0:1786015261.259424:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015261.357024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015261.357232:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280314880 00000100:00100000:1.0:1786015261.357245:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280314880 00000100:00100000:1.0:1786015261.357311:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 584 00000100:00100000:1.0:1786015261.357322:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+60:18608:x1872772280314880:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015261.357348:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015261.357368:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c4ffb82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e38 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015261.357485:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5c00/0xb1a5ef690c4ffb89 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015261.357501:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5c00/0xb1a5ef690c4ffb89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015261.357515:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5c00/0xb1a5ef690c4ffb89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015261.357528:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 158 00010000:00010000:1.0:1786015261.358062:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c4ffb82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e38 expref: 63 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015261.358109:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5c00/0xb1a5ef690c4ffb89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e38 expref: 62 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015261.358118:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8b74b0022200) 00010000:00010000:1.0:1786015261.358121:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1786015261.358125:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf3b5c00, rc 0) 00000100:00100000:1.0:1786015261.358328:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+62:18608:x1872772280314880:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1006us (1314us total) trans 4294967705 rc 0/0 00000100:00100000:1.0:1786015261.358336:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 584 00000100:00100000:3.0:1786015261.375588:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015261.483560:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:1.0:1786015261.485512:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015262.508160:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015263.533537:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015263.834970:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015263.835016:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015263.835052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015263.835100:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015263.835131:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015263.835157:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015263.835187:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015263.835217:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280315520 00000100:00100000:2.0:1786015263.835228:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280315520 00000100:00100000:2.0:1786015263.835283:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280316032 00000100:00100000:2.0:1786015263.835286:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280316032 00000100:00100000:2.0:1786015263.835299:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280315648 00000100:00100000:2.0:1786015263.835302:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280315648 00000100:00100000:2.0:1786015263.835313:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280315904 00000100:00100000:2.0:1786015263.835316:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280315904 00000100:00100000:2.0:1786015263.835333:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 216 00000100:00100000:2.0:1786015263.835342:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+10:2352:x1872772280315520:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015263.835473:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+10:2352:x1872772280315520:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 131us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015263.835481:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 216 00000100:00100000:3.0:1786015263.835606:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 217 00000100:00100000:3.0:1786015263.835618:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2352:x1872772280316032:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015263.835650:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2352:x1872772280316032:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 35us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015263.835657:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 217 00000100:00100000:3.0:1786015263.835675:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 218 00000100:00100000:3.0:1786015263.835682:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+8:2352:x1872772280315648:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015263.835720:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+8:2352:x1872772280315648:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 39us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015263.835728:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 218 00000100:00100000:3.0:1786015263.835742:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 219 00000100:00100000:3.0:1786015263.835749:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280315904:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015263.835814:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280315904:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 65us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015263.835820:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 219 00000100:00100000:3.0:1786015263.835862:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280315776 00000100:00100000:3.0:1786015263.835867:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280315776 00000100:00100000:3.0:1786015263.835899:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280315392 00000100:00100000:3.0:1786015263.835902:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280315392 00000100:00100000:3.0:1786015263.835921:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 271 00000100:00100000:3.0:1786015263.835937:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+24:2352:x1872772280315776:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015263.835969:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+24:2352:x1872772280315776:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015263.835975:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 271 00000100:00100000:3.0:1786015263.835988:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 272 00000100:00100000:3.0:1786015263.835995:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+62:2352:x1872772280315392:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015263.836018:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+62:2352:x1872772280315392:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015263.836024:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 272 00000100:00080000:3.0:1786015263.836055:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015263.836059:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015263.836061:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015263.916411:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786015263.916472:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304329728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015263.916552:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015263.916782:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304329728 00000100:00100000:2.0:1786015263.916790:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304329728 00000100:00100000:2.0:1786015263.916862:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1786015263.916872:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304329728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015263.916906:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 61276160 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015263.916971:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304329728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015263.916979:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1786015263.917027:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304329728:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786015263.918707:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1786015264.108054:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015264.108064:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015264.108377:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 14 count 2 00000040:00080000:1.0:1786015264.108386:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1786015264.523671:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:1.0:1786015264.558066:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015265.452051:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304330240:0@lo:400:kworker.0 00000100:00100000:3.0:1786015265.452160:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015265.452243:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786015265.452249:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304329856:0@lo:400:kworker.0 00000100:00100000:3.0:1786015265.452284:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015265.452308:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304330368:0@lo:400:kworker.0 00000100:00100000:3.0:1786015265.452337:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015265.452364:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304329984:0@lo:400:kworker.0 00000100:00100000:3.0:1786015265.452388:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015265.452406:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304330496:0@lo:400:kworker.0 00000100:00100000:3.0:1786015265.452427:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015265.452467:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015265.452472:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304330112:0@lo:400:kworker.0 00000100:00100000:3.0:1786015265.452496:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015265.452534:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304330240 00000100:00100000:3.0:1786015265.452544:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304330240 00000100:00100000:3.0:1786015265.452615:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304330496 00000100:00100000:3.0:1786015265.452619:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304330496 00000100:00100000:3.0:1786015265.452650:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1786015265.452660:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304330240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015265.452735:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304330240:12345-0@lo:400:kworker.0 Request processed in 77us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015265.452743:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1786015265.452798:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1786015265.452806:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304330496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015265.452841:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304330496:12345-0@lo:400:kworker.0 Request processed in 36us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015265.452846:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1786015265.452869:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304329856 00000100:00100000:3.0:1786015265.452873:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304329856 00000100:00100000:3.0:1786015265.452903:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1786015265.452910:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304329856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015265.452942:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304329856:12345-0@lo:400:kworker.0 Request processed in 32us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015265.452948:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1786015265.452979:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304330368 00000100:00100000:3.0:1786015265.452982:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304330368 00000100:00100000:3.0:1786015265.453005:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1786015265.453011:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304330368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015265.453046:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304330368:12345-0@lo:400:kworker.0 Request processed in 36us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015265.453052:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1786015265.453060:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304329984 00000100:00100000:3.0:1786015265.453063:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304329984 00000100:00100000:3.0:1786015265.453079:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304330112 00000100:00100000:3.0:1786015265.453081:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304330112 00000100:00100000:3.0:1786015265.453094:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1786015265.453098:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304329984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015265.453122:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304329984:12345-0@lo:400:kworker.0 Request processed in 23us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015265.453127:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1786015265.453136:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1786015265.453141:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304330112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015265.453163:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304330112:12345-0@lo:400:kworker.0 Request processed in 23us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015265.453169:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:3.0:1786015265.453197:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015265.453202:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015265.453205:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015265.453246:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304330112:0@lo:400:kworker.0 00000100:00100000:3.0:1786015265.453257:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304329984:0@lo:400:kworker.0 00000100:00100000:3.0:1786015265.453265:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304330496:0@lo:400:kworker.0 00000100:00100000:3.0:1786015265.453301:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304329856:0@lo:400:kworker.0 00000100:00100000:3.0:1786015265.453311:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304330368:0@lo:400:kworker.0 00000100:00100000:3.0:1786015265.453329:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304330240:0@lo:400:kworker.0 00010000:00010000:1.0:1786015265.585092:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015265.969947:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304330624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015265.970060:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015265.970716:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304330624 00000100:00100000:2.0:1786015265.970730:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304330624 00000100:00100000:2.0:1786015265.970848:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1786015265.970859:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304330624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015265.970907:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 54460416 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015265.970979:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304330624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015265.970986:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1786015265.971067:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304330624:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1786015266.036483:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967704 is committed 00000001:00080000:1.0:1786015266.036516:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967705 is committed 00010000:00010000:1.0:1786015266.604235:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015267.575260:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015267.575617:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280316160 00000100:00100000:1.0:1786015267.575632:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280316160 00000100:00100000:1.0:1786015267.575742:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 587 00000100:00100000:1.0:1786015267.575757:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+24:18568:x1872772280316160:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1786015267.576006:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+24:18568:x1872772280316160:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 253us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015267.576016:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 587 00000100:00080000:3.0:1786015267.577339:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015267.601243:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015267.601397:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280316416 00000100:00100000:2.0:1786015267.601412:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280316416 00000100:00100000:2.0:1786015267.601512:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 126 00000100:00100000:2.0:1786015267.601526:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+24:18568:x1872772280316416:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015267.602178:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+25:18568:x1872772280316416:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 653us (949us total) trans 4294967706 rc 0/0 00000100:00100000:2.0:1786015267.602188:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 126 00010000:00010000:1.0:1786015267.633782:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015268.652333:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015268.930225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015268.930277:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015268.930313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015268.930339:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015268.930362:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015268.930380:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015268.930404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015268.930436:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280316544 00000100:00100000:2.0:1786015268.930449:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280316544 00000100:00100000:2.0:1786015268.930507:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 347 00000100:00100000:2.0:1786015268.930520:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280316544:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015268.930614:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280316544:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 96us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015268.930636:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 347 00000100:00100000:3.0:1786015268.930787:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280316672 00000100:00100000:3.0:1786015268.930793:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280316672 00000100:00100000:3.0:1786015268.930846:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280317056 00000100:00100000:3.0:1786015268.930850:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280317056 00000100:00100000:3.0:1786015268.930873:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 276 00000100:00100000:3.0:1786015268.930881:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+59:2354:x1872772280316672:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015268.930917:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+59:2354:x1872772280316672:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015268.930924:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 276 00000100:00100000:3.0:1786015268.930940:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 277 00000100:00100000:3.0:1786015268.930945:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+25:2354:x1872772280317056:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015268.930975:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+25:2354:x1872772280317056:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015268.930981:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 277 00000100:00100000:3.0:1786015268.931008:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280316928 00000100:00100000:3.0:1786015268.931012:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280316928 00000100:00100000:3.0:1786015268.931040:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280317184 00000100:00100000:3.0:1786015268.931043:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280317184 00000100:00100000:3.0:1786015268.931055:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280316800 00000100:00100000:3.0:1786015268.931057:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280316800 00000100:00100000:3.0:1786015268.931069:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280317312 00000100:00100000:3.0:1786015268.931072:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280317312 00000100:00100000:3.0:1786015268.931088:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 222 00000100:00100000:3.0:1786015268.931104:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+8:2354:x1872772280316928:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015268.931133:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+8:2354:x1872772280316928:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015268.931140:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 222 00000100:00100000:3.0:1786015268.931153:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 223 00000100:00100000:3.0:1786015268.931159:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2354:x1872772280317184:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015268.931182:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2354:x1872772280317184:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015268.931189:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 223 00000100:00100000:3.0:1786015268.931201:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 224 00000100:00100000:3.0:1786015268.931207:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+10:2354:x1872772280316800:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015268.931229:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+10:2354:x1872772280316800:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015268.931235:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 224 00000100:00100000:3.0:1786015268.931244:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 225 00000100:00100000:3.0:1786015268.931250:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2354:x1872772280317312:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015268.931272:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2354:x1872772280317312:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015268.931277:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 225 00000100:00080000:2.0:1786015268.931666:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015268.931673:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015268.931677:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015269.045825:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304330752 00000100:00100000:2.0:1786015269.045843:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304330752 00000100:00100000:2.0:1786015269.045947:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1786015269.045961:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304330752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015269.046017:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015269.046143:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304330752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 185us (2912us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015269.046151:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1786015269.046523:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304330752:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1786015269.520617:0:15577:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 10b: Archive of non dirty file must work without doing request ========================================================== 07:21:08 (1786015268) 00010000:00010000:1.0:1786015269.677678:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015269.866911:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00080000:2.0:1786015269.867576:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786015269.870456:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ffbba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.870487:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ffbba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.870500:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ffbba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015269.870516:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1786015269.872204:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4ffbac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.872251:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4ffbac lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.872260:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4ffbac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.872267:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381935800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015269.872272:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4ffbac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.872282:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4ffbac lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.872304:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b749802e100) 00010000:00010000:2.0:1786015269.872308:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015269.872314:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4ffbac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.872321:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4ffbac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.872342:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934e00/0xb1a5ef690c4ffbb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.872349:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934e00/0xb1a5ef690c4ffbb3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.872356:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934e00/0xb1a5ef690c4ffbb3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.872360:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381934e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015269.872369:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934e00/0xb1a5ef690c4ffbb3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.872376:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934e00/0xb1a5ef690c4ffbb3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.872385:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8b7482d4bb00) 00010000:00010000:2.0:1786015269.872388:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015269.872391:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934e00/0xb1a5ef690c4ffbb3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.872397:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934e00/0xb1a5ef690c4ffbb3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.874154:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c4ffba5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e3f expref: 28 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.874194:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ffbba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e3f expref: 27 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.874205:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:2.0:1786015269.874209:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015269.874213:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1c00, rc 0) 00000100:00100000:2.0:1786015269.874350:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+27:19221:x1872772280317568:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 7168us (7452us total) trans 4294967707 rc 0/0 00000100:00100000:2.0:1786015269.874362:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 588 00000100:00100000:3.0:1786015269.879222:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015269.879297:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015269.879512:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280317824 00000100:00100000:2.0:1786015269.879529:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280317824 00000100:00100000:2.0:1786015269.879647:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:2.0:1786015269.879661:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+27:2353:x1872772280317824:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015269.879730:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015269.879810:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ffbba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e3f expref: 27 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.879986:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:2.0:1786015269.879993:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015269.880066:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+26:2353:x1872772280317824:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 408us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015269.880074:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:3.0:1786015269.901547:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015269.902144:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280317952 00000100:00100000:1.0:1786015269.902161:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280317952 00000100:00100000:1.0:1786015269.902279:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 590 00000100:00100000:1.0:1786015269.902291:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+59:19222:x1872772280317952:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015269.902321:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015269.906455:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c4ffbc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e46 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.906567:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffbcf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.906583:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffbcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.906595:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffbcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.910978:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffbd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.911023:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.911038:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.911456:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffbcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.911465:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffbcf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.911472:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffbcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.911479:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf3b5600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015269.911483:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffbcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.911490:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffbcf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.911505:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:1.0:1786015269.911508:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015269.911514:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffbcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.911520:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffbcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.911533:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.912398:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffbd6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.912413:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffbd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.912418:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf3b4e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015269.912422:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffbd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.912430:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffbd6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.912442:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x80c094a7 (ffff8b749802e300) 00010000:00010000:1.0:1786015269.912445:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015269.912448:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffbd6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.912455:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffbd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.912517:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c4ffbc8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e46 expref: 60 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.912528:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:1.0:1786015269.912531:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015269.912535:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c4ffbc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e46 expref: 60 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.912575:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf3b5000, rc 0) 00000100:00100000:1.0:1786015269.913913:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+59:19222:x1872772280317952:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 11616us (12373us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015269.913926:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 590 00000100:00100000:2.0:1786015269.923003:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015269.923210:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280318208 00000100:00100000:3.0:1786015269.923224:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280318208 00000100:00100000:3.0:1786015269.923306:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 591 00000100:00100000:3.0:1786015269.923319:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+59:19222:x1872772280318208:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:3.0:1786015269.923405:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015269.923445:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ff9de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d9e expref: 59 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.923471:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:3.0:1786015269.923477:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015269.925439:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffbdd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.925475:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c4ffa47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7dba expref: 25 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.925485:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffbdd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.925537:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c4ffa47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7dba expref: 25 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.925559:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c4ffa47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7dba expref: 25 pid: 5794 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015269.925577:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304330880:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015269.926910:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482dfd840 going to sleep for 11 seconds 00000100:00100000:3.0:1786015269.933879:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015269.934224:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304330880:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015269.934271:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffbdd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015269.934362:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280318336 00000100:00100000:1.0:1786015269.934372:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280318336 00010000:00010000:1.0:1786015269.934423:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c4ffa47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7dba expref: 26 pid: 5794 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015269.934474:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 176 00000100:00100000:1.0:1786015269.934486:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+26:2353:x1872772280318336:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015269.934507:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015269.934517:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c4ffa47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7dba expref: 26 pid: 5794 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.934531:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c4ffa47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7dba expref: 26 pid: 5794 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.934562:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c4ffa47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7dba expref: 26 pid: 5794 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.934582:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:1.0:1786015269.934588:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffbdd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.934599:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffbdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.934617:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffbdd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.934662:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015269.934739:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+25:2353:x1872772280318336:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 254us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015269.934749:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 176 00010000:00010000:3.0:1786015269.935693:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffbdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.935710:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffbdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.935790:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ffbe4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.935803:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ffbe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.935815:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ffbe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015269.938540:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 512 00010000:00010000:3.0:1786015269.938568:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffbdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.938580:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffbdd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.938589:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffbdd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.938596:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bbc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015269.938603:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffbdd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.938613:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffbdd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.938647:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:3.0:1786015269.938659:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015269.938666:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffbdd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.938673:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffbdd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015269.938750:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b1aceba4 reply state 00000000870fba36 transno 4294967708 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ffbe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015269.938799:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015269.939129:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+60:19222:x1872772280318208:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 15805us (16135us total) trans 4294967708 rc 0/0 00000100:00100000:3.0:1786015269.939141:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 591 00010000:00010000:2.0:1786015269.942421:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ffbe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.942442:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ffbe4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.942451:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ffbe4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.942458:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bbe00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015269.942464:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ffbe4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.942473:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ffbe4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.942512:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x80c094a7 (ffff8b74a04b5b00) 00010000:00010000:2.0:1786015269.942516:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015269.942521:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ffbe4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.942528:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4ffbe4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015269.952398:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280318464 00000100:00100000:3.0:1786015269.952413:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280318464 00000100:00100000:3.0:1786015269.952486:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 592 00000100:00100000:3.0:1786015269.952495:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+59:19223:x1872772280318464:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1786015269.952530:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015269.952557:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffbeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e4d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.952657:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c4ffbf2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.952674:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c4ffbf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.952688:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c4ffbf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015269.953124:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1786015269.953130:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 15 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015269.953165:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c4ffbf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.953197:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffbeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e4d expref: 61 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.953214:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c4ffbf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e4d expref: 60 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.953223:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5700) 00010000:00010000:3.0:1786015269.953226:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015269.953229:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb000, rc 0) 00000100:00100000:3.0:1786015269.953344:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+60:19223:x1872772280318464:12345-192.168.202.56@tcp:101:bash.0 Request processed in 850us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015269.953350:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 592 00000100:00100000:3.0:1786015269.960415:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015269.960502:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280318592 00000100:00100000:1.0:1786015269.960514:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280318592 00000100:00100000:1.0:1786015269.960578:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 593 00000100:00100000:1.0:1786015269.960588:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+60:19223:x1872772280318592:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1786015269.960614:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015269.960645:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c4ffbf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e54 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.960741:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffc00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.960801:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffc00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.960816:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffc00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.960839:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.960844:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.960868:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.961299:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7480031600/0xb1a5ef690c4ffc0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.961322:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7480031600/0xb1a5ef690c4ffc0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.961336:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7480031600/0xb1a5ef690c4ffc0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015269.961402:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 512 00000004:00200000:1.0:1786015269.961405:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015269.961429:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7480031600/0xb1a5ef690c4ffc0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.961440:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffc00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.961444:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffc00 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.961449:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffc00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.961453:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf3b4e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015269.961456:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffc00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.961460:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffc00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.961484:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5700) 00010000:00010000:1.0:1786015269.961486:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015269.961489:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffc00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.961493:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffc00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.961708:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.961713:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.961717:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.961719:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf3b5600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015269.961722:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.961726:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.961731:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x80c094a7 (ffff8b749802e300) 00010000:00010000:1.0:1786015269.961733:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015269.961735:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc07 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.961738:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.962016:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c4ffbf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e54 expref: 62 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.962033:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7480031600/0xb1a5ef690c4ffc0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e54 expref: 61 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015269.962041:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8b749802ed00) 00010000:00010000:1.0:1786015269.962043:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1786015269.962046:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7480031600, rc 0) 00000100:00100000:1.0:1786015269.962128:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+61:19223:x1872772280318592:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1540us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015269.962138:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 593 00000100:00100000:3.0:1786015269.968509:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280318720 00000100:00100000:3.0:1786015269.968518:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280318720 00000100:00100000:3.0:1786015269.972511:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 594 00000100:00100000:3.0:1786015269.972528:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+61:19223:x1872772280318720:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1786015269.972748:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015269.972793:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffc15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e5b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.972874:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffc1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.972906:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffc1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.972917:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffc1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.972982:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.972990:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.972998:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.973083:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffc1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.973091:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffc1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.973098:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffc1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.973105:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819baa00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015269.973109:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffc1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.973116:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffc1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.973129:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8b749802ed00) 00010000:00010000:3.0:1786015269.973139:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015269.973144:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffc1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.973150:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffc1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.973165:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.973171:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.973177:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.973183:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bac00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015269.973186:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.973417:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.973429:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff8b74a04b5900) 00010000:00010000:3.0:1786015269.973431:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015269.973435:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.973440:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.973479:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffc15 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e5b expref: 62 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.973498:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8b749802ed00) 00010000:00010000:3.0:1786015269.973500:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015269.973504:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffc15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e5b expref: 62 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.973513:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bbc00, rc 0) 00000100:00100000:3.0:1786015269.973997:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+61:19223:x1872772280318720:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1470us (5612us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015269.974007:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 594 00000100:00100000:3.0:1786015269.987561:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280318848 00000100:00100000:3.0:1786015269.987574:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280318848 00000100:00100000:3.0:1786015269.987646:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 595 00000100:00100000:3.0:1786015269.987657:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+25:19224:x1872772280318848:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015269.987679:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015269.987703:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffc2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e62 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.987794:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffc31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.987807:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffc31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.987816:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffc31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015269.987879:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1786015269.987899:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 15 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015269.987923:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffc31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.987943:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffc2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e62 expref: 27 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.987957:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffc31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e62 expref: 26 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015269.987964:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5700) 00010000:00010000:3.0:1786015269.987966:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015269.987979:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb200, rc 0) 00000100:00100000:3.0:1786015269.988043:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+26:19224:x1872772280318848:12345-192.168.202.56@tcp:101:rm.0 Request processed in 390us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015269.988048:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 595 00000100:00100000:1.0:1786015269.991210:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015269.991348:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280318976 00000100:00100000:2.0:1786015269.991363:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280318976 00000100:00100000:2.0:1786015269.991438:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 596 00000100:00100000:2.0:1786015269.991451:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+26:19224:x1872772280318976:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015269.991484:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015269.991515:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ffc38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e69 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.991610:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffc3f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.991902:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffc3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.991921:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffc3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.991946:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffc46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.991956:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffc46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.991987:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffc46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992158:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ffc4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992168:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ffc4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992176:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ffc4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015269.992227:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 512 00000004:00200000:2.0:1786015269.992232:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015269.992266:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ffc4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992282:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffc3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992288:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffc3f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992295:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffc3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992302:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a0a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015269.992306:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffc3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992315:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffc3f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992338:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5700) 00010000:00010000:2.0:1786015269.992341:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015269.992346:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffc3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992353:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffc3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992366:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffc46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992372:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffc46 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992378:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffc46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992383:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015269.992386:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffc46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992392:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffc46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992400:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x80c094a7 (ffff8b749232d200) 00010000:00010000:2.0:1786015269.992402:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015269.992405:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffc46 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992410:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffc46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992465:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ffc38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e69 expref: 28 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992480:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0200/0xb1a5ef690c4ffc4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e69 expref: 27 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015269.992488:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8b749802ed00) 00010000:00010000:2.0:1786015269.992490:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786015269.992494:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a0200, rc 0) 00000100:00100000:2.0:1786015269.993310:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+27:19224:x1872772280318976:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1850us (2105us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015269.993324:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 596 00000100:00100000:1.0:1786015270.002892:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015270.003028:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280319104 00000100:00100000:3.0:1786015270.003052:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280319104 00000100:00100000:3.0:1786015270.003336:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 597 00000100:00100000:3.0:1786015270.003350:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+27:19224:x1872772280319104:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015270.003373:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015270.003399:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffc54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e70 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003473:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffc5b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003488:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffc5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003522:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffc5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003564:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003571:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003578:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003663:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffc5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003671:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffc5b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003678:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffc5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003684:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bbc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015270.003689:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffc5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003696:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffc5b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003710:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8b749802ed00) 00010000:00010000:3.0:1786015270.003713:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015270.003718:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffc5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003731:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffc5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003745:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003751:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003757:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003820:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bac00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015270.003824:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003830:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003843:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff8b74a04b5900) 00010000:00010000:3.0:1786015270.003846:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015270.003849:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003854:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffc62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003893:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffc54 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e70 expref: 28 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003913:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8b749802ed00) 00010000:00010000:3.0:1786015270.003915:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015270.003919:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffc54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e70 expref: 28 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.003928:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819ba200, rc 0) 00000100:00100000:3.0:1786015270.004014:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+27:19224:x1872772280319104:12345-192.168.202.56@tcp:101:rm.0 Request processed in 667us (1142us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015270.004021:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 597 00000100:00100000:3.0:1786015270.008060:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280319232 00000100:00100000:3.0:1786015270.008074:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280319232 00000100:00100000:3.0:1786015270.008146:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 598 00000100:00100000:3.0:1786015270.008168:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+27:19224:x1872772280319232:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015270.008294:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015270.008320:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffc69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e77 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008393:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffc70 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008407:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffc70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008420:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffc70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008436:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008457:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008464:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008626:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffc70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008643:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffc70 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008649:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffc70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008656:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819ba400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015270.008661:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffc70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008669:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffc70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008682:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8b749802ed00) 00010000:00010000:3.0:1786015270.008685:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015270.008690:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffc70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008696:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffc70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008710:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008723:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008729:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008734:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015270.008737:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008743:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008752:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff8b74a04b5300) 00010000:00010000:3.0:1786015270.008755:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015270.008757:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008946:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008988:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffc69 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e77 expref: 28 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.008998:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8b749802ed00) 00010000:00010000:3.0:1786015270.009001:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015270.009004:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffc69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e77 expref: 28 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.009028:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819baa00, rc 0) 00000100:00100000:3.0:1786015270.009141:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+27:19224:x1872772280319232:12345-192.168.202.56@tcp:101:rm.0 Request processed in 974us (1320us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015270.009149:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 598 00000100:00100000:2.0:1786015270.022432:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015270.024413:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280319360 00000100:00100000:1.0:1786015270.024428:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280319360 00000100:00100000:1.0:1786015270.024519:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 599 00000100:00100000:1.0:1786015270.024533:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+27:19225:x1872772280319360:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015270.024570:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015270.024595:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffc7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e7e expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024681:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c4ffc85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024696:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c4ffc85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024726:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c4ffc85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024743:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024750:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024755:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024876:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c4ffc85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024882:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c4ffc85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024887:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c4ffc85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024891:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf3b5000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015270.024894:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c4ffc85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024900:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c4ffc85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024909:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8b749802ed00) 00010000:00010000:1.0:1786015270.024911:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015270.024914:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c4ffc85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024924:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c4ffc85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024935:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024938:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024942:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024945:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf3b5600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015270.024947:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024950:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024954:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff8b749802e300) 00010000:00010000:1.0:1786015270.024955:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015270.024957:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024960:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c4ffc8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.024991:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffc7e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e7e expref: 28 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.025005:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8b749802ed00) 00010000:00010000:1.0:1786015270.025007:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015270.025009:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c4ffc7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e7e expref: 28 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.025017:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf3b4e00, rc 0) 00000100:00100000:1.0:1786015270.025071:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+27:19225:x1872772280319360:12345-192.168.202.56@tcp:101:cp.0 Request processed in 544us (2652us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015270.025076:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 599 00000100:00100000:3.0:1786015270.029005:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280319488 00000100:00100000:3.0:1786015270.029018:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280319488 00000100:00100000:3.0:1786015270.029096:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 600 00000100:00100000:3.0:1786015270.029108:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+27:19225:x1872772280319488:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015270.029135:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015270.029162:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffc93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e85 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029250:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029264:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029275:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029290:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffca1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029295:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029301:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029379:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029388:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029396:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029402:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015270.029406:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029413:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029426:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8b749802ed00) 00010000:00010000:3.0:1786015270.029428:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015270.029434:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029439:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffc9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029454:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029459:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffca1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029464:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffca1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029476:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819ba400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015270.029480:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffca1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029485:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffca1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029493:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff8b74a04b5300) 00010000:00010000:3.0:1786015270.029496:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015270.029498:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffca1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029504:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffca1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029556:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffc93 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e85 expref: 28 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029568:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8b749802ed00) 00010000:00010000:3.0:1786015270.029570:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015270.029573:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffc93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e85 expref: 28 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.029583:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819baa00, rc 0) 00000100:00100000:3.0:1786015270.029665:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+27:19225:x1872772280319488:12345-192.168.202.56@tcp:101:cp.0 Request processed in 561us (795us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015270.029672:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 600 00000100:00100000:3.0:1786015270.035698:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280319744 00000100:00100000:3.0:1786015270.035727:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280319744 00000100:00100000:3.0:1786015270.035824:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 601 00000100:00100000:3.0:1786015270.035836:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+27:19225:x1872772280319744:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015270.035862:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015270.035885:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffca8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e8c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.036014:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffcaf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.036027:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffcaf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.036036:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffcaf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.036047:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffcb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.036051:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffcb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.036055:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffcb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786015270.037021:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe:0x0], index 1: 0 00010000:00010000:3.0:1786015270.037364:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba800/0xb1a5ef690c4ffcbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.037377:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba800/0xb1a5ef690c4ffcbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.037400:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba800/0xb1a5ef690c4ffcbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.037444:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffcaf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.037452:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffcaf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.037459:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffcaf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.037465:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bac00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015270.037470:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffcaf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.037477:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffcaf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.037490:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8b749802ed00) 00010000:00010000:3.0:1786015270.037493:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015270.037498:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffcaf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.037503:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffcaf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015270.037518:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001a6e4cab reply state 00000000129fbd5f transno 4294967709 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffcb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015270.037526:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786015270.038044:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffca8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e8c expref: 30 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.038066:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba800/0xb1a5ef690c4ffcbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e8c expref: 29 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.038075:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8b74a04b5c00) 00010000:00010000:3.0:1786015270.038078:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015270.038080:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819ba800, rc 0) 00000100:00100000:3.0:1786015270.038173:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+30:19225:x1872772280319744:12345-192.168.202.56@tcp:101:cp.0 Request processed in 2338us (2651us total) trans 4294967709 rc 0/0 00000100:00100000:3.0:1786015270.038182:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 601 00010000:00010000:2.0:1786015270.041262:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffcb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015270.041281:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffcb6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015270.041289:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffcb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015270.041295:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bbc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015270.041299:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffcb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015270.041308:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffcb6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015270.041345:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff8b74a04b5900) 00010000:00010000:2.0:1786015270.041348:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015270.041352:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffcb6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015270.041359:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffcb6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015270.044098:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280319872 00000100:00100000:3.0:1786015270.044109:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280319872 00000100:00100000:3.0:1786015270.044186:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 150 00000100:00100000:3.0:1786015270.044209:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2351:x1872772280319872:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015270.044229:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015270.044253:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffccb lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e93 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015270.044278:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786015270.044299:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=505s v=(0 0) 00010000:00010000:3.0:1786015270.044304:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015270.044313:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffccb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e93 expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.044332:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffccb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e93 expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.044362:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819ba200, rc 0) 00000100:00100000:3.0:1786015270.044420:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2351:x1872772280319872:12345-192.168.202.56@tcp:101:cp.0 Request processed in 226us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015270.044427:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 150 00000100:00080000:2.0:1786015270.044732:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015270.052065:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015270.052744:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280320000 00000100:00100000:3.0:1786015270.052776:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280320000 00000100:00100000:3.0:1786015270.052839:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 151 00000100:00100000:3.0:1786015270.052851:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:19225:x1872772280320000:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015270.052875:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015270.052899:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097efddd7/0xb1a5ef690c4ffcd2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7e9a expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.052936:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffccb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e93 expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.052945:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015270.052950:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015270.052956:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097efddd7/0xb1a5ef690c4ffcd2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e9a expref: 9 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.053069:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffccb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e93 expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.053085:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffccb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e93 expref: 9 pid: 6590 timeout: 605 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015270.053125:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304331008:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015270.053361:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482dfd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015270.057474:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304331008:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015270.057912:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097efddd7/0xb1a5ef690c4ffcd2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e9a expref: 9 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.057938:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bac00, rc 0) 00000100:00100000:3.0:1786015270.058031:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:19225:x1872772280320000:12345-192.168.202.56@tcp:101:cp.0 Request processed in 5182us (5975us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015270.058041:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 151 00000100:00100000:2.0:1786015270.062897:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015270.063088:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280320128 00000100:00100000:1.0:1786015270.063104:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280320128 00010000:00010000:1.0:1786015270.063160:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffccb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e93 expref: 9 pid: 6590 timeout: 605 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015270.063208:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 177 00000100:00100000:1.0:1786015270.063218:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280320128:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015270.063239:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015270.063273:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffccb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e93 expref: 9 pid: 6590 timeout: 605 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.063289:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffccb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e93 expref: 9 pid: 6590 timeout: 605 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.063320:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffccb lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e93 expref: 9 pid: 6590 timeout: 605 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.063376:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015270.063381:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015270.063392:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000097efddd7/0xb1a5ef690c4ffcd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e9a expref: 8 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.063404:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097efddd7/0xb1a5ef690c4ffcd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e9a expref: 8 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.063452:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000097efddd7/0xb1a5ef690c4ffcd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e9a expref: 8 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015270.063467:0:5781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1872772304331136:192.168.202.56@tcp:105: 00000100:00100000:1.0:1786015270.063572:0:5781:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1318240 going to sleep for 11 seconds 00000100:00100000:2.0:1786015270.066065:0:5781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1872772304331136:192.168.202.56@tcp:105: 00010000:00010000:2.0:1786015270.066102:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015270.066176:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280320128:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 2957us (3292us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015270.066191:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 177 00000100:00100000:2.0:1786015270.070436:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280320384 00000100:00100000:2.0:1786015270.070452:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280320384 00000100:00100000:2.0:1786015270.070622:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 127 00000100:00100000:2.0:1786015270.070642:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+29:19225:x1872772280320384:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:2.0:1786015270.071210:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+30:19225:x1872772280320384:12345-192.168.202.56@tcp:35:cp.0 Request processed in 576us (956us total) trans 4294967710 rc 0/0 00000100:00100000:2.0:1786015270.071220:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 127 00000100:00100000:3.0:1786015270.138367:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280320512 00000100:00100000:3.0:1786015270.138391:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280320512 00000100:00100000:3.0:1786015270.138494:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 602 00000100:00100000:3.0:1786015270.138506:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+61:19228:x1872772280320512:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015270.138535:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015270.138567:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffcd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7ea1 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.138692:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffce0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.138710:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffce0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.138724:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffce0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.138813:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffce7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.138831:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffce7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.138838:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffce7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.138965:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ffcee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.138975:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ffcee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.138982:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ffcee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015270.139026:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 158 00000004:00200000:3.0:1786015270.139031:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015270.139057:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ffcee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.139072:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ffcee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.139083:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffce0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.139091:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffce0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.139109:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffce0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.139117:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819ba400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015270.139122:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffce0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.139131:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffce0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.139146:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8b749802ed00) 00010000:00010000:3.0:1786015270.139150:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015270.139156:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffce0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.139162:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffce0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.139179:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffce7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.139186:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffce7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.139192:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffce7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.139198:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015270.139201:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffce7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.139216:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffce7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.139224:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff8b74a04b5a00) 00010000:00010000:3.0:1786015270.139227:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015270.139229:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffce7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.139235:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffce7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.139272:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffcd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ea1 expref: 63 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.139286:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba000/0xb1a5ef690c4ffcee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ea1 expref: 62 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.139294:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8b74a04b5c00) 00010000:00010000:3.0:1786015270.139296:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015270.139299:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819ba000, rc 0) 00000100:00100000:3.0:1786015270.139392:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+62:19228:x1872772280320512:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 888us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015270.139401:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 602 00000100:00080000:2.0:1786015270.140942:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015270.144193:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015270.144413:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280320640 00000100:00100000:3.0:1786015270.144428:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280320640 00000100:00080000:2.0:1786015270.144614:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015270.144686:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 152 00000100:00100000:3.0:1786015270.144699:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+8:2353:x1872772280320640:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015270.144740:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015270.144797:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffcf5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7ea8 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015270.144889:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304331264:192.168.202.56@tcp:106: 00000100:00100000:3.0:1786015270.145001:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482dfd6c0 going to sleep for 11 seconds 00002000:00010000:3.0:1786015270.150351:0:6592:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0xe:0x0] updating lvb size: 0 -> 158 00002000:00010000:3.0:1786015270.150367:0:6592:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0xe:0x0] updating lvb mtime: 0 -> 1786015270 00002000:00010000:3.0:1786015270.150370:0:6592:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0xe:0x0] updating lvb atime: 0 -> 1786015270 00002000:00010000:3.0:1786015270.150372:0:6592:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0xe:0x0] updating lvb ctime: 0 -> 1786015270 00000100:00100000:3.0:1786015270.150414:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304331264:192.168.202.56@tcp:106: 00010000:00010000:3.0:1786015270.150471:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffcf5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ea8 expref: 9 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.150503:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffcf5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ea8 expref: 9 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.150518:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819ba200, rc 0) 00000100:00100000:3.0:1786015270.150609:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+8:2353:x1872772280320640:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 5912us (6431us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015270.150620:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 152 00000100:00100000:2.0:1786015270.155944:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015270.162060:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015270.177254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015270.177394:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280321152 00000100:00100000:3.0:1786015270.177415:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280321152 00000100:00100000:3.0:1786015270.177518:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 604 00000100:00100000:3.0:1786015270.177531:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+63:19228:x1872772280321152:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:3.0:1786015270.178183:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].14, 136 off10096 00000100:00100000:3.0:1786015270.178312:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+63:19228:x1872772280321152:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 780us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015270.178323:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 604 00000040:00080000:3.0:1786015270.252973:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015270.252989:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015270.253040:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 15 count 3 00000040:00080000:3.0:1786015270.253054:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015270.253432:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304331520:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015270.255188:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482dfd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786015270.268130:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015270.268346:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304331520:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015270.276858:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015270.283746:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280321536 00000100:00100000:3.0:1786015270.283775:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280321536 00000100:00100000:3.0:1786015270.284184:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 606 00000100:00100000:3.0:1786015270.284197:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+30:19238:x1872772280321536:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015270.284226:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015270.284254:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffd11 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7ebd expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.284375:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffd18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.284388:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffd18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.284398:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffd18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015270.284422:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 158 00010000:00010000:3.0:1786015270.284570:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffd11 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ebd expref: 33 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.284586:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffd18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ebd expref: 32 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.284594:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8b74a04b5c00) 00010000:00010000:3.0:1786015270.284597:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015270.284599:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819baa00, rc 0) 00000100:00100000:3.0:1786015270.285019:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+32:19238:x1872772280321536:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 822us (8174us total) trans 4294967711 rc 0/0 00000100:00100000:3.0:1786015270.285029:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 606 00000100:00100000:2.0:1786015270.294485:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015270.294585:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015270.294869:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280321792 00000100:00100000:3.0:1786015270.294883:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280321792 00000100:00100000:3.0:1786015270.294964:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 154 00000100:00100000:3.0:1786015270.294977:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280321792:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015270.295048:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffd26 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.295076:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097efddd7/0xb1a5ef690c4ffcd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e9a expref: 8 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.295087:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015270.295093:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015270.295099:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffd26 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.295161:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097efddd7/0xb1a5ef690c4ffcd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e9a expref: 8 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.295175:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097efddd7/0xb1a5ef690c4ffcd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e9a expref: 8 pid: 11384 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015270.295191:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304331648:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015270.295286:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482dfd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015270.302069:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280321664 00000100:00100000:1.0:1786015270.302108:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280321664 00000100:00100000:1.0:1786015270.304119:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:1.0:1786015270.304148:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+32:2351:x1872772280321664:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015270.304175:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015270.304216:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffd18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ebd expref: 32 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.304241:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8b74a04b5c00) 00010000:00010000:1.0:1786015270.304265:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015270.304351:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+31:2351:x1872772280321664:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 214us (9879us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015270.304361:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:1.0:1786015270.309454:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304331648:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015270.309504:0:11384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffd26 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015270.315396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015270.315526:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280321920 00000100:00100000:3.0:1786015270.315545:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280321920 00002000:00100000:3.0:1786015270.315645:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe:0x0] (0->157) req@ffff8b74af05e680 x1872772280321920/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:116/0 lens 648/0 e 0 to 0 dl 1786015281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015270.315659:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74af05e680 with x1872772280321920 ext(0->157) 00010000:00010000:3.0:1786015270.315672:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000097efddd7/0xb1a5ef690c4ffcd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e9a expref: 9 pid: 11384 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.315695:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000097efddd7/0xb1a5ef690c4ffcd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e9a expref: 9 pid: 11384 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015270.315704:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b74af05e680 00000100:00100000:3.0:1786015270.315739:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:3.0:1786015270.315748:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280321920:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:3.0:1786015270.320757:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280321920:12345-192.168.202.56@tcp:4:cp.0 Request processed in 4997us (5359us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1786015270.320808:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 4 00002000:00100000:3.0:1786015270.320823:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe:0x0] (0->157) req@ffff8b74af05e680 x1872772280321920/t4294967329(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:116/0 lens 648/448 e 0 to 0 dl 1786015281 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015270.320834:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74af05e680 with x1872772280321920 ext(0->157) 00010000:00010000:3.0:1786015270.320847:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000097efddd7/0xb1a5ef690c4ffcd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e9a expref: 11 pid: 11384 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.320990:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000097efddd7/0xb1a5ef690c4ffcd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e9a expref: 11 pid: 11384 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015270.321000:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b74af05e680 00000100:00100000:2.0:1786015270.328709:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:2.0:1786015270.329828:0:11384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffd26 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015270.329837:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffd26 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015270.329866:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffd26 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015270.329874:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffd26 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015270.329882:0:11384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffd26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015270.329890:0:11384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819ba200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015270.329895:0:11384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffd26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015270.330252:0:11384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffd26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015270.330269:0:11384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffd26 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015270.330284:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010bcccaf/0xb1a5ef690c4ffd26 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015270.330336:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280321792:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 35361us (35750us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015270.330345:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 154 00000100:00100000:2.0:1786015270.333254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015270.349699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015270.349817:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280322432 00000100:00100000:1.0:1786015270.349831:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280322432 00000100:00100000:1.0:1786015270.349907:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 155 00000100:00100000:1.0:1786015270.349918:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280322432:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015270.349938:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015270.349963:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005383dfb9/0xb1a5ef690c4ffd2d lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7ec4 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015270.349993:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 158, mtime: 0x6a746e26, atime: 0x0, ctime: 0x6a746e26, blocks: 0x1 00010000:00010000:1.0:1786015270.350015:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=505s v=(0 0) 00010000:00010000:1.0:1786015270.350020:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015270.350031:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005383dfb9/0xb1a5ef690c4ffd2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ec4 expref: 10 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.350051:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005383dfb9/0xb1a5ef690c4ffd2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ec4 expref: 10 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.350066:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813be400, rc 0) 00000100:00100000:1.0:1786015270.350157:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280322432:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 240us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015270.350164:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 155 00000100:00100000:2.0:1786015270.357855:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015270.358650:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280322688 00000100:00100000:1.0:1786015270.358664:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280322688 00000100:00100000:1.0:1786015270.358732:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 608 00000100:00100000:1.0:1786015270.358742:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+31:19238:x1872772280322688:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786015270.358906:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+31:19238:x1872772280322688:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 164us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015270.358915:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 608 00000100:00100000:2.0:1786015270.383697:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280322816 00000100:00100000:2.0:1786015270.383709:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280322816 00002000:00100000:2.0:1786015270.383794:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xe:0x0] (0->4095) req@ffff8b7381f9c380 x1872772280322816/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:116/0 lens 488/0 e 0 to 0 dl 1786015281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015270.383806:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381f9c380 with x1872772280322816 ext(0->4095) 00002000:00010000:2.0:1786015270.383822:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7381f9c380 00000100:00100000:2.0:1786015270.383853:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 54 00000100:00100000:2.0:1786015270.383864:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280322816:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1786015270.384357:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280322816:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 492us (825us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786015270.384367:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 54 00002000:00100000:2.0:1786015270.384376:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xe:0x0] (0->4095) req@ffff8b7381f9c380 x1872772280322816/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:116/0 lens 488/4536 e 0 to 0 dl 1786015281 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015270.384385:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381f9c380 with x1872772280322816 ext(0->4095) 00002000:00010000:2.0:1786015270.384395:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7381f9c380 00000100:00100000:3.0:1786015270.412922:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015270.413015:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280322944 00000100:00100000:2.0:1786015270.413027:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280322944 00000100:00100000:2.0:1786015270.413111:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 609 00000100:00100000:2.0:1786015270.413122:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+31:19238:x1872772280322944:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015270.413144:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015270.413169:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffd34 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7ecb expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015270.413208:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffd3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015270.413222:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffd3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015270.413236:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffd3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.413379:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffd34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ecb expref: 33 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.413397:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffd3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ecb expref: 32 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.413406:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8b74a04b5c00) 00010000:00010000:3.0:1786015270.413409:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786015270.413413:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a0a00, rc 0) 00000100:00100000:3.0:1786015270.413481:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+32:19238:x1872772280322944:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 361us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015270.413488:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 609 00000100:00100000:2.0:1786015270.418224:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015270.418275:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280323072 00000100:00100000:3.0:1786015270.418301:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280323072 00000100:00100000:3.0:1786015270.418370:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 610 00000100:00100000:3.0:1786015270.418382:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+32:19238:x1872772280323072:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015270.418418:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xf:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015270.418552:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+32:19238:x1872772280323072:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 172us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015270.418561:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 610 00000100:00100000:2.0:1786015270.423806:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015270.427873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015270.436994:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304331776:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015270.437028:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4ffd49 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015270.437156:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015270.437501:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280323584 00000100:00100000:1.0:1786015270.437510:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280323584 00010000:00010000:1.0:1786015270.437547:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffd3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ecb expref: 33 pid: 12526 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015270.437588:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 179 00000100:00100000:1.0:1786015270.437597:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748821f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+33:2354:x1872772280323584:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015270.437614:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015270.437622:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffd3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ecb expref: 33 pid: 12526 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.437645:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffd3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ecb expref: 33 pid: 12526 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.437670:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffd3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ecb expref: 33 pid: 12526 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.437703:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8b74a04b5c00) 00010000:00010000:1.0:1786015270.437709:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4ffd49 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.437718:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4ffd49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.437726:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4ffd49 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015270.437756:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015270.437786:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4ffd49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.437794:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4ffd49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015270.437826:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748821f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+32:2354:x1872772280323584:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 231us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015270.437834:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 179 00010000:00010000:3.0:1786015270.438307:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4ffd49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.438317:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4ffd49 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.438324:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4ffd49 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.438331:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381935200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015270.438335:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4ffd49 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.438355:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4ffd49 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.438365:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8b74a04b5c00) 00010000:00010000:3.0:1786015270.438368:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786015270.438371:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4ffd49 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015270.438376:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4ffd49 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015270.438524:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+32:19238:x1872772280323456:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 10467us (10660us total) trans 4294967712 rc 0/0 00000100:00100000:3.0:1786015270.438534:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 611 00000040:00080000:1.0:1786015270.438851:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015270.438856:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015270.439472:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1786015270.439484:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015270.455870:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015270.575801:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304332288:0@lo:400:kworker.0 00000100:00100000:2.0:1786015270.575919:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015270.575991:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786015270.575997:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304331904:0@lo:400:kworker.0 00000100:00100000:2.0:1786015270.576028:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015270.576068:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738374ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304332416:0@lo:400:kworker.0 00000100:00100000:2.0:1786015270.576093:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015270.576131:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738374a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304332160:0@lo:400:kworker.0 00000100:00100000:2.0:1786015270.576155:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015270.576178:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1786015270.576184:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304332032:0@lo:400:kworker.0 00000100:00100000:2.0:1786015270.576204:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015270.576218:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304332544:0@lo:400:kworker.0 00000100:00100000:2.0:1786015270.576237:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015270.576262:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304332288 00000100:00100000:2.0:1786015270.576270:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304332288 00000100:00100000:2.0:1786015270.576317:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304332544 00000100:00100000:2.0:1786015270.576320:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304332544 00000100:00100000:2.0:1786015270.576371:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1786015270.576379:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304332288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015270.576431:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304332288:12345-0@lo:400:kworker.0 Request processed in 53us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015270.576437:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1786015270.576455:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1786015270.576460:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304332544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015270.576491:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304332544:12345-0@lo:400:kworker.0 Request processed in 31us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015270.576497:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1786015270.576517:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304332416 00000100:00100000:2.0:1786015270.576520:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304332416 00000100:00100000:2.0:1786015270.576545:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304332160 00000100:00100000:2.0:1786015270.576547:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304332160 00000100:00100000:2.0:1786015270.576580:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304332032 00000100:00100000:2.0:1786015270.576583:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304332032 00000100:00100000:2.0:1786015270.576595:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1786015270.576600:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304332416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015270.576643:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304332416:12345-0@lo:400:kworker.0 Request processed in 30us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015270.576649:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1786015270.576660:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1786015270.576666:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304332160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015270.576691:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304332160:12345-0@lo:400:kworker.0 Request processed in 25us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015270.576697:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1786015270.576708:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1786015270.576713:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304332032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015270.576740:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304332032:12345-0@lo:400:kworker.0 Request processed in 27us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015270.576747:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:2.0:1786015270.576784:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786015270.576789:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015270.576825:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304332032:0@lo:400:kworker.0 00000100:00100000:2.0:1786015270.576836:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304332544:0@lo:400:kworker.0 00000100:00100000:2.0:1786015270.576844:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738374a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304332160:0@lo:400:kworker.0 00000100:00100000:2.0:1786015270.576880:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738374ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304332416:0@lo:400:kworker.0 00000100:00100000:2.0:1786015270.576889:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304332288:0@lo:400:kworker.0 00000100:00100000:1.0:1786015270.578108:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304331904 00000100:00100000:1.0:1786015270.578122:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304331904 00000100:00100000:1.0:1786015270.578188:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1786015270.578198:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304331904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015270.578300:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304331904:12345-0@lo:400:kworker.0 Request processed in 103us (2271us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015270.578307:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00010000:00010000:1.0:1786015270.700093:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015271.102868:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304332672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015271.102955:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015271.103051:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304332672 00000100:00100000:3.0:1786015271.103060:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304332672 00000100:00100000:3.0:1786015271.103126:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1786015271.103136:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304332672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015271.103159:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 57868288 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015271.103208:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304332672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015271.103215:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1786015271.103513:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304332672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015271.270921:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015271.272069:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280323968 00000100:00100000:3.0:1786015271.272091:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280323968 00000100:00100000:3.0:1786015271.272436:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 157 00000100:00100000:3.0:1786015271.272462:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+8:2351:x1872772280323968:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015271.272912:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015271.272938:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6c0483d/0xb1a5ef690c4ffd50 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7ed2 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015271.272970:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786015271.272975:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015271.272986:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6c0483d/0xb1a5ef690c4ffd50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ed2 expref: 9 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015271.273005:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a6c0483d/0xb1a5ef690c4ffd50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ed2 expref: 9 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015271.273019:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bee00, rc 0) 00000100:00100000:1.0:1786015271.273080:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+9:2351:x1872772280323968:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 623us (2168us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015271.282470:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 157 00000100:00100000:1.0:1786015271.286314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000040:00080000:2.0:1786015271.469416:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015271.469426:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015271.469951:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1786015271.469964:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015271.724049:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015272.152184:0:15681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015272.152200:0:15681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015272.153027:0:15681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 15 count 3 00000040:00080000:1.0:1786015272.153051:0:15681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015272.748067:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015273.776847:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015274.052381:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015274.052433:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015274.052474:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015274.052985:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015274.053816:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015274.053846:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015274.053865:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015274.053880:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280324736 00000100:00100000:3.0:1786015274.053883:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280324736 00000100:00100000:3.0:1786015274.053905:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 228 00000100:00100000:3.0:1786015274.053910:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+9:2353:x1872772280324736:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015274.053934:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+9:2353:x1872772280324736:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015274.053938:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 228 00000100:00100000:3.0:1786015274.053945:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280324992 00000100:00100000:3.0:1786015274.053947:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280324992 00000100:00100000:3.0:1786015274.053955:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280324608 00000100:00100000:3.0:1786015274.053956:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280324608 00000100:00100000:3.0:1786015274.053963:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280325120 00000100:00100000:3.0:1786015274.053964:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280325120 00000100:00100000:3.0:1786015274.053972:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 229 00000100:00100000:3.0:1786015274.053975:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2353:x1872772280324992:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015274.053988:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2353:x1872772280324992:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 13us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015274.054000:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 229 00000100:00100000:3.0:1786015274.054008:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 230 00000100:00100000:3.0:1786015274.054011:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280324608:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015274.054026:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280324608:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 15us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015274.054030:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 230 00000100:00100000:3.0:1786015274.054035:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 231 00000100:00100000:3.0:1786015274.054038:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280325120:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015274.054048:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280325120:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 10us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015274.054051:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 231 00000100:00100000:1.0:1786015274.059143:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280324864 00000100:00100000:1.0:1786015274.059251:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280324864 00000100:00100000:1.0:1786015274.059379:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 282 00000100:00100000:1.0:1786015274.059390:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+26:2353:x1872772280324864:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015274.061004:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+26:2353:x1872772280324864:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 1607us (7146us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015274.061017:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 282 00000100:00100000:2.0:1786015274.155947:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7488258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304332800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015274.156017:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015274.156880:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304332800 00000100:00100000:3.0:1786015274.156891:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304332800 00000100:00100000:3.0:1786015274.156947:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1786015274.156956:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304332800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015274.156992:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015274.157923:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304332800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 963us (1900us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015274.157934:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1786015274.157967:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015274.158020:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7488258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304332800:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1786015274.540186:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015274.540196:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015274.540518:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 15 count 2 00000040:00080000:2.0:1786015274.540526:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015274.796648:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015275.696867:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304333312:0@lo:400:kworker.0 00000100:00100000:1.0:1786015275.696941:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015275.697017:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786015275.697024:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304332928:0@lo:400:kworker.0 00000100:00100000:1.0:1786015275.697054:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015275.697078:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304333440:0@lo:400:kworker.0 00000100:00100000:1.0:1786015275.697103:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015275.697133:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304333056:0@lo:400:kworker.0 00000100:00100000:1.0:1786015275.697156:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015275.697174:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304333568:0@lo:400:kworker.0 00000100:00100000:1.0:1786015275.697195:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015275.697213:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015275.697219:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304333184:0@lo:400:kworker.0 00000100:00100000:1.0:1786015275.697241:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015275.697273:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304333312 00000100:00100000:1.0:1786015275.697280:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304333312 00000100:00100000:1.0:1786015275.697323:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304333568 00000100:00100000:1.0:1786015275.697326:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304333568 00000100:00100000:1.0:1786015275.697360:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1786015275.697369:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304333312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015275.697424:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304333312:12345-0@lo:400:kworker.0 Request processed in 56us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015275.697447:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1786015275.697464:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1786015275.697470:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304333568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015275.697508:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304333568:12345-0@lo:400:kworker.0 Request processed in 37us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015275.697514:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1786015275.697536:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304332928 00000100:00100000:1.0:1786015275.697541:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304332928 00000100:00100000:1.0:1786015275.697562:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1786015275.697568:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304332928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015275.697615:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304332928:12345-0@lo:400:kworker.0 Request processed in 47us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015275.697621:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1786015275.697650:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304333440 00000100:00100000:1.0:1786015275.697654:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304333440 00000100:00100000:1.0:1786015275.697680:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304333056 00000100:00100000:1.0:1786015275.697682:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304333056 00000100:00100000:1.0:1786015275.697695:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304333184 00000100:00100000:1.0:1786015275.697697:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304333184 00000100:00100000:1.0:1786015275.697711:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1786015275.697717:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304333440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015275.697751:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304333440:12345-0@lo:400:kworker.0 Request processed in 34us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015275.697757:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1786015275.697803:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1786015275.697809:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304333056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015275.697850:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304333056:12345-0@lo:400:kworker.0 Request processed in 41us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015275.697856:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1786015275.697869:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1786015275.697874:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304333184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015275.697904:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304333184:12345-0@lo:400:kworker.0 Request processed in 30us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015275.697909:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:1.0:1786015275.697929:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015275.697934:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015275.697971:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304333184:0@lo:400:kworker.0 00000100:00100000:1.0:1786015275.697983:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304333056:0@lo:400:kworker.0 00000100:00100000:1.0:1786015275.697991:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304333568:0@lo:400:kworker.0 00000100:00100000:1.0:1786015275.698022:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304332928:0@lo:400:kworker.0 00000100:00100000:1.0:1786015275.698031:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304333440:0@lo:400:kworker.0 00000100:00100000:1.0:1786015275.698040:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304333312:0@lo:400:kworker.0 00010000:00010000:3.0:1786015275.821857:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015276.205206:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304333696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015276.205316:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015276.205606:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304333696 00000100:00100000:3.0:1786015276.205615:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304333696 00000100:00100000:3.0:1786015276.205786:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1786015276.205797:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304333696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015276.205836:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 56164352 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015276.205889:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304333696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015276.205897:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1786015276.208527:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304333696:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786015276.844209:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015277.868403:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015278.664904:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015278.664985:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280325248 00000100:00100000:2.0:1786015278.664997:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280325248 00000100:00100000:2.0:1786015278.665087:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 613 00000100:00100000:2.0:1786015278.665099:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+26:19221:x1872772280325248:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1786015278.665213:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+26:19221:x1872772280325248:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 117us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015278.665221:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 613 00000100:00080000:1.0:1786015278.665480:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015278.676613:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280325504 00000100:00100000:2.0:1786015278.676626:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280325504 00000100:00100000:2.0:1786015278.676727:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 129 00000100:00100000:2.0:1786015278.676740:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+26:19221:x1872772280325504:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015278.677337:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+27:19221:x1872772280325504:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 597us (1233us total) trans 4294967714 rc 0/0 00000100:00100000:2.0:1786015278.677346:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 129 00010000:00010000:1.0:1786015278.892596:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015279.174810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015279.174860:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015279.174922:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015279.174940:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015279.174955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015279.174970:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015279.175006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015279.175033:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280325888 00000100:00100000:3.0:1786015279.175044:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280325888 00000100:00100000:3.0:1786015279.175105:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280326400 00000100:00100000:3.0:1786015279.175109:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280326400 00000100:00100000:3.0:1786015279.175123:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280326016 00000100:00100000:3.0:1786015279.175125:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280326016 00000100:00100000:3.0:1786015279.175138:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280326272 00000100:00100000:3.0:1786015279.175140:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280326272 00000100:00100000:3.0:1786015279.175156:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 234 00000100:00100000:3.0:1786015279.175240:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+10:2352:x1872772280325888:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015279.175266:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+10:2352:x1872772280325888:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015279.175273:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 234 00000100:00100000:3.0:1786015279.175289:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 235 00000100:00100000:3.0:1786015279.175295:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280326400:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015279.175317:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280326400:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015279.175329:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 235 00000100:00100000:3.0:1786015279.175341:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 236 00000100:00100000:3.0:1786015279.175346:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+9:2352:x1872772280326016:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015279.175367:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+9:2352:x1872772280326016:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015279.175373:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 236 00000100:00100000:1.0:1786015279.175489:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280325632 00000100:00100000:1.0:1786015279.175493:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280325632 00000100:00100000:1.0:1786015279.175530:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 351 00000100:00100000:1.0:1786015279.175537:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280325632:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015279.175582:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280325632:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 45us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015279.175591:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 351 00000100:00080000:2.0:1786015279.175792:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786015279.175797:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015279.175799:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015279.277326:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304333824 00000100:00100000:2.0:1786015279.277336:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304333824 00000100:00100000:2.0:1786015279.277412:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1786015279.277421:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304333824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015279.277462:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015279.277513:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304333824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015279.277521:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00010000:1.0:1786015279.941157:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786015280.626178:0:15881:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 10c: Check forbidden archive ========== 07:21:19 (1786015279) 00000100:00100000:2.0:1786015280.817803:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304334336:0@lo:400:kworker.0 00000100:00100000:2.0:1786015280.817897:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015280.817980:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786015280.817988:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b748825a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304333952:0@lo:400:kworker.0 00000100:00100000:2.0:1786015280.818025:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015280.818057:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304334464:0@lo:400:kworker.0 00000100:00100000:2.0:1786015280.818085:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015280.818115:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7488258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304334080:0@lo:400:kworker.0 00000100:00100000:2.0:1786015280.818140:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015280.818178:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738374ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304334592:0@lo:400:kworker.0 00000100:00100000:2.0:1786015280.818203:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015280.818222:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786015280.818227:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7488258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304334208:0@lo:400:kworker.0 00000100:00100000:2.0:1786015280.818247:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015280.818280:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304334336 00000100:00100000:2.0:1786015280.818289:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304334336 00000100:00100000:2.0:1786015280.818335:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304334592 00000100:00100000:2.0:1786015280.818338:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304334592 00000100:00100000:2.0:1786015280.818371:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1786015280.818379:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304334336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015280.818438:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304334336:12345-0@lo:400:kworker.0 Request processed in 60us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015280.818445:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1786015280.818462:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1786015280.818467:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304334592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015280.818495:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304334592:12345-0@lo:400:kworker.0 Request processed in 28us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015280.818500:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1786015280.818519:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304333952 00000100:00100000:2.0:1786015280.818523:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304333952 00000100:00100000:2.0:1786015280.818573:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1786015280.818580:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304333952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015280.818610:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304333952:12345-0@lo:400:kworker.0 Request processed in 32us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015280.818616:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1786015280.818643:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304334464 00000100:00100000:2.0:1786015280.818654:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304334464 00000100:00100000:2.0:1786015280.818682:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1786015280.818688:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304334464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015280.818720:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304334464:12345-0@lo:400:kworker.0 Request processed in 32us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015280.818726:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1786015280.818736:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304334080 00000100:00100000:2.0:1786015280.818739:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304334080 00000100:00100000:2.0:1786015280.818757:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304334208 00000100:00100000:2.0:1786015280.818788:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304334208 00000100:00100000:2.0:1786015280.818809:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1786015280.818813:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304334080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015280.818844:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304334080:12345-0@lo:400:kworker.0 Request processed in 29us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015280.818849:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1786015280.818860:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1786015280.818866:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304334208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015280.818891:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304334208:12345-0@lo:400:kworker.0 Request processed in 25us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015280.818895:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:2.0:1786015280.818930:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786015280.818935:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015280.818975:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7488258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304334208:0@lo:400:kworker.0 00000100:00100000:2.0:1786015280.818984:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7488258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304334080:0@lo:400:kworker.0 00000100:00100000:2.0:1786015280.818992:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738374ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304334592:0@lo:400:kworker.0 00000100:00100000:2.0:1786015280.819025:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b748825a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304333952:0@lo:400:kworker.0 00000100:00100000:2.0:1786015280.819050:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304334464:0@lo:400:kworker.0 00000100:00100000:2.0:1786015280.819061:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304334336:0@lo:400:kworker.0 00000100:00100000:1.0:1786015280.926874:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015280.927010:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280326656 00000100:00100000:2.0:1786015280.927021:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280326656 00000100:00100000:2.0:1786015280.927110:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 614 00000100:00100000:2.0:1786015280.927120:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+27:19850:x1872772280326656:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015280.927150:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015280.927172:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ffd57 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7ed9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015280.927253:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ffd5e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015280.927279:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ffd5e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015280.927298:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ffd5e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015280.927314:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ffd65 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015280.927327:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ffd65 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015280.927337:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ffd65 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015280.928632:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffd6c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015280.928646:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffd6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015280.928657:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffd6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015280.928670:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1786015280.928926:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ffd5e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015280.928934:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ffd5e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015280.928940:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ffd5e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015280.928946:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015280.928950:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ffd5e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015280.928956:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ffd5e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015280.928983:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b749802e100) 00010000:00010000:1.0:1786015280.928986:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015280.928993:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ffd5e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015280.929000:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ffd5e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015280.929015:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ffd65 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015280.929022:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ffd65 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015280.929028:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ffd65 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015280.929034:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015280.929037:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ffd65 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015280.929043:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ffd65 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015280.929051:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8b749232dd00) 00010000:00010000:1.0:1786015280.929053:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015280.929056:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ffd65 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015280.929063:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4ffd65 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015280.929688:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4ffd57 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ed9 expref: 30 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015280.929706:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffd6c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ed9 expref: 29 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015280.929725:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:1.0:1786015280.929727:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015280.929730:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a0a00, rc 0) 00000100:00100000:1.0:1786015280.929863:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+29:19850:x1872772280326656:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 2743us (2998us total) trans 4294967715 rc 0/0 00000100:00100000:1.0:1786015280.929873:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 614 00000100:00100000:3.0:1786015280.944494:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015280.944609:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280326784 00000100:00100000:2.0:1786015280.944939:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280326784 00000100:00100000:2.0:1786015280.945009:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 615 00000100:00100000:2.0:1786015280.945020:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+29:19850:x1872772280326784:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1786015280.945176:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+29:19850:x1872772280326784:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 157us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015280.945185:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 615 00000100:00100000:2.0:1786015280.960428:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015280.961011:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280326912 00000100:00100000:1.0:1786015280.961022:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280326912 00000100:00100000:2.0:1786015280.961612:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:2.0:1786015280.961637:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+29:2353:x1872772280326912:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015280.961656:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015280.961683:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffd6c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ed9 expref: 29 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015280.961702:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:2.0:1786015280.961707:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015280.961960:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+28:2353:x1872772280326912:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 328us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015280.961969:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:1.0:1786015280.965056:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015280.977576:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015280.977880:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280327296 00000100:00100000:2.0:1786015280.977892:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280327296 00010000:00010000:2.0:1786015280.977940:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffc31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e62 expref: 28 pid: 5795 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015280.977989:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 180 00000100:00100000:2.0:1786015280.978001:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+28:2354:x1872772280327296:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015280.978023:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015280.978048:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffc31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e62 expref: 28 pid: 5795 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015280.978063:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffc31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e62 expref: 28 pid: 5795 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015280.978092:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffc31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7e62 expref: 28 pid: 5795 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015280.978111:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5700) 00010000:00010000:2.0:1786015280.978116:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c4ffd7a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015280.978127:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c4ffd7a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015280.978135:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c4ffd7a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015280.978166:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015280.978230:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+27:2354:x1872772280327296:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 231us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015280.978246:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 180 00010000:00010000:2.0:1786015280.988950:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4ffd81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015280.988968:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4ffd81 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015280.988976:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4ffd81 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015280.989002:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381935800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015280.989007:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4ffd81 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015280.989015:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4ffd81 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015280.989034:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x843a253e (ffff8b7482d4b000) 00010000:00010000:2.0:1786015280.989037:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015280.989043:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4ffd81 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015280.989049:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4ffd81 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015280.996804:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015281.001233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:2.0:1786015281.005074:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786015281.005939:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015281.012690:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:0.0:1786015281.013108:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c4ffdc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015281.013135:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c4ffdc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015281.013221:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c4ffdb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015281.013228:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c4ffdb9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015281.013235:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c4ffdb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015281.013241:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381935600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015281.013246:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c4ffdb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015281.013253:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c4ffdb9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015281.013265:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8b7482d4b600) 00010000:00010000:0.0:1786015281.013268:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015281.013273:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c4ffdb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015281.013279:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c4ffdb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015281.013292:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c4ffdc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015281.013298:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c4ffdc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015281.013311:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c4ffdc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015281.013317:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381934800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015281.013319:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c4ffdc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015281.013326:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c4ffdc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015281.013334:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff8b7482d4b100) 00010000:00010000:0.0:1786015281.013336:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015281.013339:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c4ffdc0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015281.013345:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c4ffdc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015281.013384:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c4ffdb2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7eee expref: 65 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015281.013396:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8b7482d4b600) 00010000:00010000:0.0:1786015281.013398:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015281.013402:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c4ffdb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7eee expref: 65 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015281.013411:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7381935e00, rc 0) 00000100:00100000:0.0:1786015281.013483:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+64:19853:x1872772280327680:12345-192.168.202.56@tcp:101:bash.0 Request processed in 555us (803us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015281.013499:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 619 00000100:00100000:2.0:1786015281.030310:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015281.030429:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280327808 00000100:00100000:3.0:1786015281.030441:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280327808 00000100:00100000:3.0:1786015281.030511:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 620 00000100:00100000:3.0:1786015281.030523:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+27:19854:x1872772280327808:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015281.030558:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015281.030581:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffdc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7ef5 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.030665:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c4ffdce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.030680:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c4ffdce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.030693:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c4ffdce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015281.030806:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1786015281.030810:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 16 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015281.030865:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c4ffdce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.030891:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4ffdc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ef5 expref: 29 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.030920:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c4ffdce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ef5 expref: 28 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.030929:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7482d4b500) 00010000:00010000:3.0:1786015281.030932:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015281.030936:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb000, rc 0) 00000100:00100000:3.0:1786015281.031045:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+28:19854:x1872772280327808:12345-192.168.202.56@tcp:101:rm.0 Request processed in 523us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015281.031052:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 620 00000100:00100000:3.0:1786015281.039105:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015281.039496:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280327936 00000100:00100000:1.0:1786015281.039515:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280327936 00000100:00100000:1.0:1786015281.039607:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 621 00000100:00100000:1.0:1786015281.039628:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+28:19854:x1872772280327936:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:1.0:1786015281.039661:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015281.039696:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c4ffdd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7efc expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040018:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffddc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040043:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffddc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040058:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffddc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040085:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffde3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040093:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffde3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040114:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffde3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040243:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffdea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040252:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffdea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040260:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffdea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015281.040302:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x26:0x0]: returning size 512 00000004:00200000:2.0:1786015281.040306:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015281.040332:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffdea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040347:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffddc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040353:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffddc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040360:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffddc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040367:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a0400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015281.040372:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffddc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040379:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffddc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040399:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7482d4b500) 00010000:00010000:2.0:1786015281.040403:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015281.040408:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffddc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040415:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffddc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040429:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffde3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040436:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffde3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040441:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffde3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040447:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015281.040450:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffde3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040456:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffde3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040463:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x843a253e (ffff8b749232d900) 00010000:00010000:2.0:1786015281.040465:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015281.040468:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffde3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040474:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffde3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040540:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c4ffdd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7efc expref: 30 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040560:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0a00/0xb1a5ef690c4ffdea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7efc expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.040569:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8b7482d4b600) 00010000:00010000:2.0:1786015281.040572:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786015281.040574:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a0a00, rc 0) 00000100:00100000:2.0:1786015281.040707:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+29:19854:x1872772280327936:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1088us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015281.040716:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 621 00000100:00100000:2.0:1786015281.049547:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015281.049670:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280328064 00000100:00100000:1.0:1786015281.049684:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280328064 00000100:00100000:1.0:1786015281.049758:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 622 00000100:00100000:1.0:1786015281.049907:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+29:19854:x1872772280328064:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:1.0:1786015281.049931:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015281.049956:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c4ffdf1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f03 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050030:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffdf8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050046:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffdf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050059:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffdf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050073:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf000/0xb1a5ef690c4ffdff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050080:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf000/0xb1a5ef690c4ffdff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050086:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf000/0xb1a5ef690c4ffdff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050145:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffdf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050151:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffdf8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050172:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffdf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050177:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bfa00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015281.050182:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffdf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050190:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffdf8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050201:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8b7482d4b600) 00010000:00010000:1.0:1786015281.050204:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015281.050208:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffdf8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050214:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffdf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050226:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf000/0xb1a5ef690c4ffdff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050232:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf000/0xb1a5ef690c4ffdff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050237:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf000/0xb1a5ef690c4ffdff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050242:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015281.050246:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf000/0xb1a5ef690c4ffdff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050259:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf000/0xb1a5ef690c4ffdff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050267:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff8b748966e200) 00010000:00010000:1.0:1786015281.050269:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015281.050271:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf000/0xb1a5ef690c4ffdff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050276:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf000/0xb1a5ef690c4ffdff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050307:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c4ffdf1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f03 expref: 30 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050317:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8b7482d4b600) 00010000:00010000:1.0:1786015281.050319:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015281.050322:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c4ffdf1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f03 expref: 30 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.050331:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf600, rc 0) 00000100:00100000:1.0:1786015281.050413:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+29:19854:x1872772280328064:12345-192.168.202.56@tcp:101:rm.0 Request processed in 516us (884us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015281.060474:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 622 00000100:00100000:0.0:1786015281.061330:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015281.061410:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280328192 00000100:00100000:2.0:1786015281.061422:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280328192 00000100:00100000:2.0:1786015281.061486:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 623 00000100:00100000:2.0:1786015281.061496:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+29:19854:x1872772280328192:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015281.061522:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015281.061560:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffe06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f0a expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.061652:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe0d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.061668:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.061697:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.061718:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.061726:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.061733:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.061842:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.061849:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe0d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.061856:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.061862:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a0400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015281.061866:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.061874:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe0d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.061887:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8b7482d4b600) 00010000:00010000:2.0:1786015281.061890:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015281.061895:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.062063:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.062078:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.062084:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.062090:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.062095:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015281.062099:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.062104:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.062113:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff8b749232d900) 00010000:00010000:2.0:1786015281.062115:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015281.062118:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.062125:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.062161:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffe06 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f0a expref: 30 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.062183:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8b7482d4b600) 00010000:00010000:2.0:1786015281.062186:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015281.062190:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffe06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f0a expref: 30 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.062200:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1600, rc 0) 00000100:00100000:2.0:1786015281.062279:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+29:19854:x1872772280328192:12345-192.168.202.56@tcp:101:rm.0 Request processed in 785us (952us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015281.062287:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 623 00000100:00100000:0.0:1786015281.087604:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015281.087701:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280328320 00000100:00100000:2.0:1786015281.087722:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280328320 00000100:00100000:2.0:1786015281.087815:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 624 00000100:00100000:2.0:1786015281.087826:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+29:19855:x1872772280328320:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015281.087848:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015281.087871:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffe1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f11 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.087955:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.087969:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.087981:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.087996:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.088017:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.088025:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.088094:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.088102:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe22 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.088108:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.088115:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015281.088119:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.088127:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.088140:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8b7482d4b600) 00010000:00010000:2.0:1786015281.088143:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015281.088148:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.088153:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.088165:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.088177:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.088184:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.088188:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a0400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015281.088192:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.088198:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.088206:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff8b749232d900) 00010000:00010000:2.0:1786015281.088208:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015281.088211:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.088217:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.088254:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffe1b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f11 expref: 30 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.088263:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8b7482d4b600) 00010000:00010000:2.0:1786015281.088265:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015281.088268:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffe1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f11 expref: 30 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.088286:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1600, rc 0) 00000100:00100000:2.0:1786015281.088342:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+29:19855:x1872772280328320:12345-192.168.202.56@tcp:101:cp.0 Request processed in 518us (755us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015281.088352:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 624 00000100:00100000:3.0:1786015281.109288:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015281.109391:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280328448 00000100:00100000:2.0:1786015281.109402:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280328448 00000100:00100000:2.0:1786015281.109467:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 625 00000100:00100000:2.0:1786015281.109478:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+29:19855:x1872772280328448:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015281.109501:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015281.109525:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffe30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f18 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109616:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe37 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109641:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109653:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109669:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109676:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109683:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109816:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109824:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe37 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109831:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109837:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a0400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015281.109841:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109849:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe37 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109862:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8b7482d4b600) 00010000:00010000:2.0:1786015281.109865:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015281.109870:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109875:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4ffe37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109888:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109894:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109900:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109915:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015281.109918:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109925:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109933:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff8b749232d900) 00010000:00010000:2.0:1786015281.109936:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015281.109938:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe3e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.109944:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4ffe3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.110549:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffe30 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f18 expref: 30 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.110562:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8b7482d4b600) 00010000:00010000:2.0:1786015281.110565:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015281.110569:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1600/0xb1a5ef690c4ffe30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f18 expref: 30 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.110579:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1600, rc 0) 00000100:00100000:2.0:1786015281.110666:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+29:19855:x1872772280328448:12345-192.168.202.56@tcp:101:cp.0 Request processed in 1189us (1387us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015281.110675:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 625 00000100:00100000:0.0:1786015281.113431:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015281.113522:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280328704 00000100:00100000:2.0:1786015281.113558:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280328704 00000100:00100000:3.0:1786015281.113725:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 626 00000100:00100000:3.0:1786015281.113741:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+29:19855:x1872772280328704:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015281.113810:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015281.113843:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffe45 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f1f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.114017:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe4c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.114032:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.114060:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.114079:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.114086:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.114093:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786015281.114888:0:5796:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xd:0x0], index 0: 0 00010000:00010000:3.0:1786015281.115074:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffe5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.115085:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffe5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.115095:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffe5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.115130:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.115137:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe4c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.115144:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.115150:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819ba400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015281.115160:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.115168:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe4c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.115182:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8b7482d4b600) 00010000:00010000:3.0:1786015281.115186:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015281.115191:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe4c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.115198:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe4c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015281.115212:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007201ae6c reply state 00000000abf73f0a transno 4294967717 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015281.115221:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786015281.115256:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffe45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f1f expref: 32 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.115270:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffe5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f1f expref: 31 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.115277:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:3.0:1786015281.115279:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015281.115282:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819ba200, rc 0) 00000100:00100000:3.0:1786015281.115354:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+32:19855:x1872772280328704:12345-192.168.202.56@tcp:101:cp.0 Request processed in 1618us (1933us total) trans 4294967717 rc 0/0 00000100:00100000:3.0:1786015281.115362:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 626 00010000:00010000:2.0:1786015281.122678:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.122701:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.122709:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.122715:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015281.122720:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.122728:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.122751:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff8b74a04b5a00) 00010000:00010000:2.0:1786015281.122754:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015281.122786:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.122792:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015281.143582:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015281.143680:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280328832 00000100:00100000:1.0:1786015281.143694:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280328832 00000100:00100000:1.0:1786015281.143794:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 158 00000100:00100000:1.0:1786015281.143805:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+7:2353:x1872772280328832:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015281.143842:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015281.143866:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c4ffe68 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f26 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015281.143894:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786015281.143925:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=516s v=(0 0) 00010000:00010000:1.0:1786015281.143931:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015281.143942:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c4ffe68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f26 expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.143958:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c4ffe68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f26 expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.143972:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf600, rc 0) 00000100:00100000:1.0:1786015281.144032:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280328832:12345-192.168.202.56@tcp:101:cp.0 Request processed in 229us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015281.144039:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 158 00000100:00080000:2.0:1786015281.144121:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015281.157194:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015281.157298:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280328960 00000100:00100000:2.0:1786015281.157307:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280328960 00000100:00100000:2.0:1786015281.157370:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 159 00000100:00100000:2.0:1786015281.157381:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:19855:x1872772280328960:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015281.157402:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015281.157439:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec18bc08/0xb1a5ef690c4ffe6f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f2d expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.157473:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c4ffe68 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f26 expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.157482:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015281.157486:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015281.157491:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec18bc08/0xb1a5ef690c4ffe6f lrc: 4/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f2d expref: 9 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.157524:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c4ffe68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f26 expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.157550:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c4ffe68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f26 expref: 9 pid: 6590 timeout: 616 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015281.157566:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304334848:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015281.157667:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b749306cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1786015281.166328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015281.166414:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280329088 00000100:00100000:3.0:1786015281.166423:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280329088 00010000:00010000:3.0:1786015281.166460:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c4ffe68 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f26 expref: 10 pid: 6590 timeout: 616 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015281.166506:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 181 00000100:00100000:3.0:1786015281.166515:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280329088:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015281.166538:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015281.166563:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c4ffe68 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f26 expref: 10 pid: 6590 timeout: 616 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.166578:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c4ffe68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f26 expref: 10 pid: 6590 timeout: 616 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.166604:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015281.166608:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015281.166616:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec18bc08/0xb1a5ef690c4ffe6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f2d expref: 10 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.166627:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec18bc08/0xb1a5ef690c4ffe6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f2d expref: 10 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.166672:0:6607:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ec18bc08/0xb1a5ef690c4ffe6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f2d expref: 10 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015281.166688:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304334976:192.168.202.56@tcp:105: 00000100:00100000:3.0:1786015281.166822:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7485a7ca80 going to sleep for 11 seconds 00010000:00010000:2.0:1786015281.166927:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c4ffe68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f26 expref: 10 pid: 6590 timeout: 616 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015281.166944:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304334848:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015281.166972:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec18bc08/0xb1a5ef690c4ffe6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f2d expref: 9 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015281.166995:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1600, rc 0) 00000100:00100000:2.0:1786015281.167025:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:19855:x1872772280328960:12345-192.168.202.56@tcp:101:cp.0 Request processed in 9646us (9841us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015281.167032:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 159 00000100:00100000:0.0:1786015281.174153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015281.174218:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280329344 00000100:00100000:2.0:1786015281.174228:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280329344 00000100:00100000:2.0:1786015281.174303:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 130 00000100:00100000:2.0:1786015281.174313:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+31:19855:x1872772280329344:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:2.0:1786015281.174729:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+32:19855:x1872772280329344:12345-192.168.202.56@tcp:35:cp.0 Request processed in 417us (585us total) trans 4294967718 rc 0/0 00000100:00100000:2.0:1786015281.174738:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 130 00000100:00100000:3.0:1786015281.175550:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304334976:192.168.202.56@tcp:105: 00010000:00010000:3.0:1786015281.175578:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015281.175620:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280329088:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 9105us (9302us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015281.175630:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 181 00000100:00100000:0.0:1786015281.232308:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015281.232436:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280329600 00000100:00100000:3.0:1786015281.232447:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280329600 00000100:00100000:3.0:1786015281.232566:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 627 00000100:00100000:3.0:1786015281.232578:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+64:19858:x1872772280329600:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015281.232617:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015281.232643:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffe76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f34 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.232745:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe7d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.232813:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.232828:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.232848:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffe84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.232855:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffe84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.232882:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffe84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.233041:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffe8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.233050:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffe8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.233058:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffe8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015281.233069:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x10:0x0]: returning size 158 00010000:00010000:3.0:1786015281.233184:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.233192:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe7d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.233197:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.233203:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819ba400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015281.233207:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.233215:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe7d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.233227:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8b7482d4b600) 00010000:00010000:3.0:1786015281.233230:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015281.233241:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.233247:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffe7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.233260:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffe84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.233265:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffe84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.233271:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffe84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.233277:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bac00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015281.233280:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffe84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.233285:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffe84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.233293:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff8b74a04b5f00) 00010000:00010000:3.0:1786015281.233295:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015281.233298:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffe84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.233304:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffe84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.233344:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffe76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f34 expref: 67 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.233369:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffe8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f34 expref: 66 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.233378:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:3.0:1786015281.233380:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015281.233382:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819baa00, rc 0) 00000100:00100000:3.0:1786015281.233453:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+66:19858:x1872772280329600:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 876us (1157us total) trans 4294967719 rc 0/0 00000100:00100000:3.0:1786015281.233461:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 627 00000100:00100000:1.0:1786015281.240213:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015281.250138:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280329856 00000100:00100000:2.0:1786015281.250159:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280329856 00000100:00100000:3.0:1786015281.250406:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 628 00000100:00100000:3.0:1786015281.250418:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+66:19858:x1872772280329856:12345-192.168.202.56@tcp:55:lfs.0 00010000:00010000:3.0:1786015281.250499:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe99 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.250516:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffe5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f1f expref: 31 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.250540:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffe8b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f34 expref: 66 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.250549:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe99 lrc: 5/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.250700:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffe8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f34 expref: 66 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.250738:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffe8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f34 expref: 66 pid: 12526 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015281.250757:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304335104:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015281.251125:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffe5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f1f expref: 31 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.251146:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffe5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f1f expref: 31 pid: 5796 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015281.251163:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304335232:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015281.251194:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482d789c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015281.266614:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015281.266662:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015281.266832:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280330112 00000100:00100000:3.0:1786015281.266852:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280330112 00010000:00010000:3.0:1786015281.266919:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffe5a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f1f expref: 32 pid: 5796 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015281.266931:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304335104:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015281.266952:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304335232:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015281.266975:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280329984 00000100:00100000:3.0:1786015281.266982:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280329984 00010000:00010000:1.0:1786015281.266997:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe99 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.267005:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffe8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f34 expref: 67 pid: 12526 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015281.267047:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 182 00000100:00100000:3.0:1786015281.267061:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+32:2354:x1872772280330112:12345-192.168.202.56@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1786015281.267075:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 183 00010000:00010000:3.0:1786015281.267078:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015281.267090:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffe5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f1f expref: 32 pid: 5796 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015281.267096:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+67:2354:x1872772280329984:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015281.267124:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffe5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f1f expref: 32 pid: 5796 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.267124:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015281.267140:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffe8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f34 expref: 67 pid: 12526 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.267160:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffe5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f1f expref: 32 pid: 5796 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.267166:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffe8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f34 expref: 67 pid: 12526 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.267204:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4ffe8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f34 expref: 67 pid: 12526 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.267223:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:3.0:1786015281.267231:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe99 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.267241:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.267249:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe99 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.268913:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:1.0:1786015281.268930:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015281.269051:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+66:2354:x1872772280329984:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1960us (2382us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015281.269064:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 183 00010000:00010000:3.0:1786015281.273345:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015281.273395:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.273418:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015281.273451:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+31:2354:x1872772280330112:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 6384us (6847us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015281.273485:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 182 00010000:00010000:1.0:1786015281.277199:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.277231:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe99 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.277240:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe99 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.277247:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015281.277253:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe99 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.277265:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe99 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.277288:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:1.0:1786015281.277293:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1786015281.277298:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe99 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.277306:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4ffe99 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015281.277484:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+66:19858:x1872772280329856:12345-192.168.202.56@tcp:55:lfs.0 Request processed in 27060us (37283us total) trans 4294967720 rc 0/0 00000100:00100000:1.0:1786015281.277498:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 628 00000100:00100000:2.0:1786015281.285855:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015281.285991:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280330368 00000100:00100000:1.0:1786015281.286023:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280330368 00000100:00100000:1.0:1786015281.286119:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 131 00000100:00100000:1.0:1786015281.286156:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7487301c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+66:19858:x1872772280330368:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:1.0:1786015281.286566:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7487301c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+67:19858:x1872772280330368:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 412us (727us total) trans 4294967721 rc 0/0 00000100:00100000:1.0:1786015281.286576:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 131 00000100:00100000:2.0:1786015281.321854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015281.322113:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280330496 00000100:00100000:3.0:1786015281.322134:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280330496 00000100:00100000:3.0:1786015281.322261:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 629 00000100:00100000:3.0:1786015281.322272:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+67:19859:x1872772280330496:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015281.322307:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015281.322331:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffea0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f3b expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.322397:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffea7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.322411:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffea7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.322444:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffea7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.322460:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffeae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.322467:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffeae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.322473:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffeae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.322603:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffeb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.322611:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffeb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.322618:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffeb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015281.322657:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x10:0x0]: returning size 158 00000004:00200000:3.0:1786015281.322661:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015281.322683:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffeb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.322703:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffeb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.322712:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffea7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.322733:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffea7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.322741:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffea7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.322747:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bbc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015281.322755:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffea7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.323252:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffea7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.323274:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8b7482d4b600) 00010000:00010000:3.0:1786015281.323278:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015281.323283:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffea7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.323289:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4ffea7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.323306:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffeae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.323312:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffeae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.323318:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffeae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.323323:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bac00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015281.323334:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffeae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.323340:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffeae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.323348:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff8b74a04b5f00) 00010000:00010000:3.0:1786015281.323350:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015281.323354:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffeae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.323359:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4ffeae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.323414:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4ffea0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f3b expref: 69 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.323436:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba400/0xb1a5ef690c4ffeb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f3b expref: 68 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.323444:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8b74a04b5d00) 00010000:00010000:3.0:1786015281.323446:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015281.323449:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819ba400, rc 0) 00000100:00100000:1.0:1786015281.326040:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304335360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015281.326299:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015281.326476:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304335360 00000100:00100000:1.0:1786015281.326489:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304335360 00000100:00100000:0.0:1786015281.328077:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+68:19859:x1872772280330496:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 4297us (4738us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015281.328091:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 629 00000100:00100000:2.0:1786015281.345713:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1786015281.345749:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304335360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015281.345868:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 56164352 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015281.354130:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304335360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8381us (27814us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015281.354153:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1786015281.354269:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304335360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015281.355586:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015281.360429:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280330624 00000100:00100000:3.0:1786015281.360445:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280330624 00000100:00100000:0.0:1786015281.360684:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 160 00000100:00100000:0.0:1786015281.360693:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+10:2352:x1872772280330624:12345-192.168.202.56@tcp:101:lfs.0 00000100:00080000:3.0:1786015281.361128:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786015281.361785:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015281.361804:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000571e83d5/0xb1a5ef690c4ffebc lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f42 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015281.361864:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304335488:192.168.202.56@tcp:106: 00000100:00100000:0.0:1786015281.362141:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7490fa2e40 going to sleep for 11 seconds 00002000:00010000:1.0:1786015281.370657:0:6591:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1786015281.370665:0:6591:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb mtime: 0 -> 1786015281 00002000:00010000:1.0:1786015281.370669:0:6591:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb atime: 0 -> 1786015281 00002000:00010000:1.0:1786015281.370671:0:6591:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb ctime: 0 -> 1786015281 00000100:00100000:1.0:1786015281.370698:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304335488:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015281.370744:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000571e83d5/0xb1a5ef690c4ffebc lrc: 1/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f42 expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.370789:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000571e83d5/0xb1a5ef690c4ffebc lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f42 expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.370802:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7381935400, rc 0) 00000100:00100000:1.0:1786015281.370874:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+10:2352:x1872772280330624:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 10180us (15298us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015281.370885:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 160 00000100:00100000:1.0:1786015281.384899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015281.384934:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280330752 00000100:00100000:1.0:1786015281.384943:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280330752 00000100:00100000:1.0:1786015281.385266:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 630 00000100:00100000:1.0:1786015281.385286:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+68:19859:x1872772280330752:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015281.385313:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015281.385336:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffec3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f49 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.385404:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf000/0xb1a5ef690c4ffeca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.385418:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf000/0xb1a5ef690c4ffeca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.385429:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf000/0xb1a5ef690c4ffeca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015281.385607:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x26:0x0]: returning size 7680 00000004:00200000:1.0:1786015281.385611:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015281.385688:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf000/0xb1a5ef690c4ffeca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.386096:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffec3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f49 expref: 70 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.386111:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf000/0xb1a5ef690c4ffeca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f49 expref: 69 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015281.386118:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8b7482d4b600) 00010000:00010000:1.0:1786015281.386120:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015281.386122:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf000, rc 0) 00000100:00100000:1.0:1786015281.386182:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+69:19859:x1872772280330752:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 907us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015281.386193:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 630 00000100:00100000:1.0:1786015281.391301:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015281.391891:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280330880 00000100:00100000:2.0:1786015281.391902:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280330880 00000100:00100000:2.0:1786015281.391963:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 161 00000100:00100000:2.0:1786015281.391973:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+10:2351:x1872772280330880:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015281.391993:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015281.392013:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edba2191/0xb1a5ef690c4ffed1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f50 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015281.392075:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304335616:192.168.202.56@tcp:106: 00000100:00100000:2.0:1786015281.392943:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b749306cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1786015281.395429:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304335616:192.168.202.56@tcp:106: 00010000:00010000:3.0:1786015281.395470:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000edba2191/0xb1a5ef690c4ffed1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f50 expref: 11 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.395518:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edba2191/0xb1a5ef690c4ffed1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f50 expref: 11 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015281.395539:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1a00, rc 0) 00000100:00100000:3.0:1786015281.395602:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+10:2351:x1872772280330880:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3630us (4312us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015281.395610:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 161 00000100:00100000:3.0:1786015281.400472:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015281.400567:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280331136 00000100:00100000:0.0:1786015281.400578:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280331136 00000100:00100000:0.0:1786015281.400644:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 631 00000100:00100000:0.0:1786015281.400655:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+69:19859:x1872772280331136:12345-192.168.202.56@tcp:58:lfs.0 00000100:00100000:0.0:1786015281.400852:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+69:19859:x1872772280331136:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 198us (388us total) trans 0 rc -1/-1 00000100:00100000:0.0:1786015281.400860:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 631 00000001:00080000:0.0:1786015281.403114:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967716 is committed 00000001:00080000:0.0:1786015281.403135:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967721 is committed 00000001:00080000:0.0:1786015281.403145:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967715 is committed 00000001:00080000:0.0:1786015281.403151:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967718 is committed 00000040:00080000:1.0:1786015281.708172:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015281.708184:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015281.708735:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1786015281.708747:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786015282.028986:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015283.052987:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015284.076290:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015284.290471:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015284.290533:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015284.290566:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015284.290585:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015284.290604:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015284.291442:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015284.291475:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015284.291523:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280331520 00000100:00100000:1.0:1786015284.291533:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280331520 00000100:00100000:1.0:1786015284.291591:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280332032 00000100:00100000:1.0:1786015284.291594:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280332032 00000100:00100000:1.0:1786015284.291606:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280331648 00000100:00100000:1.0:1786015284.291608:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280331648 00000100:00100000:1.0:1786015284.291631:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280331904 00000100:00100000:1.0:1786015284.291634:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280331904 00000100:00100000:1.0:1786015284.291650:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 240 00000100:00100000:2.0:1786015284.291954:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280331264 00000100:00100000:2.0:1786015284.291959:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280331264 00000100:00100000:2.0:1786015284.291997:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 353 00000100:00100000:2.0:1786015284.292006:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280331264:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015284.292097:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280331264:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 92us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015284.292105:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 353 00000100:00100000:1.0:1786015284.292992:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280331520:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015284.293059:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280331520:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 78us (2525us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015284.293067:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 240 00000100:00100000:1.0:1786015284.293098:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 241 00000100:00100000:1.0:1786015284.293123:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280332032:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015284.293153:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280332032:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (2568us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015284.293159:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 241 00000100:00100000:1.0:1786015284.293171:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 242 00000100:00100000:1.0:1786015284.293177:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+9:2353:x1872772280331648:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015284.293204:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+9:2353:x1872772280331648:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (1767us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015284.293211:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 242 00000100:00100000:1.0:1786015284.293223:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 243 00000100:00100000:1.0:1786015284.293229:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280331904:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015284.293269:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280331904:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 39us (1792us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015284.293275:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 243 00000100:00100000:1.0:1786015284.293302:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280331776 00000100:00100000:1.0:1786015284.293309:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280331776 00000100:00100000:1.0:1786015284.293348:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280331392 00000100:00100000:1.0:1786015284.293351:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280331392 00000100:00100000:1.0:1786015284.293373:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 291 00000100:00100000:1.0:1786015284.293379:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+27:2353:x1872772280331776:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015284.293413:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+27:2353:x1872772280331776:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (2846us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015284.293420:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 291 00000100:00100000:1.0:1786015284.293431:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 292 00000100:00100000:1.0:1786015284.293446:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+65:2353:x1872772280331392:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015284.293472:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+65:2353:x1872772280331392:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (2866us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015284.293477:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 292 00000100:00080000:1.0:1786015284.293521:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015284.293619:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015284.293622:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015284.396217:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304335744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015284.396332:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015284.396719:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304335744 00000100:00100000:0.0:1786015284.396731:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304335744 00000100:00100000:0.0:1786015284.396851:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1786015284.396863:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304335744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015284.396915:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015284.396988:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304335744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015284.396997:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1786015284.397064:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304335744:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786015284.397253:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1786015284.781679:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015284.781695:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015284.782325:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 14 count 1 00000040:00080000:0.0:1786015284.782338:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786015285.100756:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015285.938025:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304335872:0@lo:400:kworker.0 00000100:00100000:2.0:1786015285.938119:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015285.941181:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304336000:0@lo:400:kworker.0 00000100:00100000:1.0:1786015285.941269:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015285.941323:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015285.941330:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304336128:0@lo:400:kworker.0 00000100:00100000:1.0:1786015285.941353:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015285.941396:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304335872 00000100:00100000:1.0:1786015285.941410:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304335872 00000100:00100000:1.0:1786015285.941474:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1786015285.941494:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304335872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015285.942553:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304336256:0@lo:400:kworker.0 00000100:00100000:3.0:1786015285.942607:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015285.942652:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786015285.942658:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304336384:0@lo:400:kworker.0 00000100:00100000:3.0:1786015285.942686:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015285.947755:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304335872:12345-0@lo:400:kworker.0 Request processed in 6261us (9624us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015285.947802:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1786015285.947883:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304336000 00000100:00100000:1.0:1786015285.947895:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304336000 00000100:00100000:1.0:1786015285.947953:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304336128 00000100:00100000:1.0:1786015285.947958:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304336128 00000100:00100000:1.0:1786015285.947991:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304336384 00000100:00100000:1.0:1786015285.948002:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304336384 00000100:00100000:1.0:1786015285.948028:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1786015285.948037:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304336000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015285.948121:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304336000:12345-0@lo:400:kworker.0 Request processed in 85us (6851us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015285.948127:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1786015285.948141:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1786015285.948147:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304336128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015285.948175:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304336128:12345-0@lo:400:kworker.0 Request processed in 30us (6821us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015285.948181:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1786015285.948193:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1786015285.948199:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304336384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015285.948237:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304336384:12345-0@lo:400:kworker.0 Request processed in 38us (5550us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015285.948243:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1786015285.948270:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304336256 00000100:00100000:1.0:1786015285.948274:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304336256 00000100:00100000:1.0:1786015285.948299:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1786015285.948305:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304336256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015285.948337:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304336256:12345-0@lo:400:kworker.0 Request processed in 33us (5730us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015285.948343:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1786015285.948361:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015285.948404:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304336384:0@lo:400:kworker.0 00000100:00100000:1.0:1786015285.948419:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304336256:0@lo:400:kworker.0 00000100:00100000:1.0:1786015285.948472:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304336512:0@lo:400:kworker.0 00000100:00100000:1.0:1786015285.948519:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015285.948553:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304336128:0@lo:400:kworker.0 00000100:00100000:1.0:1786015285.948565:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304336000:0@lo:400:kworker.0 00000100:00100000:1.0:1786015285.948589:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304336512 00000100:00100000:1.0:1786015285.948592:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304336512 00000100:00100000:1.0:1786015285.948617:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1786015285.948622:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304336512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015285.948660:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304336512:12345-0@lo:400:kworker.0 Request processed in 37us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015285.948666:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1786015285.948680:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015285.948696:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304336512:0@lo:400:kworker.0 00000100:00100000:2.0:1786015285.949337:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304335872:0@lo:400:kworker.0 00010000:00010000:2.0:1786015286.128780:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015286.444803:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304336640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015286.444879:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015286.444953:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304336640 00000100:00100000:0.0:1786015286.444961:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304336640 00000100:00100000:0.0:1786015286.445010:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1786015286.445020:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304336640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015286.445070:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 56164352 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015286.445115:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304336640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015286.445123:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1786015286.445173:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304336640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015286.514412:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015286.514886:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280332160 00000100:00100000:3.0:1786015286.514898:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280332160 00000100:00100000:3.0:1786015286.514972:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 632 00000100:00100000:3.0:1786015286.514983:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+27:19850:x1872772280332160:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1786015286.515098:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+27:19850:x1872772280332160:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 118us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015286.515106:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 632 00000100:00080000:1.0:1786015286.516407:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015286.541703:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015286.541928:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280332416 00000100:00100000:1.0:1786015286.541938:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280332416 00000100:00100000:1.0:1786015286.542020:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 132 00000100:00100000:1.0:1786015286.542031:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+27:19850:x1872772280332416:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015286.542599:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+28:19850:x1872772280332416:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 567us (911us total) trans 4294967722 rc 0/0 00000100:00100000:1.0:1786015286.542607:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 132 00010000:00010000:1.0:1786015287.149136:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015288.179748:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786015288.299370:0:16080:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 10d: Archive a file on the default archive id ========================================================== 07:21:27 (1786015287) 00000100:00100000:3.0:1786015288.595665:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015288.595946:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280332672 00000100:00100000:1.0:1786015288.595972:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280332672 00000100:00100000:1.0:1786015288.596075:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 633 00000100:00100000:1.0:1786015288.596086:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+28:20461:x1872772280332672:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015288.596118:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015288.596144:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c4ffed8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f57 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.596231:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffedf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.596247:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffedf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.596260:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffedf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.596274:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c4ffee6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.596281:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c4ffee6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.596287:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c4ffee6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.596810:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c4ffeed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.596821:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c4ffeed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.596830:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c4ffeed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015288.596848:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1786015288.596997:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffedf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.597005:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffedf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.597012:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffedf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.597018:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bfa00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015288.597022:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffedf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.597029:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffedf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.597042:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b749802e100) 00010000:00010000:1.0:1786015288.597046:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015288.597051:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffedf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.597057:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4ffedf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.597069:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c4ffee6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.597074:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c4ffee6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.597089:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c4ffee6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.597094:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bec00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015288.597097:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c4ffee6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.597103:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c4ffee6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.597112:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8b7483ee6e00) 00010000:00010000:1.0:1786015288.597114:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015288.597117:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c4ffee6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.597123:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c4ffee6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.597486:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c4ffed8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f57 expref: 31 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.597502:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c4ffeed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f57 expref: 30 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.597509:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:1.0:1786015288.597512:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015288.597514:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bfc00, rc 0) 00000100:00100000:1.0:1786015288.597581:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+30:20461:x1872772280332672:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1496us (1939us total) trans 4294967723 rc 0/0 00000100:00100000:1.0:1786015288.597597:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 633 00000100:00080000:2.0:1786015288.598163:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015288.604113:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015288.604167:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015288.604256:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280332800 00000100:00100000:3.0:1786015288.604280:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280332800 00000100:00100000:3.0:1786015288.604344:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 634 00000100:00100000:3.0:1786015288.604355:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+30:20461:x1872772280332800:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1786015288.604495:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+30:20461:x1872772280332800:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 142us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015288.604503:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 634 00000100:00100000:0.0:1786015288.604819:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280332928 00000100:00100000:0.0:1786015288.604825:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280332928 00000100:00100000:0.0:1786015288.604865:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:0.0:1786015288.604872:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+30:2351:x1872772280332928:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015288.604885:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015288.604913:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c4ffeed lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f57 expref: 30 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015288.604934:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:0.0:1786015288.604940:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015288.604970:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+29:2351:x1872772280332928:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 98us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015288.604977:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:1.0:1786015288.620405:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015288.620497:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280333056 00000100:00100000:0.0:1786015288.620512:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280333056 00000100:00100000:0.0:1786015288.620593:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 635 00000100:00100000:0.0:1786015288.620602:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+65:20462:x1872772280333056:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015288.620622:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015288.620642:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935400/0xb1a5ef690c4ffefb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f5e expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015288.620736:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4fff02 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015288.620752:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4fff02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015288.620802:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4fff02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.621050:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4fff09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.621060:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4fff09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.621069:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4fff09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786015288.621271:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786015288.621357:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4fff02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.621365:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4fff02 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.621370:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4fff02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.621376:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381935800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015288.621380:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4fff02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.621387:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4fff02 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.621409:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7482d4b500) 00010000:00010000:3.0:1786015288.621412:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015288.621417:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4fff02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.621422:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c4fff02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.621447:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4fff09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.621454:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4fff09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.621472:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4fff09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.621478:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381935200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015288.621480:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4fff09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.621487:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4fff09 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.621495:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb54fab68 (ffff8b7482d4bf00) 00010000:00010000:3.0:1786015288.621497:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015288.621500:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4fff09 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.621506:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c4fff09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.621556:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935400/0xb1a5ef690c4ffefb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f5e expref: 66 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.621567:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7482d4b500) 00010000:00010000:3.0:1786015288.621569:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015288.621573:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935400/0xb1a5ef690c4ffefb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f5e expref: 66 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.621583:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7381935400, rc 0) 00000100:00100000:3.0:1786015288.621663:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+65:20462:x1872772280333056:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1060us (1274us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015288.621671:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 635 00000100:00100000:0.0:1786015288.632714:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015288.632875:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280333312 00000100:00100000:3.0:1786015288.632892:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280333312 00000100:00100000:3.0:1786015288.632995:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 636 00000100:00100000:3.0:1786015288.633010:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+65:20462:x1872772280333312:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:3.0:1786015288.633074:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015288.633114:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935a00/0xb1a5ef690c4ffd8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ee0 expref: 65 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.633134:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7482d4b500) 00010000:00010000:3.0:1786015288.633138:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015288.633381:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4fff10 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.633392:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c4ffdce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ef5 expref: 28 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.633404:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4fff10 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.633437:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c4ffdce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ef5 expref: 28 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.633450:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c4ffdce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ef5 expref: 28 pid: 12526 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015288.633480:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304336768:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015288.633589:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7381ffb780 going to sleep for 11 seconds 00000100:00100000:0.0:1786015288.637010:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015288.637117:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304336768:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015288.637147:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4fff10 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015288.637224:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280333440 00000100:00100000:1.0:1786015288.637236:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280333440 00010000:00010000:1.0:1786015288.637294:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c4ffdce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ef5 expref: 29 pid: 12526 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015288.637359:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 184 00000100:00100000:1.0:1786015288.637373:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74865a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+29:2354:x1872772280333440:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015288.637394:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015288.637403:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c4ffdce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ef5 expref: 29 pid: 12526 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.637419:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c4ffdce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ef5 expref: 29 pid: 12526 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.637468:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c4ffdce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ef5 expref: 29 pid: 12526 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.637611:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7482d4b500) 00010000:00010000:1.0:1786015288.637619:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4fff10 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.637631:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4fff10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.637688:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4fff10 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.637724:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015288.637859:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74865a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+28:2354:x1872772280333440:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 488us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015288.637870:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 184 00010000:00010000:3.0:1786015288.650750:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4fff10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.650850:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4fff10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.650908:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4fff17 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.650927:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4fff17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.650941:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4fff17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015288.657040:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 512 00010000:00010000:3.0:1786015288.657070:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4fff10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.657083:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4fff10 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.657091:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4fff10 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.657098:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819baa00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015288.657104:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4fff10 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.657113:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4fff10 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.657134:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7482d4b500) 00010000:00010000:3.0:1786015288.657137:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015288.657142:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4fff10 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.657148:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c4fff10 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015288.657174:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006e4b86d5 reply state 00000000a372ff80 transno 4294967724 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4fff17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015288.657186:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015288.657344:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+66:20462:x1872772280333312:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 24332us (24639us total) trans 4294967724 rc 0/0 00000100:00100000:3.0:1786015288.657369:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 636 00010000:00010000:2.0:1786015288.662449:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4fff17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.662510:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4fff17 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.662519:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4fff17 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.662526:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015288.662532:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4fff17 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.662541:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4fff17 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.662572:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb54fab68 (ffff8b74a04b5400) 00010000:00010000:2.0:1786015288.662576:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015288.662582:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4fff17 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.662588:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c4fff17 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015288.677147:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015288.677401:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280333568 00000100:00100000:1.0:1786015288.677414:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280333568 00000100:00100000:1.0:1786015288.677523:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 637 00000100:00100000:1.0:1786015288.677536:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+65:20463:x1872772280333568:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1786015288.677572:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015288.677604:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c4fff1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f65 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.677881:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c4fff25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.677901:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c4fff25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.677917:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c4fff25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015288.678002:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1786015288.678007:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 17 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015288.678042:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c4fff25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.678101:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c4fff1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f65 expref: 67 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.678125:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c4fff25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f65 expref: 66 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.678135:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:1.0:1786015288.678139:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015288.678143:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bec00, rc 0) 00000100:00100000:1.0:1786015288.678354:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+66:20463:x1872772280333568:12345-192.168.202.56@tcp:101:bash.0 Request processed in 821us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015288.678363:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 637 00000100:00100000:0.0:1786015288.686174:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015288.686298:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280333696 00000100:00100000:3.0:1786015288.686313:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280333696 00000100:00100000:3.0:1786015288.686397:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 638 00000100:00100000:3.0:1786015288.686409:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+66:20463:x1872772280333696:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1786015288.686441:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015288.686483:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4fff2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f6c expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.686717:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.686736:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.686750:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.686866:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fff3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.686875:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fff3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.686882:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fff3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.687038:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4fff41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.687069:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4fff41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.687076:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4fff41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015288.687127:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 512 00000004:00200000:3.0:1786015288.687133:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015288.687162:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4fff41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.687176:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.687183:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff33 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.687190:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.687198:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bac00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015288.687203:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.687211:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.687224:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:3.0:1786015288.687227:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015288.687232:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.687249:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.687263:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fff3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.687269:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fff3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.687275:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fff3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.687279:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bbc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015288.687282:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fff3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.687288:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fff3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.687296:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb54fab68 (ffff8b74a04b5f00) 00010000:00010000:3.0:1786015288.687298:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015288.687300:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fff3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.687306:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fff3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.687344:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c4fff2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f6c expref: 68 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.688924:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbe00/0xb1a5ef690c4fff41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f6c expref: 67 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.688958:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:3.0:1786015288.688961:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786015288.688964:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bbe00, rc 0) 00000100:00100000:3.0:1786015288.689062:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+67:20463:x1872772280333696:12345-192.168.202.56@tcp:101:bash.0 Request processed in 2655us (2903us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015288.689070:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 638 00000100:00100000:3.0:1786015288.693867:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015288.696111:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280333824 00000100:00100000:1.0:1786015288.696138:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280333824 00000100:00100000:1.0:1786015288.696276:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 639 00000100:00100000:1.0:1786015288.696290:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+67:20463:x1872772280333824:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1786015288.696320:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015288.696351:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c4fff48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f73 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696454:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696501:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696516:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696568:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696577:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696583:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696748:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696781:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff4f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696790:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696798:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bfa00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015288.696803:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696812:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff4f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696826:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:1.0:1786015288.696829:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015288.696834:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696840:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696862:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696868:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696874:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696882:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813be200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015288.696885:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696891:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696898:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x7fd8c415 (ffff8b7483ee6800) 00010000:00010000:1.0:1786015288.696900:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015288.696903:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696909:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696950:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c4fff48 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f73 expref: 68 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696961:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:1.0:1786015288.696963:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015288.696973:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c4fff48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f73 expref: 68 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.696984:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf200, rc 0) 00000100:00100000:1.0:1786015288.697088:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+67:20463:x1872772280333824:12345-192.168.202.56@tcp:101:bash.0 Request processed in 800us (3234us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015288.697098:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 639 00000100:00100000:0.0:1786015288.720878:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015288.721042:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280333952 00000100:00100000:2.0:1786015288.721054:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280333952 00000100:00100000:2.0:1786015288.721118:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 640 00000100:00100000:2.0:1786015288.721128:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+28:20464:x1872772280333952:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015288.721155:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015288.721181:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4fff5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f7a expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.721277:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4fff64 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.721290:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4fff64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.721302:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4fff64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015288.721375:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1786015288.721378:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 17 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015288.721401:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4fff64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.721423:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4fff5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f7a expref: 30 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.721440:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4fff64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f7a expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.721579:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:2.0:1786015288.721583:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015288.721588:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1e00, rc 0) 00000100:00100000:2.0:1786015288.721843:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+29:20464:x1872772280333952:12345-192.168.202.56@tcp:101:rm.0 Request processed in 716us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015288.721850:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 640 00000100:00100000:0.0:1786015288.734623:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015288.734742:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280334080 00000100:00100000:3.0:1786015288.734756:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280334080 00000100:00100000:3.0:1786015288.734963:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 641 00000100:00100000:3.0:1786015288.734976:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+29:20464:x1872772280334080:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015288.735008:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015288.735038:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fff6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f81 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735128:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735146:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735161:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735180:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4fff79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735186:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4fff79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735213:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4fff79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735375:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bae00/0xb1a5ef690c4fff80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735385:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bae00/0xb1a5ef690c4fff80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735392:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bae00/0xb1a5ef690c4fff80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015288.735435:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 512 00000004:00200000:3.0:1786015288.735439:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015288.735490:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bae00/0xb1a5ef690c4fff80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735507:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735514:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff72 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735521:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735528:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bac00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015288.735533:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735542:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735564:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:3.0:1786015288.735567:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015288.735573:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735580:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fff72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735595:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4fff79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735602:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4fff79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735609:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4fff79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735614:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015288.735617:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4fff79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735622:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4fff79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735630:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb54fab68 (ffff8b74a04b5f00) 00010000:00010000:3.0:1786015288.735632:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015288.735635:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4fff79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735640:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4fff79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735689:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fff6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f81 expref: 31 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735704:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bae00/0xb1a5ef690c4fff80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f81 expref: 30 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.735711:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:3.0:1786015288.735714:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786015288.735716:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bae00, rc 0) 00000100:00100000:3.0:1786015288.735836:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+30:20464:x1872772280334080:12345-192.168.202.56@tcp:101:rm.0 Request processed in 863us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015288.735845:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 641 00000100:00100000:3.0:1786015288.742129:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015288.742241:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280334208 00000100:00100000:1.0:1786015288.742257:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280334208 00000100:00100000:1.0:1786015288.742378:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 642 00000100:00100000:1.0:1786015288.742393:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+30:20464:x1872772280334208:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:1.0:1786015288.742426:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015288.742478:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c4fff87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f88 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742608:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff8e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742627:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742651:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742670:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742677:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742685:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742840:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742849:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff8e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742857:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742864:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813be200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015288.742869:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742878:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff8e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742898:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:1.0:1786015288.742902:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015288.742908:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742914:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fff8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742930:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742936:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742942:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742955:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bfa00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015288.742958:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742965:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742974:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x7fd8c415 (ffff8b7483ee6800) 00010000:00010000:1.0:1786015288.742977:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015288.742980:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.742986:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fff95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.743029:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c4fff87 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f88 expref: 31 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.743041:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:1.0:1786015288.743043:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015288.743047:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c4fff87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f88 expref: 31 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.743057:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf200, rc 0) 00000100:00100000:1.0:1786015288.743135:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+30:20464:x1872772280334208:12345-192.168.202.56@tcp:101:rm.0 Request processed in 747us (1022us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015288.743143:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 642 00000100:00100000:0.0:1786015288.751113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015288.751175:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280334336 00000100:00100000:2.0:1786015288.751188:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280334336 00000100:00100000:2.0:1786015288.751283:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 643 00000100:00100000:2.0:1786015288.751296:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+30:20464:x1872772280334336:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015288.751330:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015288.751364:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4fff9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f8f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751488:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffa3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751506:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751522:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751541:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751560:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751568:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751667:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751676:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffa3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751683:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffa3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751702:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015288.751708:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffa3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751717:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffa3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751732:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:2.0:1786015288.751736:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015288.751741:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffa3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751748:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffa3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751793:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751801:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751807:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751812:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015288.751815:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751821:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751842:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x7fd8c415 (ffff8b749232d900) 00010000:00010000:2.0:1786015288.751845:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015288.751848:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751854:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751900:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4fff9c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f8f expref: 31 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751912:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:2.0:1786015288.751914:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015288.751919:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4fff9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f8f expref: 31 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.751929:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a0400, rc 0) 00000100:00100000:2.0:1786015288.752013:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+30:20464:x1872772280334336:12345-192.168.202.56@tcp:101:rm.0 Request processed in 719us (917us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015288.752022:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 643 00000100:00100000:0.0:1786015288.774224:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015288.774345:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280334464 00000100:00100000:3.0:1786015288.774359:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280334464 00000100:00100000:3.0:1786015288.774436:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 644 00000100:00100000:3.0:1786015288.774464:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+30:20465:x1872772280334464:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015288.774495:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015288.774526:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4fffb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f96 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.774629:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fffb8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.774659:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fffb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.774703:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fffb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.774722:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fffbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.774730:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fffbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.774737:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fffbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.774870:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fffb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.774878:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fffb8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.774886:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fffb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.774893:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bac00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015288.774898:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fffb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.774907:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fffb8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.774921:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:3.0:1786015288.774925:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015288.774930:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fffb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.774943:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c4fffb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.774958:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fffbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.774965:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fffbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.774971:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fffbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.774977:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bbc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015288.774980:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fffbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.774987:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fffbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.774994:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x7fd8c415 (ffff8b74a04b5f00) 00010000:00010000:3.0:1786015288.774996:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015288.774999:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fffbf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.775006:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bbc00/0xb1a5ef690c4fffbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.775046:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4fffb1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f96 expref: 31 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.775068:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:3.0:1786015288.775070:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015288.775074:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c4fffb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f96 expref: 31 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015288.775084:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb200, rc 0) 00000100:00100000:3.0:1786015288.775154:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+30:20465:x1872772280334464:12345-192.168.202.56@tcp:101:cp.0 Request processed in 709us (947us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015288.775163:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 644 00000100:00100000:3.0:1786015288.778623:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015288.778938:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280334592 00000100:00100000:1.0:1786015288.778980:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280334592 00000100:00100000:1.0:1786015288.779099:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 645 00000100:00100000:1.0:1786015288.779112:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+30:20465:x1872772280334592:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015288.779141:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015288.779172:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c4fffc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7f9d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779268:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fffcd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779287:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fffcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779302:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fffcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779319:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fffd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779327:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fffd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779334:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fffd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779427:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fffcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779436:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fffcd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779464:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fffcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779479:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bfa00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015288.779484:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fffcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779492:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fffcd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779506:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:1.0:1786015288.779509:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015288.779515:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fffcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779522:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c4fffcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779538:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fffd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779544:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fffd4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779549:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fffd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779554:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813be200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015288.779557:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fffd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779564:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fffd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779583:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x7fd8c415 (ffff8b7483ee6800) 00010000:00010000:1.0:1786015288.779585:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015288.779589:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fffd4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779595:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c4fffd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779647:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c4fffc6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f9d expref: 31 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779660:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:1.0:1786015288.779663:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015288.779667:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c4fffc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f9d expref: 31 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.779677:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf200, rc 0) 00000100:00100000:1.0:1786015288.779890:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+30:20465:x1872772280334592:12345-192.168.202.56@tcp:101:cp.0 Request processed in 780us (1288us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015288.779899:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 645 00000100:00100000:0.0:1786015288.783371:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015288.784150:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280334848 00000100:00100000:2.0:1786015288.784167:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280334848 00000100:00100000:2.0:1786015288.784280:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 646 00000100:00100000:2.0:1786015288.784293:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+30:20465:x1872772280334848:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015288.784326:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015288.784358:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4fffdb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7fa4 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.784936:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffe2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.784958:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffe2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.784972:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffe2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.784990:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffe9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.784998:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffe9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.785005:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffe9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786015288.787412:0:5796:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xf:0x0], index 1: 0 00010000:00010000:2.0:1786015288.788204:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ffff0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.788229:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ffff0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.788245:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ffff0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.788292:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffe2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.788315:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffe2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.788323:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffe2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.788329:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015288.788335:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffe2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.788343:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffe2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.788358:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:2.0:1786015288.788362:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015288.788368:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffe2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.788375:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c4fffe2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015288.788393:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000043beb14a reply state 000000005fcb1845 transno 4294967725 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffe9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015288.788403:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786015288.788465:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c4fffdb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fa4 expref: 33 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.788484:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1a00/0xb1a5ef690c4ffff0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fa4 expref: 32 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.788503:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8b749232dc00) 00010000:00010000:2.0:1786015288.788506:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015288.788509:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1a00, rc 0) 00000100:00100000:2.0:1786015288.789375:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+33:20465:x1872772280334848:12345-192.168.202.56@tcp:101:cp.0 Request processed in 5078us (6014us total) trans 4294967725 rc 0/0 00000100:00100000:2.0:1786015288.789387:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 646 00010000:00010000:2.0:1786015288.791495:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffe9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.791517:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffe9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.791527:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffe9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.791534:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015288.791540:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffe9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.791562:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffe9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.791585:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x7fd8c415 (ffff8b749232d900) 00010000:00010000:2.0:1786015288.791589:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015288.791594:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffe9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.791602:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c4fffe9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015288.794849:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015288.794963:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280334976 00000100:00100000:1.0:1786015288.794980:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280334976 00000100:00100000:1.0:1786015288.795100:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 162 00000100:00100000:1.0:1786015288.795117:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280334976:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015288.795150:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015288.795182:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000723e0120/0xb1a5ef690c4ffffe lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7fab expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015288.795252:0:14547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786015288.795285:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=524s v=(0 0) 00010000:00010000:1.0:1786015288.795290:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015288.795303:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000723e0120/0xb1a5ef690c4ffffe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fab expref: 9 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.795328:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000723e0120/0xb1a5ef690c4ffffe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fab expref: 9 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.795348:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf200, rc 0) 00000100:00100000:1.0:1786015288.795440:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280334976:12345-192.168.202.56@tcp:101:cp.0 Request processed in 328us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015288.795468:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 162 00000100:00080000:2.0:1786015288.795886:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015288.799221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015288.799314:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280335104 00000100:00100000:1.0:1786015288.799327:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280335104 00000100:00100000:1.0:1786015288.799395:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 163 00000100:00100000:1.0:1786015288.799405:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:20465:x1872772280335104:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015288.799429:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015288.799471:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c500005 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7fb2 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.799517:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000723e0120/0xb1a5ef690c4ffffe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fab expref: 10 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.799560:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015288.799565:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015288.799572:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c500005 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fb2 expref: 10 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.799619:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000723e0120/0xb1a5ef690c4ffffe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fab expref: 10 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.799878:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000723e0120/0xb1a5ef690c4ffffe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fab expref: 10 pid: 14547 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015288.799902:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304336896:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015288.800088:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b749306c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015288.802573:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304336896:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015288.802623:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c500005 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fb2 expref: 10 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.802662:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813be200, rc 0) 00000100:00100000:1.0:1786015288.802746:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:20465:x1872772280335104:12345-192.168.202.56@tcp:101:cp.0 Request processed in 3341us (3538us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015288.802756:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 163 00000100:00100000:2.0:1786015288.808826:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015288.808986:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280335232 00000100:00100000:0.0:1786015288.809001:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280335232 00010000:00010000:0.0:1786015288.809061:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000723e0120/0xb1a5ef690c4ffffe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fab expref: 10 pid: 14547 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015288.809116:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 185 00000100:00100000:0.0:1786015288.809127:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280335232:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015288.809148:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015288.809202:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000723e0120/0xb1a5ef690c4ffffe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fab expref: 10 pid: 14547 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015288.809219:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000723e0120/0xb1a5ef690c4ffffe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fab expref: 10 pid: 14547 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015288.809253:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000723e0120/0xb1a5ef690c4ffffe lrc: 0/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fab expref: 10 pid: 14547 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015288.809275:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015288.809281:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015288.809292:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c500005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fb2 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015288.809305:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c500005 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fb2 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015288.809362:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c500005 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fb2 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015288.809382:0:5781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1872772304337024:192.168.202.56@tcp:105: 00000100:00100000:0.0:1786015288.809517:0:5781:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b7e16240 going to sleep for 11 seconds 00000100:00100000:2.0:1786015288.818030:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015288.818137:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280335488 00000100:00100000:1.0:1786015288.818151:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280335488 00000100:00100000:1.0:1786015288.818270:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 133 00000100:00100000:1.0:1786015288.818285:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+32:20465:x1872772280335488:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:1.0:1786015288.818919:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+33:20465:x1872772280335488:12345-192.168.202.56@tcp:35:cp.0 Request processed in 635us (905us total) trans 4294967726 rc 0/0 00000100:00100000:1.0:1786015288.818929:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 133 00000100:00100000:0.0:1786015288.820393:0:5781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1872772304337024:192.168.202.56@tcp:105: 00010000:00010000:0.0:1786015288.820431:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015288.820593:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280335232:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 11466us (11840us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015288.820626:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 185 00000100:00100000:2.0:1786015288.852064:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015288.852221:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280335616 00000100:00100000:1.0:1786015288.852236:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280335616 00000100:00100000:1.0:1786015288.852316:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 647 00000100:00100000:1.0:1786015288.852328:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+67:20468:x1872772280335616:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015288.852356:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015288.852382:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c50000c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7fb9 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.852490:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500013 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.852512:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500013 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.852526:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500013 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.852546:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c50001a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.852554:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c50001a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.852561:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c50001a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.852719:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf400/0xb1a5ef690c500021 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.852750:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf400/0xb1a5ef690c500021 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.852758:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf400/0xb1a5ef690c500021 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015288.854131:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x11:0x0]: returning size 158 00000004:00200000:2.0:1786015288.854141:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015288.854182:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf400/0xb1a5ef690c500021 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.854204:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf400/0xb1a5ef690c500021 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.854216:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500013 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.854225:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500013 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.854235:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500013 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.854242:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015288.854247:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500013 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.854255:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500013 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.854276:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:2.0:1786015288.854279:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015288.854307:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500013 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.854314:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500013 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.854337:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c50001a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.854344:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c50001a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.854350:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c50001a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.854355:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813be000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015288.854358:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c50001a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.854364:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c50001a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.854370:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x7fd8c415 (ffff8b7483ee6b00) 00010000:00010000:2.0:1786015288.854373:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015288.854376:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c50001a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.854381:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c50001a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.854438:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c50000c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fb9 expref: 69 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.854475:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf400/0xb1a5ef690c500021 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fb9 expref: 68 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015288.854484:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8b749232dc00) 00010000:00010000:2.0:1786015288.854486:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015288.854489:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf400, rc 0) 00000100:00100000:2.0:1786015288.854913:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+68:20468:x1872772280335616:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 2584us (2862us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015288.854924:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 647 00000100:00100000:3.0:1786015288.858315:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015288.858421:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280335744 00000100:00100000:1.0:1786015288.858436:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280335744 00000100:00100000:1.0:1786015288.858621:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 164 00000100:00100000:1.0:1786015288.858635:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+9:2353:x1872772280335744:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015288.858667:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015288.858710:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000723e0120/0xb1a5ef690c500028 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7fc0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015288.858838:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304337152:192.168.202.56@tcp:106: 00000100:00080000:2.0:1786015288.858920:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015288.858972:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b749306c780 going to sleep for 11 seconds 00002000:00010000:1.0:1786015288.861078:0:6592:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1786015288.861091:0:6592:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb mtime: 0 -> 1786015289 00002000:00010000:1.0:1786015288.861093:0:6592:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb atime: 0 -> 1786015289 00002000:00010000:1.0:1786015288.861095:0:6592:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb ctime: 0 -> 1786015289 00000100:00100000:1.0:1786015288.861123:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304337152:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015288.861166:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000723e0120/0xb1a5ef690c500028 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fc0 expref: 10 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.861200:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000723e0120/0xb1a5ef690c500028 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fc0 expref: 10 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.861237:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf200, rc 0) 00000100:00100000:1.0:1786015288.861299:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+9:2353:x1872772280335744:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 2668us (3005us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015288.861308:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 164 00000100:00100000:2.0:1786015288.863511:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015288.863643:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280335872 00000100:00100000:1.0:1786015288.863655:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280335872 00000100:00100000:1.0:1786015288.863920:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 648 00000100:00100000:1.0:1786015288.863933:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+68:20468:x1872772280335872:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015288.864010:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015288.864044:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50002f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7fc7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015288.864151:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935400/0xb1a5ef690c500036 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015288.864171:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935400/0xb1a5ef690c500036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015288.864186:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935400/0xb1a5ef690c500036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015288.864280:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 512 00000004:00200000:0.0:1786015288.864285:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015288.864316:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935400/0xb1a5ef690c500036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015288.864349:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50002f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fc7 expref: 70 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015288.864372:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935400/0xb1a5ef690c500036 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fc7 expref: 69 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015288.864382:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8b74a04b5800) 00010000:00010000:0.0:1786015288.864385:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015288.864390:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7381935400, rc 0) 00000100:00100000:0.0:1786015288.864502:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+69:20468:x1872772280335872:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 571us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015288.864534:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 648 00000100:00100000:3.0:1786015288.868203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015288.868281:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280336000 00000100:00100000:1.0:1786015288.868297:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280336000 00000100:00100000:1.0:1786015288.868369:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 165 00000100:00100000:1.0:1786015288.868378:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+9:2354:x1872772280336000:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015288.868399:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015288.868422:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000723e0120/0xb1a5ef690c50003d lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7fce expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015288.868523:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304337280:192.168.202.56@tcp:106: 00000100:00100000:1.0:1786015288.868805:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b749306c780 going to sleep for 11 seconds 00000100:00100000:1.0:1786015288.871339:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304337280:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015288.871392:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000723e0120/0xb1a5ef690c50003d lrc: 1/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fce expref: 10 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.871424:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000723e0120/0xb1a5ef690c50003d lrc: 0/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fce expref: 10 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015288.871469:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf200, rc 0) 00000100:00100000:1.0:1786015288.871553:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+9:2354:x1872772280336000:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3174us (3370us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015288.871563:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 165 00000100:00100000:0.0:1786015288.876071:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000040:00080000:3.0:1786015288.876179:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015288.876187:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1786015288.876211:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280336256 00000100:00100000:2.0:1786015288.876228:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280336256 00000100:00100000:2.0:1786015288.876322:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 649 00000100:00100000:2.0:1786015288.876334:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+69:20468:x1872772280336256:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:2.0:1786015288.876681:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].15, 136 off10232 00000100:00100000:2.0:1786015288.876844:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+69:20468:x1872772280336256:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 510us (789us total) trans 0 rc 0/0 00000040:00080000:3.0:1786015288.876851:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000100:00100000:2.0:1786015288.876853:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 649 00000040:00080000:3.0:1786015288.876860:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786015289.195994:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015289.406955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015289.407614:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015289.407716:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015289.407758:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015289.407814:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015289.407919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015289.407949:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015289.407991:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280336768 00000100:00100000:3.0:1786015289.408005:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280336768 00000100:00100000:3.0:1786015289.408278:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280337024 00000100:00100000:3.0:1786015289.408282:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280337024 00000100:00100000:3.0:1786015289.408309:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280336640 00000100:00100000:3.0:1786015289.408312:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280336640 00000100:00100000:3.0:1786015289.408326:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280337152 00000100:00100000:3.0:1786015289.408329:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280337152 00000100:00100000:3.0:1786015289.408349:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 246 00000100:00100000:3.0:1786015289.408360:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+9:2351:x1872772280336768:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015289.408499:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+9:2351:x1872772280336768:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 130us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015289.408509:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 246 00000100:00100000:3.0:1786015289.408535:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 247 00000100:00100000:3.0:1786015289.408949:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2351:x1872772280337024:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015289.408993:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2351:x1872772280337024:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 49us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015289.409000:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 247 00000100:00100000:3.0:1786015289.409414:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 248 00000100:00100000:3.0:1786015289.409424:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+10:2351:x1872772280336640:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015289.409479:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+10:2351:x1872772280336640:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 57us (1664us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015289.409488:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 248 00000100:00100000:3.0:1786015289.409503:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 249 00000100:00100000:3.0:1786015289.409511:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280337152:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015289.409713:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280337152:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015289.409741:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 249 00000100:00100000:3.0:1786015289.409813:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280336384 00000100:00100000:3.0:1786015289.409898:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280336384 00000100:00100000:3.0:1786015289.409947:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 355 00000100:00100000:3.0:1786015289.409955:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280336384:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015289.409990:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280336384:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 36us (2231us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015289.409996:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 355 00000100:00100000:3.0:1786015289.410181:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280336512 00000100:00100000:3.0:1786015289.410187:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280336512 00000100:00100000:3.0:1786015289.410223:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280336896 00000100:00100000:3.0:1786015289.410226:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280336896 00000100:00100000:3.0:1786015289.410248:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 296 00000100:00100000:3.0:1786015289.410254:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+69:2351:x1872772280336512:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015289.410292:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+69:2351:x1872772280336512:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (3354us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015289.410298:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 296 00000100:00100000:3.0:1786015289.410311:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 297 00000100:00100000:3.0:1786015289.410317:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+33:2351:x1872772280336896:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015289.410344:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+33:2351:x1872772280336896:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (2425us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015289.410349:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 297 00000100:00080000:3.0:1786015289.410377:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015289.516572:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786015289.516608:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304337408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015289.516743:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015289.516893:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304337408 00000100:00100000:1.0:1786015289.516904:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304337408 00000100:00100000:1.0:1786015289.516984:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1786015289.516991:0:6593:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1786015289.516994:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304337408:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015289.517003:0:6593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1786015289.517057:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015289.517117:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304337408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015289.517125:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1786015289.517918:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015289.517982:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304337408:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1786015289.849562:0:16130:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015289.849576:0:16130:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015289.849625:0:16130:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 16 count 2 00000040:00080000:2.0:1786015289.849635:0:16130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1786015289.900140:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015289.900155:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015289.900215:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 16 count 2 00000040:00080000:3.0:1786015289.900225:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015289.902916:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af068e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304337536:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015289.903177:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54e600 going to sleep for 11 seconds 00000100:00100000:0.0:1786015289.918880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015289.919258:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af068e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304337536:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786015289.919801:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280337280 00000100:00100000:2.0:1786015289.919813:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280337280 00000100:00100000:2.0:1786015289.919892:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 650 00000100:00100000:2.0:1786015289.919906:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+33:20479:x1872772280337280:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015289.919951:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x11:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015289.920157:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+33:20479:x1872772280337280:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 253us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015289.920166:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 650 00000100:00100000:1.0:1786015289.935934:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015289.940958:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280337536 00000100:00100000:3.0:1786015289.940983:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280337536 00000100:00100000:2.0:1786015289.941294:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 651 00000100:00100000:2.0:1786015289.941308:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+33:20479:x1872772280337536:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015289.941343:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015289.941380:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c500044 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7fd5 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015289.941635:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c50004b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015289.941654:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c50004b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015289.941670:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c50004b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015289.941686:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x11:0x0]: returning size 158 00010000:00010000:2.0:1786015289.942029:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c500044 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fd5 expref: 36 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015289.942052:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c50004b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fd5 expref: 35 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015289.942077:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8b749232dc00) 00010000:00010000:2.0:1786015289.942081:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015289.942086:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1c00, rc 0) 00000100:00100000:2.0:1786015289.942228:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+35:20479:x1872772280337536:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 922us (6310us total) trans 4294967727 rc 0/0 00000100:00100000:2.0:1786015289.942237:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 651 00000100:00100000:3.0:1786015289.945733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015289.945998:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280337664 00000100:00100000:0.0:1786015289.946014:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280337664 00000100:00100000:0.0:1786015289.946083:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 166 00000100:00100000:0.0:1786015289.946095:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280337664:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786015289.946163:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009b2a53f7/0xb1a5ef690c500059 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015289.946189:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c500005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fb2 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015289.946200:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xf:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786015289.946203:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015289.946208:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b2a53f7/0xb1a5ef690c500059 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015289.946257:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c500005 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fb2 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015289.946302:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c500005 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fb2 expref: 9 pid: 6590 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015289.946323:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304337664:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015289.946530:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748628ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1786015289.955375:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015289.958731:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015289.958824:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280337920 00000100:00100000:3.0:1786015289.958836:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280337920 00002000:00100000:3.0:1786015289.958907:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xf:0x0] (0->157) req@ffff8b74af069500 x1872772280337920/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:135/0 lens 648/0 e 0 to 0 dl 1786015300 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015289.958921:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74af069500 with x1872772280337920 ext(0->157) 00010000:00010000:3.0:1786015289.958933:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c500005 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fb2 expref: 10 pid: 6590 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015289.958954:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c500005 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fb2 expref: 10 pid: 6590 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015289.958963:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b74af069500 00000100:00100000:3.0:1786015289.958999:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:3.0:1786015289.959009:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280337920:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:3.0:1786015289.959834:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280337920:12345-192.168.202.56@tcp:4:cp.0 Request processed in 819us (1116us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1786015289.959856:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 5 00002000:00100000:3.0:1786015289.959867:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xf:0x0] (0->157) req@ffff8b74af069500 x1872772280337920/t4294967330(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:135/0 lens 648/448 e 0 to 0 dl 1786015300 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015289.959876:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74af069500 with x1872772280337920 ext(0->157) 00010000:00010000:3.0:1786015289.959883:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c500005 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fb2 expref: 12 pid: 6590 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015289.959900:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c500005 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fb2 expref: 12 pid: 6590 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015289.959908:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b74af069500 00000100:00100000:2.0:1786015289.963874:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280337792 00000100:00100000:2.0:1786015289.963899:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280337792 00000100:00100000:2.0:1786015289.964001:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:2.0:1786015289.964013:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+35:2353:x1872772280337792:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015289.964039:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015289.964075:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c50004b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fd5 expref: 35 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015289.964099:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8b749232dc00) 00010000:00010000:2.0:1786015289.964105:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015289.964180:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+34:2353:x1872772280337792:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 170us (8817us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015289.964188:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:1.0:1786015289.964877:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304337664:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015289.964918:0:14547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009b2a53f7/0xb1a5ef690c500059 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015289.968428:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015289.968617:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280338048 00000100:00100000:3.0:1786015289.968749:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280338048 00010000:00010000:3.0:1786015289.969249:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c500005 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fb2 expref: 12 pid: 6590 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015289.969341:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 186 00000100:00100000:3.0:1786015289.969354:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280338048:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015289.969376:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015289.969409:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c500005 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fb2 expref: 12 pid: 6590 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015289.969425:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c500005 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fb2 expref: 12 pid: 6590 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015289.969495:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c500005 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fb2 expref: 12 pid: 6590 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015289.969516:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015289.969521:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015289.969529:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b2a53f7/0xb1a5ef690c500059 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015289.969551:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b2a53f7/0xb1a5ef690c500059 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015289.969593:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015289.969798:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280338048:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 447us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015289.969807:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 186 00010000:00010000:1.0:1786015289.969877:0:14547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009b2a53f7/0xb1a5ef690c500059 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015289.969888:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b2a53f7/0xb1a5ef690c500059 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015289.969936:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009b2a53f7/0xb1a5ef690c500059 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015289.969946:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b2a53f7/0xb1a5ef690c500059 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015289.969956:0:14547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b2a53f7/0xb1a5ef690c500059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015289.969965:0:14547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381935200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015289.969970:0:14547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b2a53f7/0xb1a5ef690c500059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015289.969980:0:14547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b2a53f7/0xb1a5ef690c500059 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015289.969993:0:14547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b2a53f7/0xb1a5ef690c500059 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015289.970001:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b2a53f7/0xb1a5ef690c500059 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015289.970065:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280337664:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 23973us (24346us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015289.970085:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 166 00000100:00100000:3.0:1786015289.983206:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015289.986967:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280338304 00000100:00100000:0.0:1786015289.986997:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280338304 00000100:00100000:0.0:1786015289.987215:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 652 00000100:00100000:0.0:1786015289.987229:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+34:20479:x1872772280338304:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015289.987408:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+34:20479:x1872772280338304:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 181us (4226us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015289.987417:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 652 00000100:00100000:1.0:1786015289.990382:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015289.990744:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280338432 00000100:00100000:3.0:1786015289.990785:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280338432 00000100:00100000:3.0:1786015289.990867:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 167 00000100:00100000:3.0:1786015289.990882:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280338432:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015289.990916:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015289.990951:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d6f1b8e/0xb1a5ef690c500060 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7fdc expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015289.990991:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 158, mtime: 0x6a746e39, atime: 0x0, ctime: 0x6a746e39, blocks: 0x1 00010000:00010000:3.0:1786015289.991043:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1786015289.991049:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015289.991061:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d6f1b8e/0xb1a5ef690c500060 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fdc expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015289.991088:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000d6f1b8e/0xb1a5ef690c500060 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fdc expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015289.991108:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bbc00, rc 0) 00000100:00100000:3.0:1786015289.991190:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280338432:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 311us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015289.991198:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 167 00000100:00100000:1.0:1786015290.006598:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015290.006825:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280338688 00000100:00100000:2.0:1786015290.006842:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280338688 00000100:00100000:2.0:1786015290.006933:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 653 00000100:00100000:2.0:1786015290.006950:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+34:20479:x1872772280338688:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015290.007118:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+34:20479:x1872772280338688:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 172us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015290.007148:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 653 00000100:00080000:0.0:1786015290.007360:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015290.010440:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015290.010640:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280338816 00000100:00100000:0.0:1786015290.010660:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280338816 00000100:00080000:1.0:1786015290.010735:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:0.0:1786015290.010748:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xf:0x0] (0->4095) req@ffff8b74aef03800 x1872772280338816/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:136/0 lens 488/0 e 0 to 0 dl 1786015301 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015290.010810:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aef03800 with x1872772280338816 ext(0->4095) 00002000:00010000:0.0:1786015290.010817:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74aef03800 00000100:00100000:0.0:1786015290.010852:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:0.0:1786015290.010863:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280338816:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1786015290.011186:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280338816:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 326us (760us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786015290.011203:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 55 00002000:00100000:0.0:1786015290.011211:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xf:0x0] (0->4095) req@ffff8b74aef03800 x1872772280338816/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:136/0 lens 488/4536 e 0 to 0 dl 1786015301 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015290.011219:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aef03800 with x1872772280338816 ext(0->4095) 00002000:00010000:0.0:1786015290.011223:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74aef03800 00000100:00100000:2.0:1786015290.024678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015290.025377:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280338944 00000100:00100000:3.0:1786015290.025396:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280338944 00000100:00100000:3.0:1786015290.025541:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 654 00000100:00100000:3.0:1786015290.025555:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+34:20479:x1872772280338944:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015290.025590:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015290.025624:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c500067 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7fe3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015290.025675:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50006e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015290.025692:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50006e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015290.025707:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50006e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015290.025897:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c500067 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fe3 expref: 36 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015290.025918:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50006e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fe3 expref: 35 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015290.025929:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8b749232dc00) 00010000:00010000:3.0:1786015290.025933:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786015290.025938:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb800, rc 0) 00000100:00100000:3.0:1786015290.027556:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+35:20479:x1872772280338944:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1991us (2874us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015290.027570:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 654 00000100:00100000:2.0:1786015290.034466:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015290.035529:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280339072 00000100:00100000:3.0:1786015290.035559:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280339072 00000100:00100000:3.0:1786015290.035791:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 655 00000100:00100000:3.0:1786015290.035806:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+35:20479:x1872772280339072:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015290.036029:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x11:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015290.036335:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+35:20479:x1872772280339072:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 531us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015290.036345:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 655 00000100:00100000:1.0:1786015290.041868:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015290.041989:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280339200 00000100:00100000:2.0:1786015290.042005:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280339200 00000100:00100000:2.0:1786015290.042099:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 168 00000100:00100000:2.0:1786015290.042114:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280339200:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786015290.042189:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c500075 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015290.042213:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015290.042219:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015290.042227:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c500075 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015290.042245:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c500075 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015290.042288:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c500075 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015290.042297:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c500075 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015290.042306:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c500075 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015290.042335:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a0400 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015290.042340:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c500075 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015290.042351:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c500075 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015290.042371:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c500075 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015290.042379:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cabb5502/0xb1a5ef690c500075 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015290.042579:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280339200:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 467us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015290.042588:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 168 00000100:00100000:3.0:1786015290.049150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015290.050080:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280339456 00000100:00100000:0.0:1786015290.050097:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280339456 00000100:00100000:0.0:1786015290.050166:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 656 00000100:00100000:0.0:1786015290.050179:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+35:20479:x1872772280339456:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786015290.050271:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c50007c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015290.050290:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50006e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fe3 expref: 35 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015290.050300:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c50007c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015290.050339:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50006e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fe3 expref: 35 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015290.050354:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50006e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fe3 expref: 35 pid: 5794 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015290.050370:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304337792:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015290.050487:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748628a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015290.057980:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015290.058055:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280339584 00000100:00100000:2.0:1786015290.058076:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280339584 00000100:00100000:0.0:1786015290.058108:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304337792:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015290.058139:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50006e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fe3 expref: 36 pid: 5794 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015290.058139:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c50007c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015290.058235:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 187 00000100:00100000:2.0:1786015290.058248:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+36:2354:x1872772280339584:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015290.058269:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015290.058288:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50006e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fe3 expref: 36 pid: 5794 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015290.058303:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50006e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fe3 expref: 36 pid: 5794 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015290.058335:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50006e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fe3 expref: 36 pid: 5794 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015290.058354:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8b749232dc00) 00010000:00010000:2.0:1786015290.058360:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c50007c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015290.058373:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c50007c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015290.058381:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c50007c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015290.058418:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015290.058522:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+35:2354:x1872772280339584:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 275us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015290.058542:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 187 00010000:00010000:0.0:1786015290.059504:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c50007c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015290.059519:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c50007c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015290.059778:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c50007c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015290.059788:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c50007c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015290.059795:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c50007c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015290.059801:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381934800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015290.059808:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c50007c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015290.059819:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c50007c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015290.059846:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8b749232dc00) 00010000:00010000:0.0:1786015290.059851:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015290.059857:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c50007c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015290.059865:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c50007c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015290.060108:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+35:20479:x1872772280339456:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 9929us (10968us total) trans 4294967728 rc 0/0 00000100:00100000:0.0:1786015290.060119:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 656 00000040:00080000:1.0:1786015290.063935:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015290.063951:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015290.064434:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1786015290.064455:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015290.067551:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015290.067659:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280339840 00000100:00100000:2.0:1786015290.067676:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280339840 00000100:00100000:2.0:1786015290.067800:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 134 00000100:00100000:2.0:1786015290.067814:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+35:20479:x1872772280339840:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015290.068380:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+36:20479:x1872772280339840:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 567us (842us total) trans 4294967729 rc 0/0 00000100:00100000:2.0:1786015290.068414:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 134 00010000:00010000:2.0:1786015290.220088:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015291.052357:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304338304:0@lo:400:kworker.0 00000100:00100000:2.0:1786015291.052612:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015291.052982:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786015291.052994:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304337920:0@lo:400:kworker.0 00000100:00100000:0.0:1786015291.053142:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304338048:0@lo:400:kworker.0 00000100:00100000:0.0:1786015291.053190:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015291.053221:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304338560:0@lo:400:kworker.0 00000100:00100000:0.0:1786015291.053246:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015291.053267:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015291.053273:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304338176:0@lo:400:kworker.0 00000100:00100000:0.0:1786015291.053295:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015291.053359:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304338048 00000100:00100000:0.0:1786015291.053369:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304338048 00000100:00100000:0.0:1786015291.053451:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304338176 00000100:00100000:0.0:1786015291.053455:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304338176 00000100:00100000:0.0:1786015291.053497:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1786015291.053508:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304338048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015291.053574:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304338048:12345-0@lo:400:kworker.0 Request processed in 67us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015291.053582:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1786015291.053603:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1786015291.053609:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304338176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015291.053892:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015291.053922:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304338432:0@lo:400:kworker.0 00000100:00100000:2.0:1786015291.053949:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015291.054145:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304338304 00000100:00100000:2.0:1786015291.054152:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304338304 00000100:00100000:2.0:1786015291.054187:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304338560 00000100:00100000:2.0:1786015291.054190:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304338560 00000100:00100000:2.0:1786015291.054213:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1786015291.054223:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304338304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015291.054269:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304338304:12345-0@lo:400:kworker.0 Request processed in 49us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015291.054275:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1786015291.054290:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1786015291.054297:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304338560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015291.054325:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304338560:12345-0@lo:400:kworker.0 Request processed in 29us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015291.054330:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1786015291.054352:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304338432 00000100:00100000:2.0:1786015291.054355:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304338432 00000100:00100000:2.0:1786015291.054376:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1786015291.054402:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304338432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015291.054448:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304338432:12345-0@lo:400:kworker.0 Request processed in 34us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015291.054454:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1786015291.054509:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304338432:0@lo:400:kworker.0 00000100:00100000:2.0:1786015291.054526:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304338304:0@lo:400:kworker.0 00000100:00080000:2.0:1786015291.054579:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015291.054585:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015291.054588:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015291.054710:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304338176:12345-0@lo:400:kworker.0 Request processed in 1100us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015291.054719:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1786015291.054833:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304338176:0@lo:400:kworker.0 00000100:00100000:3.0:1786015291.054855:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304338048:0@lo:400:kworker.0 00000100:00100000:3.0:1786015291.054879:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304338560:0@lo:400:kworker.0 00000100:00100000:1.0:1786015291.055656:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304337920 00000100:00100000:1.0:1786015291.055669:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304337920 00000100:00100000:1.0:1786015291.055747:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1786015291.055756:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304337920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015291.055886:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304337920:12345-0@lo:400:kworker.0 Request processed in 132us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015291.055893:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1786015291.056248:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304337920:0@lo:400:kworker.0 00010000:00010000:1.0:1786015291.245935:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015291.568790:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015291.568818:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304338688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015291.568892:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015291.568972:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304338688 00000100:00100000:3.0:1786015291.568981:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304338688 00000100:00100000:3.0:1786015291.569031:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1786015291.569041:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304338688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015291.569065:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 59572224 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015291.569110:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304338688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015291.569118:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1786015291.569170:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304338688:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1786015291.651519:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967728 is committed 00000001:00080000:1.0:1786015291.651561:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967729 is committed 00000001:00080000:1.0:1786015291.651587:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967724 is committed 00000040:00080000:1.0:1786015291.896274:0:16182:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015291.896287:0:16182:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015291.896332:0:16182:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 16 count 2 00000040:00080000:1.0:1786015291.896340:0:16182:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015292.020745:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015292.020854:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280340096 00000100:00100000:3.0:1786015292.020863:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280340096 00000100:00100000:3.0:1786015292.020942:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 657 00000100:00100000:3.0:1786015292.020953:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+68:20490:x1872772280340096:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015292.020975:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015292.020998:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500083 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7fea expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015292.021110:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c50008a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015292.021124:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c50008a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015292.021137:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c50008a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015292.021165:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x11:0x0]: returning size 158 00010000:00010000:3.0:1786015292.021409:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500083 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fea expref: 71 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015292.021439:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c50008a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fea expref: 70 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015292.021448:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8b749232dc00) 00010000:00010000:3.0:1786015292.021451:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015292.021455:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819ba200, rc 0) 00000100:00100000:3.0:1786015292.021551:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+70:20490:x1872772280340096:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 598us (815us total) trans 4294967730 rc 0/0 00000100:00100000:3.0:1786015292.021559:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 657 00000100:00080000:2.0:1786015292.022324:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015292.029722:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015292.029849:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280340224 00000100:00100000:0.0:1786015292.029859:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280340224 00000100:00100000:0.0:1786015292.029919:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 658 00000100:00100000:0.0:1786015292.029930:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+70:20490:x1872772280340224:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:0.0:1786015292.030004:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935a00/0xb1a5ef690c500098 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015292.030022:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935a00/0xb1a5ef690c500098 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015292.030034:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935a00/0xb1a5ef690c500098 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015292.030064:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935a00/0xb1a5ef690c500098 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015292.030072:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935a00/0xb1a5ef690c500098 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015292.030079:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935a00/0xb1a5ef690c500098 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015292.030085:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381935a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015292.030089:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935a00/0xb1a5ef690c500098 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015292.030097:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935a00/0xb1a5ef690c500098 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015292.030108:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8b749232dc00) 00010000:00010000:0.0:1786015292.030111:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015292.030130:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935a00/0xb1a5ef690c500098 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015292.030136:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935a00/0xb1a5ef690c500098 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015292.030223:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+70:20490:x1872772280340224:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 294us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015292.030231:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 658 00000100:00100000:3.0:1786015292.032882:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015292.032993:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280340352 00000100:00100000:0.0:1786015292.033003:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280340352 00000100:00100000:0.0:1786015292.033073:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:0.0:1786015292.033082:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+70:2353:x1872772280340352:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015292.033107:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015292.033132:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c50008a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fea expref: 70 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015292.033151:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8b749232dc00) 00010000:00010000:0.0:1786015292.033156:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015292.033208:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+69:2353:x1872772280340352:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 127us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015292.033215:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:1.0:1786015292.044118:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015292.044170:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280340608 00000100:00100000:1.0:1786015292.044181:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280340608 00000100:00100000:1.0:1786015292.044246:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 135 00000100:00100000:1.0:1786015292.044257:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+69:20490:x1872772280340608:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:1.0:1786015292.044531:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+70:20490:x1872772280340608:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 274us (421us total) trans 4294967731 rc 0/0 00000100:00100000:1.0:1786015292.044540:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 135 00000001:00080000:3.0:1786015292.173678:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967330 is committed 00010000:00010000:1.0:1786015292.273538:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015293.292015:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015294.188084:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015294.188099:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015294.188150:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 16 count 2 00000040:00080000:2.0:1786015294.188159:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786015294.315930:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015294.528528:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015294.528577:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015294.528625:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015294.528645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015294.528668:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015294.528692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015294.528739:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015294.528820:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280340992 00000100:00100000:0.0:1786015294.528834:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280340992 00000100:00100000:0.0:1786015294.528905:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280341504 00000100:00100000:0.0:1786015294.528908:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280341504 00000100:00100000:0.0:1786015294.528941:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280341120 00000100:00100000:0.0:1786015294.528944:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280341120 00000100:00100000:0.0:1786015294.528960:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280341376 00000100:00100000:0.0:1786015294.528962:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280341376 00000100:00100000:0.0:1786015294.528984:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 252 00000100:00100000:0.0:1786015294.528995:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+10:2352:x1872772280340992:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015294.529096:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+10:2352:x1872772280340992:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 102us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015294.529104:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 252 00000100:00100000:0.0:1786015294.529128:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 253 00000100:00100000:0.0:1786015294.529136:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280341504:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015294.529161:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280341504:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015294.529167:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 253 00000100:00100000:0.0:1786015294.529180:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 254 00000100:00100000:0.0:1786015294.529186:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+9:2352:x1872772280341120:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015294.529209:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+9:2352:x1872772280341120:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015294.529215:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 254 00000100:00100000:0.0:1786015294.529226:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 255 00000100:00100000:0.0:1786015294.529232:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280341376:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015294.529494:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280341376:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 39us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015294.529504:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 255 00000100:00100000:0.0:1786015294.529537:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280341248 00000100:00100000:0.0:1786015294.529542:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280341248 00000100:00100000:0.0:1786015294.529714:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280340864 00000100:00100000:0.0:1786015294.529719:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280340864 00000100:00100000:0.0:1786015294.529750:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 301 00000100:00100000:0.0:1786015294.529758:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+29:2352:x1872772280341248:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015294.529829:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+29:2352:x1872772280341248:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 73us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015294.529836:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 301 00000100:00100000:0.0:1786015294.529848:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 302 00000100:00100000:0.0:1786015294.529855:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+70:2352:x1872772280340864:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015294.529879:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+70:2352:x1872772280340864:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015294.529885:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 302 00000100:00080000:0.0:1786015294.530078:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015294.530084:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015294.530087:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015294.530194:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280340736 00000100:00100000:1.0:1786015294.530200:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280340736 00000100:00100000:1.0:1786015294.530245:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 357 00000100:00100000:1.0:1786015294.530253:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280340736:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015294.530302:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280340736:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 48us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015294.530309:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 357 00000100:00100000:0.0:1786015294.639156:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786015294.639207:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304338816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015294.639318:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015294.639811:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304338816 00000100:00100000:1.0:1786015294.639823:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304338816 00000100:00100000:1.0:1786015294.639928:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1786015294.639941:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304338816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015294.639992:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015294.640066:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304338816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015294.640074:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1786015294.640880:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015294.641011:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304338816:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786015295.348704:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015296.180055:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304339072:0@lo:400:kworker.0 00000100:00100000:0.0:1786015296.180172:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015296.180478:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304339584:0@lo:400:kworker.0 00000100:00100000:0.0:1786015296.180515:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015296.180559:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015296.180578:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304339200:0@lo:400:kworker.0 00000100:00100000:0.0:1786015296.180605:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015296.180653:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304339584 00000100:00100000:0.0:1786015296.180663:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304339584 00000100:00100000:0.0:1786015296.180741:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1786015296.180752:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304339584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015296.180971:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304339584:12345-0@lo:400:kworker.0 Request processed in 221us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015296.180980:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1786015296.181009:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304339072 00000100:00100000:0.0:1786015296.181013:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304339072 00000100:00100000:0.0:1786015296.181040:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304339200 00000100:00100000:0.0:1786015296.181043:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304339200 00000100:00100000:0.0:1786015296.181068:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1786015296.181075:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304339072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015296.181109:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304339072:12345-0@lo:400:kworker.0 Request processed in 35us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015296.181115:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1786015296.181126:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1786015296.181132:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304339200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015296.181157:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304339200:12345-0@lo:400:kworker.0 Request processed in 25us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015296.181185:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:0.0:1786015296.181445:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015296.181451:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015296.181508:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304339200:0@lo:400:kworker.0 00000100:00100000:0.0:1786015296.181522:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304339072:0@lo:400:kworker.0 00000100:00100000:0.0:1786015296.181533:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304339584:0@lo:400:kworker.0 00000100:00100000:1.0:1786015296.181704:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304338944:0@lo:400:kworker.0 00000100:00100000:1.0:1786015296.181754:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015296.181832:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304339456:0@lo:400:kworker.0 00000100:00100000:1.0:1786015296.181936:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015296.181961:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786015296.181968:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304339328:0@lo:400:kworker.0 00000100:00100000:1.0:1786015296.181998:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015296.182034:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304339456 00000100:00100000:1.0:1786015296.182039:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304339456 00000100:00100000:1.0:1786015296.183054:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1786015296.183075:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304339456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015296.183162:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304339456:12345-0@lo:400:kworker.0 Request processed in 97us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015296.183169:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1786015296.184077:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304338944 00000100:00100000:0.0:1786015296.184093:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304338944 00000100:00100000:0.0:1786015296.184160:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1786015296.184171:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304338944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015296.185353:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304339328 00000100:00100000:1.0:1786015296.185368:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304339328 00000100:00100000:0.0:1786015296.185584:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304338944:12345-0@lo:400:kworker.0 Request processed in 1410us (3823us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015296.185597:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1786015296.185705:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304338944:0@lo:400:kworker.0 00000100:00100000:0.0:1786015296.185728:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304339456:0@lo:400:kworker.0 00000100:00080000:0.0:1786015296.185785:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015296.185791:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015296.190163:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1786015296.190211:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304339328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015296.190540:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304339328:12345-0@lo:400:kworker.0 Request processed in 353us (8538us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015296.190552:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1786015296.191963:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304339328:0@lo:400:kworker.0 00010000:00010000:1.0:1786015296.365352:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015296.688494:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015296.688524:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304339712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015296.688627:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015296.688728:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304339712 00000100:00100000:3.0:1786015296.688739:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304339712 00000100:00100000:3.0:1786015296.688840:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1786015296.688851:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304339712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015296.688899:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 57868288 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015296.688954:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304339712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015296.688979:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1786015296.689046:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304339712:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1786015296.724136:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967731 is committed 00010000:00010000:1.0:1786015297.388279:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015298.414757:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015299.105669:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015299.105716:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280341632 00000100:00100000:1.0:1786015299.105729:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280341632 00000100:00100000:1.0:1786015299.105812:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 659 00000100:00100000:1.0:1786015299.105824:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+29:20461:x1872772280341632:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1786015299.105936:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+29:20461:x1872772280341632:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 114us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015299.105944:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 659 00000100:00080000:1.0:1786015299.105966:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015299.117754:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015299.118411:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280341888 00000100:00100000:2.0:1786015299.118423:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280341888 00000100:00100000:2.0:1786015299.118508:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 136 00000100:00100000:2.0:1786015299.118521:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+29:20461:x1872772280341888:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015299.119119:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+30:20461:x1872772280341888:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 598us (1372us total) trans 4294967732 rc 0/0 00000100:00100000:2.0:1786015299.119128:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 136 00010000:00010000:0.0:1786015299.436118:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015299.647110:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015299.647175:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015299.647216:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015299.647251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015299.647284:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015299.647317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015299.647591:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280342144 00000100:00100000:0.0:1786015299.647606:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280342144 00000100:00100000:0.0:1786015299.647709:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 306 00000100:00100000:0.0:1786015299.647721:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+68:2352:x1872772280342144:12345-192.168.202.56@tcp:400:kworker.0 00000100:00080000:2.0:1786015299.647957:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015299.649750:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+68:2352:x1872772280342144:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 2017us (2655us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015299.649842:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 306 00000100:00100000:2.0:1786015299.651091:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280342400 00000100:00100000:2.0:1786015299.651116:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280342400 00000100:00100000:2.0:1786015299.651193:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280342656 00000100:00100000:2.0:1786015299.651216:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280342656 00000100:00100000:2.0:1786015299.651241:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280342272 00000100:00100000:2.0:1786015299.651245:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280342272 00000100:00100000:2.0:1786015299.651259:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280342528 00000100:00100000:2.0:1786015299.651262:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280342528 00000100:00100000:2.0:1786015299.651281:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 258 00000100:00100000:2.0:1786015299.651291:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+9:2352:x1872772280342400:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015299.651406:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+9:2352:x1872772280342400:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 116us (4230us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015299.651413:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 258 00000100:00100000:2.0:1786015299.651431:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 259 00000100:00100000:2.0:1786015299.651436:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280342656:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015299.651461:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280342656:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (4244us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015299.651467:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 259 00000100:00100000:2.0:1786015299.651478:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 260 00000100:00100000:2.0:1786015299.651484:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+10:2352:x1872772280342272:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015299.651508:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+10:2352:x1872772280342272:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (4224us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015299.651514:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 260 00000100:00100000:2.0:1786015299.651542:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 261 00000100:00100000:2.0:1786015299.651549:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280342528:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015299.651574:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280342528:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (4257us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015299.651580:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 261 00000100:00080000:2.0:1786015299.651630:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015299.651635:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015299.653560:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280342016 00000100:00100000:3.0:1786015299.653576:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280342016 00000100:00100000:3.0:1786015299.653651:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 359 00000100:00100000:3.0:1786015299.653678:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280342016:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015299.653777:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280342016:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 85us (6508us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015299.653785:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 359 00000100:00100000:1.0:1786015299.758862:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304339840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015299.758977:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015299.759101:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304339840 00000100:00100000:1.0:1786015299.759110:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304339840 00000100:00100000:1.0:1786015299.759180:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1786015299.759243:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304339840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015299.759296:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015299.759359:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304339840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015299.759368:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1786015299.759396:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015299.759457:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304339840:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786015300.460049:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786015301.264518:0:16429:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 11a: Import a file ==================== 07:21:39 (1786015299) 00000100:00100000:3.0:1786015301.292231:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304340352:0@lo:400:kworker.0 00000100:00100000:3.0:1786015301.292324:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015301.292418:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786015301.292437:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304339968:0@lo:400:kworker.0 00000100:00100000:3.0:1786015301.292470:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015301.292494:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304340480:0@lo:400:kworker.0 00000100:00100000:3.0:1786015301.292534:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015301.292564:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304340096:0@lo:400:kworker.0 00000100:00100000:3.0:1786015301.292588:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015301.292613:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304340608:0@lo:400:kworker.0 00000100:00100000:3.0:1786015301.292635:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015301.292655:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015301.292660:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304340224:0@lo:400:kworker.0 00000100:00100000:3.0:1786015301.292681:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015301.292738:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304340352 00000100:00100000:3.0:1786015301.292746:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304340352 00000100:00100000:3.0:1786015301.292830:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304340608 00000100:00100000:3.0:1786015301.292834:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304340608 00000100:00100000:3.0:1786015301.292863:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1786015301.292873:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304340352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015301.292932:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304340352:12345-0@lo:400:kworker.0 Request processed in 61us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015301.292939:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1786015301.292958:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1786015301.292964:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304340608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015301.292997:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304340608:12345-0@lo:400:kworker.0 Request processed in 33us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015301.293003:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1786015301.293024:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304339968 00000100:00100000:3.0:1786015301.293028:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304339968 00000100:00100000:3.0:1786015301.293054:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1786015301.293061:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304339968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015301.293091:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304339968:12345-0@lo:400:kworker.0 Request processed in 31us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015301.293097:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1786015301.293126:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304340480 00000100:00100000:3.0:1786015301.293130:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304340480 00000100:00100000:3.0:1786015301.293155:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304340096 00000100:00100000:3.0:1786015301.293159:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304340096 00000100:00100000:3.0:1786015301.293174:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304340224 00000100:00100000:3.0:1786015301.293176:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304340224 00000100:00100000:3.0:1786015301.293191:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1786015301.293198:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304340480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015301.293240:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304340480:12345-0@lo:400:kworker.0 Request processed in 42us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015301.293246:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1786015301.293258:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1786015301.293263:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304340096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015301.293290:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304340096:12345-0@lo:400:kworker.0 Request processed in 27us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015301.293294:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1786015301.293305:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1786015301.293310:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304340224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015301.293347:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304340224:12345-0@lo:400:kworker.0 Request processed in 25us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015301.293352:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:3.0:1786015301.293377:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015301.293381:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015301.293383:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015301.293428:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304340224:0@lo:400:kworker.0 00000100:00100000:3.0:1786015301.293441:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304340096:0@lo:400:kworker.0 00000100:00100000:3.0:1786015301.293450:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304340608:0@lo:400:kworker.0 00000100:00100000:3.0:1786015301.293482:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304339968:0@lo:400:kworker.0 00000100:00100000:3.0:1786015301.293493:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304340480:0@lo:400:kworker.0 00000100:00100000:3.0:1786015301.293503:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304340352:0@lo:400:kworker.0 00000100:00100000:1.0:1786015301.427985:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015301.428144:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280342784 00000100:00100000:3.0:1786015301.428167:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280342784 00000100:00100000:3.0:1786015301.428254:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 660 00000100:00100000:3.0:1786015301.428265:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+68:21071:x1872772280342784:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015301.428288:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015301.428311:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c50009f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7ff1 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428400:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5000a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428419:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5000a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428433:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5000a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428449:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5000ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428456:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5000ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428462:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5000ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428816:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5000a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428826:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5000a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428833:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5000a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428846:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bac00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015301.428851:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5000a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428859:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5000a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428872:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:3.0:1786015301.428876:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015301.428881:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5000a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428887:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5000a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428898:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5000ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428904:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5000ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428910:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5000ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428915:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015301.428918:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5000ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428924:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5000ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428941:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ba86b33 (ffff8b74a04b5100) 00010000:00010000:3.0:1786015301.428944:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015301.428947:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5000ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428953:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5000ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428986:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c50009f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ff1 expref: 69 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.428996:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:3.0:1786015301.428998:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015301.429001:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c50009f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ff1 expref: 69 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.429010:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb200, rc 0) 00000100:00100000:3.0:1786015301.429096:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+68:21071:x1872772280342784:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 833us (1121us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015301.429105:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 660 00000100:00080000:1.0:1786015301.429462:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015301.441149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015301.441226:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280343040 00000100:00100000:2.0:1786015301.441238:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280343040 00000100:00100000:2.0:1786015301.441303:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 661 00000100:00100000:2.0:1786015301.441313:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+68:21071:x1872772280343040:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:2.0:1786015301.441386:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015301.441421:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c4fff25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f65 expref: 68 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015301.441441:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:2.0:1786015301.441446:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015301.441749:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c5000b4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015301.441801:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4fff64 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f7a expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015301.441811:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c5000b4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015301.441846:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4fff64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f7a expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015301.441863:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4fff64 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f7a expref: 29 pid: 5796 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015301.441880:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383749f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304340736:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015301.441984:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748570af00 going to sleep for 11 seconds 00000100:00100000:2.0:1786015301.448435:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015301.448479:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280343168 00000100:00100000:2.0:1786015301.448492:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280343168 00010000:00010000:2.0:1786015301.448554:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4fff64 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f7a expref: 30 pid: 5796 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015301.448594:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 188 00000100:00100000:2.0:1786015301.448603:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+30:2351:x1872772280343168:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015301.448618:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015301.448626:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4fff64 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f7a expref: 30 pid: 5796 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015301.448639:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4fff64 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f7a expref: 30 pid: 5796 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015301.448663:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:2.0:1786015301.448669:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c5000b4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015301.448678:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c5000b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015301.448698:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c5000b4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015301.448718:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015301.448796:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+30:2351:x1872772280343168:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 193us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015301.448803:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 188 00000100:00080000:2.0:1786015301.448843:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786015301.449123:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c4fff64 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7f7a expref: 29 pid: 5796 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015301.449141:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383749f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304340736:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015301.449166:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c5000b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015301.449183:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c5000b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015301.449190:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c5000b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015301.449218:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5000bb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015301.449228:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5000bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015301.449237:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5000bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015301.450502:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x28:0x0]: returning size 512 00010000:00010000:1.0:1786015301.450521:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c5000b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015301.450531:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c5000b4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015301.450538:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c5000b4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015301.450544:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386bc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015301.450548:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c5000b4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015301.450557:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c5000b4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015301.450585:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:1.0:1786015301.450588:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015301.450593:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c5000b4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015301.450599:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c5000b4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786015301.450619:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009010aebe reply state 000000003eb1f5f5 transno 4294967733 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5000bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015301.450629:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786015301.450734:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+69:21071:x1872772280343040:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 9420us (9595us total) trans 4294967733 rc 0/0 00000100:00100000:1.0:1786015301.450743:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 661 00010000:00010000:3.0:1786015301.461691:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5000bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.461712:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5000bb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.461719:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5000bb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.461742:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015301.461748:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5000bb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.461756:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5000bb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.461795:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ba86b33 (ffff8b7483ee6c00) 00010000:00010000:3.0:1786015301.461799:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015301.461803:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5000bb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015301.461809:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5000bb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015301.484417:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015301.804160:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304340864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015301.804268:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015301.806869:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304340864 00000100:00100000:2.0:1786015301.806889:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304340864 00000100:00100000:2.0:1786015301.806971:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1786015301.806985:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304340864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015301.807036:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 57868288 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015301.807144:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304340864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (2875us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015301.807152:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1786015301.807227:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304340864:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1786015301.926508:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967733 is committed 00000001:00080000:2.0:1786015301.927276:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967732 is committed 00000100:00100000:2.0:1786015302.076923:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015302.077048:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280343296 00000100:00100000:0.0:1786015302.077062:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280343296 00000100:00100000:0.0:1786015302.077460:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 662 00000100:00100000:0.0:1786015302.077475:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+67:21118:x1872772280343296:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:0.0:1786015302.077513:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015302.077550:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5000c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7ff8 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.077662:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5000c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.077683:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5000c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.077737:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5000c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015302.078047:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1786015302.078053:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015302.078219:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5000c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.078272:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5000c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ff8 expref: 69 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.078293:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5000c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ff8 expref: 68 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.078304:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7482d4bf00) 00010000:00010000:0.0:1786015302.078307:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015302.078312:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7381935e00, rc 0) 00000100:00100000:0.0:1786015302.079825:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+68:21118:x1872772280343296:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 2339us (2900us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015302.079841:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 662 00000100:00100000:2.0:1786015302.091744:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015302.091871:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280343552 00000100:00100000:3.0:1786015302.091883:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280343552 00000100:00100000:3.0:1786015302.091950:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 663 00000100:00100000:3.0:1786015302.091961:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+68:21118:x1872772280343552:12345-192.168.202.56@tcp:36:mkdir.0 00010000:00010000:3.0:1786015302.092041:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015302.092076:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5000c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ff8 expref: 68 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.092114:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7482d4bf00) 00010000:00010000:3.0:1786015302.092127:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015302.092676:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+67:21118:x1872772280343552:12345-192.168.202.56@tcp:36:mkdir.0 Request processed in 713us (946us total) trans 0 rc -17/-17 00000100:00100000:3.0:1786015302.092685:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 663 00000100:00100000:2.0:1786015302.100365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015302.100581:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280343680 00000100:00100000:1.0:1786015302.100597:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280343680 00000100:00100000:1.0:1786015302.100682:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 664 00000100:00100000:1.0:1786015302.100695:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+67:21118:x1872772280343680:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:1.0:1786015302.100725:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015302.100792:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c5000d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e7fff expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.100885:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5000d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.100904:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5000d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.100943:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5000d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015302.101228:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1786015302.101234:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015302.101319:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5000d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.101600:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c5000d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fff expref: 69 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.101624:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5000d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fff expref: 68 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.101635:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:1.0:1786015302.101639:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015302.101643:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf600, rc 0) 00000100:00100000:1.0:1786015302.101733:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+68:21118:x1872772280343680:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 1041us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015302.101743:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 664 00000100:00100000:2.0:1786015302.111456:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015302.111600:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280343808 00000100:00100000:0.0:1786015302.111615:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280343808 00000100:00100000:0.0:1786015302.111706:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 665 00000100:00100000:0.0:1786015302.111718:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+68:21118:x1872772280343808:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:0.0:1786015302.111754:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015302.111842:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5000de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8006 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.112185:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5000e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.112203:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5000e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.112219:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5000e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.112238:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5000ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.112246:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5000ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.112277:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5000ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.112758:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5000f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.112805:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5000f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.112814:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5000f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015302.112937:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x28:0x0]: returning size 7680 00000004:00200000:2.0:1786015302.112943:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015302.113028:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5000f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.113047:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5000e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.113055:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5000e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.113062:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5000e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.113069:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386be00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015302.113075:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5000e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.113084:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5000e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.113106:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:2.0:1786015302.113110:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015302.113116:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5000e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.113123:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5000e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.113138:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5000ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.113144:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5000ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.113151:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5000ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.113156:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386ae00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015302.113160:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5000ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.113166:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5000ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.113173:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ba86b33 (ffff8b749232d200) 00010000:00010000:2.0:1786015302.113176:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015302.113179:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5000ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.113185:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5000ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.113241:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5000de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8006 expref: 70 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.113260:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5000f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8006 expref: 69 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.113268:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff8b749232d000) 00010000:00010000:2.0:1786015302.113270:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015302.113273:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386b000, rc 0) 00000100:00100000:2.0:1786015302.113395:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+69:21118:x1872772280343808:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 1677us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015302.113406:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 665 00000100:00100000:2.0:1786015302.232299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015302.238899:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280343936 00000100:00100000:0.0:1786015302.238927:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280343936 00000100:00100000:0.0:1786015302.239049:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 666 00000100:00100000:0.0:1786015302.239062:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+28:21124:x1872772280343936:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015302.239111:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015302.239148:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935a00/0xb1a5ef690c5000fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e800d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.239271:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500101 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.239292:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500101 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.239308:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500101 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015302.242612:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1786015302.242629:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015302.242819:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500101 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.242875:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935a00/0xb1a5ef690c5000fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e800d expref: 30 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.242903:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500101 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e800d expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.242927:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:1.0:1786015302.242932:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015302.242936:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7381935200, rc 0) 00000100:00100000:1.0:1786015302.243118:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+29:21124:x1872772280343936:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 4057us (10833us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015302.243129:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 666 00000100:00100000:3.0:1786015302.267680:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015302.267862:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280344192 00000100:00100000:1.0:1786015302.267878:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280344192 00000100:00100000:1.0:1786015302.267968:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 667 00000100:00100000:1.0:1786015302.267981:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+69:21124:x1872772280344192:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015302.268016:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015302.268021:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786015302.268060:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5000f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8006 expref: 69 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.268086:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff8b749232d000) 00010000:00010000:1.0:1786015302.268113:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015302.268137:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c500108 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8014 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.269156:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c50010f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.269180:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c50010f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.269196:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c50010f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.269274:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c500116 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.269284:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c500116 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.269293:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c500116 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.270580:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50011d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.270598:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50011d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.270612:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50011d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015302.270627:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 0 00010000:00010000:1.0:1786015302.270666:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c50010f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.270675:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c50010f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.270683:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c50010f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.270692:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bea00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015302.270698:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c50010f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.270720:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c50010f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.270735:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:1.0:1786015302.270738:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015302.270744:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c50010f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.270752:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c50010f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786015302.270814:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008904e737 reply state 000000004616096c transno 4294967734 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c500116 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015302.270827:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786015302.270881:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c500108 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8014 expref: 71 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.270910:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50011d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8014 expref: 70 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.270919:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff8b7483ee6d00) 00010000:00010000:1.0:1786015302.270922:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015302.270924:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bec00, rc 0) 00000100:00100000:1.0:1786015302.271046:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+71:21124:x1872772280344192:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 3067us (3381us total) trans 4294967734 rc 0/0 00000100:00100000:1.0:1786015302.271060:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 667 00010000:00010000:3.0:1786015302.280926:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c500116 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.280953:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c500116 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.280961:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c500116 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.280969:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015302.280976:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c500116 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.280986:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c500116 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.281011:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x4a4b4929 (ffff8b7483ee6f00) 00010000:00010000:3.0:1786015302.281015:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015302.281020:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c500116 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.281027:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c500116 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015302.288975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015302.289145:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280344448 00000100:00100000:2.0:1786015302.289161:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280344448 00000100:00100000:2.0:1786015302.289241:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 668 00000100:00100000:2.0:1786015302.289254:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+70:21124:x1872772280344448:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015302.289297:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015302.289346:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ba00/0xb1a5ef690c50012b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e801b expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.289521:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500132 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.289542:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50011d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8014 expref: 71 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.289590:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500132 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.289641:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50011d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8014 expref: 71 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.289659:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50011d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8014 expref: 71 pid: 5795 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015302.289678:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b748825aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304340992:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015302.289884:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748570ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015302.305253:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b748825aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304340992:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015302.305814:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500132 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015302.311520:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015302.312447:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280344576 00000100:00100000:1.0:1786015302.312464:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280344576 00010000:00010000:1.0:1786015302.312544:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50011d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8014 expref: 72 pid: 5795 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015302.312609:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 189 00000100:00100000:1.0:1786015302.312623:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74865a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+72:2353:x1872772280344576:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015302.312645:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015302.312654:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50011d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8014 expref: 72 pid: 5795 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.312670:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50011d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8014 expref: 72 pid: 5795 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.312701:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50011d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8014 expref: 72 pid: 5795 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.312723:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff8b7483ee6d00) 00010000:00010000:1.0:1786015302.312730:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500132 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.312741:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500132 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.312751:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500132 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015302.312851:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015302.312938:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74865a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+71:2353:x1872772280344576:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 317us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015302.312948:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 189 00010000:00010000:0.0:1786015302.313614:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500132 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.313628:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500132 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015302.313656:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 0 00010000:00010000:0.0:1786015302.314136:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500132 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.314146:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500132 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.314154:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500132 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.314160:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386bc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015302.314166:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500132 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.314175:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500132 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.314213:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff8b7483ee6d00) 00010000:00010000:0.0:1786015302.314216:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015302.314221:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500132 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.314227:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500132 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.314311:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ba00/0xb1a5ef690c50012b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e801b expref: 71 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.314336:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff8b749232d200) 00010000:00010000:0.0:1786015302.314340:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015302.314344:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ba00/0xb1a5ef690c50012b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e801b expref: 71 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.314359:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386ba00, rc 0) 00000100:00100000:0.0:1786015302.314433:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+70:21124:x1872772280344448:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 25181us (25474us total) trans 4294967735 rc 301/301 00000100:00100000:0.0:1786015302.314443:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 668 00000100:00100000:3.0:1786015302.319394:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015302.319805:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280344832 00000100:00100000:2.0:1786015302.319821:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280344832 00000100:00100000:2.0:1786015302.319916:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 137 00000100:00100000:2.0:1786015302.319930:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7487302c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+70:21124:x1872772280344832:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015302.320936:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7487302c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+71:21124:x1872772280344832:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 999us (1552us total) trans 4294967736 rc 0/0 00000100:00100000:2.0:1786015302.320949:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 137 00000100:00100000:2.0:1786015302.325969:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015302.329858:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280344960 00000100:00100000:1.0:1786015302.329887:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280344960 00000100:00100000:0.0:1786015302.330465:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 669 00000100:00100000:0.0:1786015302.330481:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+71:21124:x1872772280344960:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015302.330668:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015302.330712:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c500140 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8022 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.336171:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c500140 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8022 expref: 72 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.336235:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935800/0xb1a5ef690c500140 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8022 expref: 72 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.336273:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff8b7482d4b100) 00010000:00010000:0.0:1786015302.336276:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015302.336282:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7381935800, rc 0) 00000100:00100000:0.0:1786015302.336537:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+72:21124:x1872772280344960:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 6056us (10578us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015302.336856:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 669 00000100:00100000:1.0:1786015302.339942:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015302.340228:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280345216 00000100:00100000:2.0:1786015302.340247:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280345216 00000100:00100000:2.0:1786015302.340351:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 670 00000100:00100000:2.0:1786015302.340367:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+72:21124:x1872772280345216:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1786015302.340495:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c500147 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.340560:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c500147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.340578:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c500147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.340973:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c500147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.340983:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c500147 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.340992:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c500147 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.340999:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386b400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015302.341005:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c500147 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.341015:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c500147 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.341032:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff8b7482d4b100) 00010000:00010000:2.0:1786015302.341036:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1786015302.341042:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c500147 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.341050:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c500147 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015302.341177:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+73:21124:x1872772280345216:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 811us (1254us total) trans 4294967737 rc 0/0 00000100:00100000:2.0:1786015302.341194:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 670 00000100:00100000:2.0:1786015302.348734:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015302.349479:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280345472 00000100:00100000:0.0:1786015302.349503:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280345472 00000100:00100000:0.0:1786015302.349753:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 671 00000100:00100000:0.0:1786015302.349820:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+73:21124:x1872772280345472:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786015302.350289:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50014e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.350313:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50014e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.350899:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50014e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786015302.351025:0:12526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967738 00000004:00010000:0.0:1786015302.351094:0:12526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ad6f09e reply state 00000000910f0433 transno 4294967739 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50014e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015302.351107:0:12526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015302.351348:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+76:21124:x1872772280345472:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 1532us (2625us total) trans 4294967739 rc 0/0 00000100:00100000:0.0:1786015302.351360:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 671 00000020:00080000:0.0:1786015302.351367:0:12526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786015302.371194:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:3.0:1786015302.371303:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50014e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.371334:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50014e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.371343:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50014e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.371350:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381935600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015302.371356:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50014e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.371364:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50014e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.371385:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff8b7482d4b100) 00010000:00010000:3.0:1786015302.371389:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786015302.371395:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50014e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.371402:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50014e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015302.372028:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280345728 00000100:00100000:1.0:1786015302.372044:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280345728 00000100:00100000:1.0:1786015302.372134:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 138 00000100:00100000:1.0:1786015302.372146:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+75:21124:x1872772280345728:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015302.372842:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+76:21124:x1872772280345728:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 693us (1661us total) trans 4294967740 rc 0/0 00000100:00100000:1.0:1786015302.372854:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 138 00000100:00100000:0.0:1786015302.466480:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015302.466806:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280345856 00000100:00100000:2.0:1786015302.466823:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280345856 00000100:00100000:2.0:1786015302.466908:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 672 00000100:00100000:2.0:1786015302.466921:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+76:21127:x1872772280345856:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015302.466961:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015302.466994:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c500155 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8029 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.467136:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50015c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.467154:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50015c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.467171:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50015c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.467192:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c500163 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.467199:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c500163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.467205:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c500163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.467995:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ba00/0xb1a5ef690c50016a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.468015:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ba00/0xb1a5ef690c50016a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015302.468027:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ba00/0xb1a5ef690c50016a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015302.468083:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x28:0x0]: returning size 7680 00000004:00200000:2.0:1786015302.468089:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015302.468718:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ba00/0xb1a5ef690c50016a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.468740:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50015c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.468747:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50015c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.468813:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50015c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.468820:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386b200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015302.468825:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50015c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.468833:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50015c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.468852:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:3.0:1786015302.468855:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015302.468861:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50015c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.468868:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50015c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.468889:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c500163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.468895:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c500163 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.468900:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c500163 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.468906:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386a200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015302.468908:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c500163 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.468925:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c500163 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.468934:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ba86b33 (ffff8b749232d400) 00010000:00010000:3.0:1786015302.468936:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015302.468939:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c500163 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.468945:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c500163 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.468998:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c500155 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8029 expref: 78 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.469015:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ba00/0xb1a5ef690c50016a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8029 expref: 77 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.469024:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff8b749232d700) 00010000:00010000:3.0:1786015302.469026:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786015302.469029:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386ba00, rc 0) 00000100:00100000:3.0:1786015302.469221:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+77:21127:x1872772280345856:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 2301us (2755us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015302.469231:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 672 00000100:00100000:3.0:1786015302.473732:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015302.474063:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280346112 00000100:00100000:0.0:1786015302.474084:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280346112 00000100:00100000:0.0:1786015302.474196:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 673 00000100:00100000:0.0:1786015302.474210:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+77:21127:x1872772280346112:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015302.474244:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015302.474279:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c500171 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8030 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.474432:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c500178 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.474451:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c500178 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.474465:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c500178 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.474488:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50017f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.474496:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50017f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.474503:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50017f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.474730:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935a00/0xb1a5ef690c500186 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.474740:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935a00/0xb1a5ef690c500186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.474748:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935a00/0xb1a5ef690c500186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015302.474799:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 158 00010000:00010000:0.0:1786015302.474935:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c500178 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.474943:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c500178 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.474951:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c500178 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.474958:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381935e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015302.474963:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c500178 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.474971:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c500178 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.474986:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff8b749232d700) 00010000:00010000:0.0:1786015302.474990:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015302.474996:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c500178 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.475015:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c500178 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.475034:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50017f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.475040:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50017f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.475046:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50017f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.475051:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381935600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015302.475054:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50017f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.475060:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50017f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.475066:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x4a4b4929 (ffff8b7482d4b000) 00010000:00010000:0.0:1786015302.475069:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015302.475072:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50017f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.475077:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c50017f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.475126:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c500171 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8030 expref: 80 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.475154:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935a00/0xb1a5ef690c500186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8030 expref: 79 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.475163:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff8b7482d4b100) 00010000:00010000:0.0:1786015302.475165:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015302.475168:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7381935a00, rc 0) 00000100:00100000:0.0:1786015302.475267:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+79:21127:x1872772280346112:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1060us (1561us total) trans 4294967741 rc 0/0 00000100:00100000:0.0:1786015302.475277:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 673 00000100:00100000:2.0:1786015302.487162:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015302.487255:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280346240 00000100:00100000:0.0:1786015302.487268:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280346240 00000100:00100000:0.0:1786015302.487379:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 674 00000100:00100000:0.0:1786015302.487391:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+79:21127:x1872772280346240:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:0.0:1786015302.487507:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c500194 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.487531:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c500194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.487556:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c500194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.487597:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c500194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.487604:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c500194 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.487636:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c500194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.487643:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381934800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015302.487649:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c500194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.487658:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c500194 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.487673:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff8b7482d4b100) 00010000:00010000:0.0:1786015302.487677:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015302.487683:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c500194 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.487690:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c500194 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015302.487842:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+79:21127:x1872772280346240:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 454us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015302.487852:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 674 00000100:00100000:1.0:1786015302.491074:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015302.491284:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280346496 00000100:00100000:3.0:1786015302.491301:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280346496 00000100:00100000:3.0:1786015302.491411:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 139 00000100:00100000:3.0:1786015302.491424:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+79:21127:x1872772280346496:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:3.0:1786015302.498008:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+80:21127:x1872772280346496:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 6319us (6685us total) trans 4294967742 rc 0/0 00000100:00100000:3.0:1786015302.498036:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 139 00010000:00010000:1.0:1786015302.510945:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015302.886299:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015302.886547:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280346752 00000100:00100000:3.0:1786015302.886562:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280346752 00000100:00100000:3.0:1786015302.886650:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 675 00000100:00100000:3.0:1786015302.886662:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+80:21146:x1872772280346752:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015302.886697:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015302.886731:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c50019b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8037 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015302.886988:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x28:0x0]: returning size 7680 00010000:00010000:3.0:1786015302.887172:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c50019b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8037 expref: 82 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.887191:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:3.0:1786015302.887195:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786015302.887201:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c50019b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8037 expref: 82 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015302.887217:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bac00, rc 0) 00000100:00100000:3.0:1786015302.887298:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+81:21146:x1872772280346752:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 638us (1014us total) trans 4294967743 rc 301/301 00000100:00100000:3.0:1786015302.887308:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 675 00000100:00100000:2.0:1786015302.898265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015302.898607:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280346880 00000100:00100000:0.0:1786015302.898622:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280346880 00000100:00100000:0.0:1786015302.898710:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 676 00000100:00100000:0.0:1786015302.898723:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+81:21146:x1872772280346880:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:0.0:1786015302.898893:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.898916:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.898952:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.898972:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.898980:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.898987:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899130:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5001b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899140:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5001b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899148:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5001b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015302.899196:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 158 00000004:00200000:0.0:1786015302.899201:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015302.899219:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5001b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899235:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899243:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899261:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899268:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381934800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015302.899273:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899283:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899296:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff8b749232d700) 00010000:00010000:0.0:1786015302.899300:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015302.899305:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899312:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899339:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899346:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899351:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899356:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381935600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015302.899360:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899378:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899387:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x4a4b4929 (ffff8b7482d4b000) 00010000:00010000:0.0:1786015302.899390:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015302.899392:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899398:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899416:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5001b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899422:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5001b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899428:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5001b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899433:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381935e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015302.899435:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5001b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899441:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5001b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899448:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff8b7482d4b100) 00010000:00010000:0.0:1786015302.899451:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015302.899454:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5001b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015302.899471:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5001b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015302.899584:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+81:21146:x1872772280346880:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 861us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015302.899594:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 676 00000100:00100000:0.0:1786015302.908620:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015302.908801:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280347136 00000100:00100000:1.0:1786015302.908816:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280347136 00000100:00100000:1.0:1786015302.908928:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 140 00000100:00100000:1.0:1786015302.908940:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+81:21146:x1872772280347136:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:1.0:1786015302.910700:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+82:21146:x1872772280347136:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 1745us (2079us total) trans 4294967744 rc 0/0 00000100:00100000:1.0:1786015302.910718:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 140 00010000:00010000:0.0:1786015303.532396:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015304.428112:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015304.428124:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015304.428300:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 15 count 1 00000040:00080000:0.0:1786015304.428324:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015304.560376:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015304.787085:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015304.787143:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015304.787196:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015304.787217:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015304.787237:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015304.787255:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015304.787281:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015304.787341:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280347520 00000100:00100000:3.0:1786015304.787355:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280347520 00000100:00100000:3.0:1786015304.787433:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280348032 00000100:00100000:3.0:1786015304.787437:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280348032 00000100:00100000:3.0:1786015304.787453:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280347648 00000100:00100000:3.0:1786015304.787456:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280347648 00000100:00100000:3.0:1786015304.787471:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280347904 00000100:00100000:3.0:1786015304.787474:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280347904 00000100:00100000:3.0:1786015304.787492:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 264 00000100:00100000:3.0:1786015304.787505:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+10:2354:x1872772280347520:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015304.787856:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280347264 00000100:00100000:1.0:1786015304.787862:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280347264 00000100:00100000:1.0:1786015304.787899:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 361 00000100:00100000:1.0:1786015304.787908:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280347264:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015304.788011:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+10:2354:x1872772280347520:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 508us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015304.788020:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 264 00000100:00100000:3.0:1786015304.788042:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 265 00000100:00100000:3.0:1786015304.788049:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280348032:12345-192.168.202.56@tcp:400:kworker.0 00000100:00080000:2.0:1786015304.788197:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015304.788203:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015304.799746:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280347264:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 11817us (12653us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015304.799786:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 361 00000100:00100000:1.0:1786015304.799979:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 266 00000100:00100000:1.0:1786015304.799999:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+9:2354:x1872772280347648:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015304.800071:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+9:2354:x1872772280347648:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 82us (12814us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015304.800078:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 266 00000100:00100000:1.0:1786015304.800097:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 267 00000100:00100000:1.0:1786015304.800105:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280347904:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015304.800134:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280347904:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (12852us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015304.800142:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 267 00000100:00100000:1.0:1786015304.800166:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280347776 00000100:00100000:1.0:1786015304.800178:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280347776 00000100:00100000:1.0:1786015304.800250:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280347392 00000100:00100000:1.0:1786015304.800255:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280347392 00000100:00100000:1.0:1786015304.800284:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 310 00000100:00100000:1.0:1786015304.800292:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+29:2354:x1872772280347776:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015304.800334:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+29:2354:x1872772280347776:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 42us (13137us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015304.800364:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 310 00000100:00100000:1.0:1786015304.800378:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 311 00000100:00100000:1.0:1786015304.800385:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+82:2354:x1872772280347392:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015304.800417:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+82:2354:x1872772280347392:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (13179us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015304.800423:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 311 00000100:00080000:0.0:1786015304.801428:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015304.809538:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280348032:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21468us (22299us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015304.809558:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 265 00000100:00100000:1.0:1786015304.890935:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786015304.890972:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304341120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015304.891082:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015304.891398:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304341120 00000100:00100000:0.0:1786015304.891413:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304341120 00000100:00100000:0.0:1786015304.891513:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1786015304.891525:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b7e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304341120:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786015304.891675:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1786015304.891714:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015304.891822:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b7e11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304341120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 298us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015304.891830:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1786015304.892265:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304341120:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786015305.581669:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015306.414172:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304341248:0@lo:400:kworker.0 00000100:00100000:3.0:1786015306.414274:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015306.414364:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304341760:0@lo:400:kworker.0 00000100:00100000:3.0:1786015306.414411:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015306.414448:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786015306.414455:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304341632:0@lo:400:kworker.0 00000100:00100000:3.0:1786015306.414631:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015306.414708:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304341376:0@lo:400:kworker.0 00000100:00100000:3.0:1786015306.414736:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015306.414757:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304341888:0@lo:400:kworker.0 00000100:00100000:3.0:1786015306.414804:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015306.414880:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304341504:0@lo:400:kworker.0 00000100:00100000:2.0:1786015306.414915:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015306.414955:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304341760 00000100:00100000:2.0:1786015306.414967:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304341760 00000100:00100000:2.0:1786015306.415035:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304341376 00000100:00100000:2.0:1786015306.415038:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304341376 00000100:00100000:2.0:1786015306.415058:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304341504 00000100:00100000:2.0:1786015306.415061:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304341504 00000100:00100000:2.0:1786015306.415082:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1786015306.415091:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304341760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015306.415156:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304341760:12345-0@lo:400:kworker.0 Request processed in 66us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015306.415164:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1786015306.415186:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1786015306.415192:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304341376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015306.415237:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304341376:12345-0@lo:400:kworker.0 Request processed in 45us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015306.415243:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1786015306.415255:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1786015306.415261:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304341504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015306.415305:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304341504:12345-0@lo:400:kworker.0 Request processed in 43us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015306.415311:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00080000:2.0:1786015306.415328:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015306.415363:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304341504:0@lo:400:kworker.0 00000100:00100000:2.0:1786015306.415414:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304341760:0@lo:400:kworker.0 00000100:00100000:2.0:1786015306.417869:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304341248 00000100:00100000:2.0:1786015306.417892:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304341248 00000100:00100000:2.0:1786015306.417974:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1786015306.417986:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304341248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015306.418103:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304341248:12345-0@lo:400:kworker.0 Request processed in 120us (3829us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015306.418111:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1786015306.418187:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304341248:0@lo:400:kworker.0 00000100:00100000:3.0:1786015306.425635:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304341376:0@lo:400:kworker.0 00000100:00100000:0.0:1786015306.427586:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304341632 00000100:00100000:0.0:1786015306.427603:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304341632 00000100:00100000:0.0:1786015306.427708:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304341888 00000100:00100000:0.0:1786015306.427713:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304341888 00000100:00100000:0.0:1786015306.427746:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1786015306.427773:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304341632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015306.427922:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304341632:12345-0@lo:400:kworker.0 Request processed in 166us (13289us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015306.427931:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1786015306.427952:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1786015306.427960:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304341888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015306.428001:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304341888:12345-0@lo:400:kworker.0 Request processed in 42us (13196us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015306.428006:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:0.0:1786015306.428042:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015306.428046:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015306.428091:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304341632:0@lo:400:kworker.0 00000100:00100000:0.0:1786015306.428137:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304341888:0@lo:400:kworker.0 00010000:00010000:2.0:1786015306.603969:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015306.925609:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b748825ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304342016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015306.925695:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015306.925985:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304342016 00000100:00100000:1.0:1786015306.926003:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304342016 00000100:00100000:1.0:1786015306.926826:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1786015306.926851:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304342016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015306.926914:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 57868288 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015306.927032:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304342016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 193us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015306.927042:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1786015306.927486:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b748825ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304342016:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1786015307.058604:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967741 is committed 00000001:00080000:2.0:1786015307.058643:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967744 is committed 00010000:00010000:0.0:1786015307.634233:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015308.652991:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015309.676041:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015309.892644:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015309.892912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015309.892950:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015309.892989:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015309.893016:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015309.893059:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015309.893085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015309.893117:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280348160 00000100:00100000:1.0:1786015309.893127:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280348160 00000100:00100000:1.0:1786015309.893176:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 363 00000100:00100000:1.0:1786015309.893186:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280348160:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015309.893277:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280348544 00000100:00100000:0.0:1786015309.893284:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280348544 00000100:00100000:1.0:1786015309.893293:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280348160:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 106us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015309.893302:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 363 00000100:00100000:0.0:1786015309.893333:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280348800 00000100:00100000:0.0:1786015309.893337:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280348800 00000100:00100000:1.0:1786015309.893341:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280348416 00000100:00100000:1.0:1786015309.893347:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280348416 00000100:00100000:0.0:1786015309.893369:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280348928 00000100:00100000:0.0:1786015309.893374:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280348928 00000100:00100000:1.0:1786015309.893378:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 270 00000100:00100000:1.0:1786015309.893388:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+9:2354:x1872772280348544:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015309.893404:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 271 00000100:00100000:0.0:1786015309.893415:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280348800:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015309.893422:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+9:2354:x1872772280348544:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 35us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015309.893429:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 270 00000100:00100000:1.0:1786015309.893445:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 272 00000100:00100000:0.0:1786015309.893456:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280348800:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 40us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015309.893457:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+10:2354:x1872772280348416:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015309.893472:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 271 00000100:00100000:0.0:1786015309.893487:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 273 00000100:00100000:0.0:1786015309.893501:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280348928:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015309.893525:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280348928:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015309.893530:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 273 00000100:00080000:0.0:1786015309.893563:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015309.893567:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015309.893678:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280348288 00000100:00100000:2.0:1786015309.893684:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280348288 00000100:00100000:2.0:1786015309.893729:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280348672 00000100:00100000:2.0:1786015309.893732:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280348672 00000100:00100000:2.0:1786015309.893750:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 315 00000100:00100000:2.0:1786015309.893757:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+71:2354:x1872772280348288:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015309.893809:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+71:2354:x1872772280348288:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 52us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015309.893815:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 315 00000100:00100000:2.0:1786015309.893827:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 316 00000100:00100000:2.0:1786015309.893833:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+29:2354:x1872772280348672:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015309.893852:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+29:2354:x1872772280348672:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 19us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015309.893858:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 316 00000100:00080000:0.0:1786015309.895046:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015309.895134:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+10:2354:x1872772280348416:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 1679us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015309.895143:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 272 00000100:00100000:3.0:1786015309.996379:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786015309.996411:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304342144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015309.996489:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015309.997353:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304342144 00000100:00100000:0.0:1786015309.997364:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304342144 00000100:00100000:0.0:1786015309.997443:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1786015309.997452:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304342144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015309.997489:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015309.997553:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304342144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015309.997560:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1786015309.997656:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304342144:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786015309.997683:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786015310.700015:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015311.438987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015311.439044:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280349056 00000100:00100000:3.0:1786015311.439055:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280349056 00002000:00100000:3.0:1786015311.439122:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xd:0x0] (0->157) req@ffff8b74af068380 x1872772280349056/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:157/0 lens 648/0 e 0 to 0 dl 1786015322 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015311.439135:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74af068380 with x1872772280349056 ext(0->157) 00002000:00010000:3.0:1786015311.439142:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74af068380 00000100:00100000:3.0:1786015311.439171:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:3.0:1786015311.439183:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280349056:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:3.0:1786015311.440402:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2352:x1872772280349056:12345-192.168.202.56@tcp:4:cp.0 Request processed in 1213us (1416us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1786015311.440494:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 56 00002000:00100000:3.0:1786015311.440505:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xd:0x0] (0->157) req@ffff8b74af068380 x1872772280349056/t4294967325(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:157/0 lens 648/448 e 0 to 0 dl 1786015322 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015311.440515:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74af068380 with x1872772280349056 ext(0->157) 00002000:00010000:3.0:1786015311.440519:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74af068380 00000100:00080000:3.0:1786015311.440620:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015311.534658:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304342272:0@lo:400:kworker.0 00000100:00100000:3.0:1786015311.534754:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015311.534837:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304342784:0@lo:400:kworker.0 00000100:00100000:3.0:1786015311.534867:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015311.534903:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786015311.534910:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304342656:0@lo:400:kworker.0 00000100:00100000:3.0:1786015311.534937:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015311.534970:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304342400:0@lo:400:kworker.0 00000100:00100000:3.0:1786015311.534995:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015311.535016:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304342912:0@lo:400:kworker.0 00000100:00100000:3.0:1786015311.535038:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015311.535059:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015311.535065:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304342528:0@lo:400:kworker.0 00000100:00100000:3.0:1786015311.535091:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015311.535132:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304342272 00000100:00100000:3.0:1786015311.535141:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304342272 00000100:00100000:3.0:1786015311.535203:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1786015311.535212:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304342272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015311.535301:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304342272:12345-0@lo:400:kworker.0 Request processed in 89us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015311.535308:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1786015311.535360:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304342784 00000100:00100000:3.0:1786015311.535364:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304342784 00000100:00100000:3.0:1786015311.535405:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304342400 00000100:00100000:3.0:1786015311.535408:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304342400 00000100:00100000:3.0:1786015311.535427:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304342528 00000100:00100000:3.0:1786015311.535430:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304342528 00000100:00100000:3.0:1786015311.535448:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1786015311.535453:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304342784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015311.535488:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304342784:12345-0@lo:400:kworker.0 Request processed in 34us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015311.535494:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1786015311.535506:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1786015311.535512:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304342400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015311.535543:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304342400:12345-0@lo:400:kworker.0 Request processed in 31us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015311.535549:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1786015311.535561:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1786015311.535567:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304342528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015311.535596:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304342528:12345-0@lo:400:kworker.0 Request processed in 29us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015311.535602:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1786015311.535620:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304342656 00000100:00100000:3.0:1786015311.535623:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304342656 00000100:00100000:3.0:1786015311.535647:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304342912 00000100:00100000:3.0:1786015311.535656:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304342912 00000100:00100000:3.0:1786015311.535682:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1786015311.535688:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304342656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015311.535722:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304342656:12345-0@lo:400:kworker.0 Request processed in 34us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015311.535727:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1786015311.535738:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1786015311.535743:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304342912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015311.535795:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304342912:12345-0@lo:400:kworker.0 Request processed in 51us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015311.535801:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1786015311.535856:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304342656:0@lo:400:kworker.0 00000100:00100000:3.0:1786015311.535866:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304342272:0@lo:400:kworker.0 00000100:00100000:3.0:1786015311.535876:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304342784:0@lo:400:kworker.0 00000100:00080000:3.0:1786015311.535905:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015311.535911:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786015311.535913:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015311.535945:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304342528:0@lo:400:kworker.0 00000100:00100000:3.0:1786015311.535956:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304342400:0@lo:400:kworker.0 00000100:00100000:3.0:1786015311.535966:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304342912:0@lo:400:kworker.0 00010000:00010000:0.0:1786015311.727144:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786015311.991124:0:16626:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 11b: Import a deleted file using its FID ========================================================== 07:21:49 (1786015309) 00000100:00100000:0.0:1786015312.044027:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015312.044060:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b748825ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304343040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015312.044182:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015312.044345:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304343040 00000100:00100000:0.0:1786015312.044356:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304343040 00000100:00100000:0.0:1786015312.044431:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1786015312.044445:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304343040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015312.044501:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 57868288 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015312.044561:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304343040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015312.044570:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1786015312.044648:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b748825ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304343040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015312.351828:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015312.352035:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280349312 00000100:00100000:0.0:1786015312.352050:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280349312 00000100:00100000:0.0:1786015312.352152:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 677 00000100:00100000:0.0:1786015312.352165:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+29:21767:x1872772280349312:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015312.352195:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015312.352225:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5001be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e803e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.352353:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001c5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.352371:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.352386:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.352405:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001cc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.352412:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.352418:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.352991:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5001d3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.353004:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5001d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.353022:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5001d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015312.353035:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1786015312.353286:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.353297:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001c5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.353304:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001c5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.353312:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381935600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015312.353318:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001c5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.353327:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001c5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.353344:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b749802e100) 00010000:00010000:0.0:1786015312.353347:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015312.353353:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.353359:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935600/0xb1a5ef690c5001c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.353375:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.353380:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001cc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.353394:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.353399:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381934800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015312.353402:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.353408:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001cc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.353417:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8b7482d4bd00) 00010000:00010000:0.0:1786015312.353420:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015312.353422:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001cc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.353428:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934800/0xb1a5ef690c5001cc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.354024:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5001be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e803e expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.354050:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5001d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e803e expref: 31 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.354059:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:0.0:1786015312.354062:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015312.354065:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6800, rc 0) 00000100:00100000:0.0:1786015312.354182:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+31:21767:x1872772280349312:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 2018us (2369us total) trans 4294967745 rc 0/0 00000100:00100000:0.0:1786015312.354203:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 677 00000100:00080000:1.0:1786015312.354361:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015312.362756:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015312.362911:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280349440 00000100:00100000:3.0:1786015312.362924:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280349440 00000100:00100000:3.0:1786015312.363006:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 678 00000100:00100000:3.0:1786015312.363041:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+31:21767:x1872772280349440:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1786015312.363193:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+31:21767:x1872772280349440:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 156us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015312.363202:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 678 00000100:00100000:3.0:1786015312.373898:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015312.374011:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280349568 00000100:00100000:2.0:1786015312.374026:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280349568 00000100:00100000:2.0:1786015312.374120:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:2.0:1786015312.374133:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+31:2352:x1872772280349568:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015312.374156:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015312.374193:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5001d3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e803e expref: 31 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.374218:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:2.0:1786015312.374282:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015312.374383:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+30:2352:x1872772280349568:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 248us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015312.374391:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:0.0:1786015312.392913:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015312.393045:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280349696 00000100:00100000:3.0:1786015312.393060:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280349696 00000100:00100000:3.0:1786015312.393154:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 679 00000100:00100000:3.0:1786015312.393168:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+71:21768:x1872772280349696:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015312.393201:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015312.393245:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5001e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8045 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393372:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5001e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393395:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5001e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393422:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5001e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393440:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c5001ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393448:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c5001ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393455:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c5001ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393860:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5001e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393870:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5001e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393878:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5001e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393884:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bac00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015312.393889:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5001e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393897:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5001e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393911:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:3.0:1786015312.393913:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015312.393918:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5001e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393925:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c5001e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393938:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c5001ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393943:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c5001ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393949:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c5001ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393960:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015312.393963:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c5001ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393970:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c5001ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393978:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbc29f2cb (ffff8b74a04b5b00) 00010000:00010000:3.0:1786015312.393980:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015312.393983:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c5001ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.393989:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c5001ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.394029:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5001e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8045 expref: 72 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.394041:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:3.0:1786015312.394044:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015312.394047:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5001e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8045 expref: 72 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.394057:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb800, rc 0) 00000100:00100000:3.0:1786015312.394140:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+71:21768:x1872772280349696:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 976us (1245us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015312.394148:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 679 00000100:00080000:1.0:1786015312.395330:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015312.400474:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015312.400669:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280349952 00000100:00100000:2.0:1786015312.400684:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280349952 00000100:00100000:2.0:1786015312.400800:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 680 00000100:00100000:2.0:1786015312.400812:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+71:21768:x1872772280349952:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:2.0:1786015312.400897:0:7673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015312.400936:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5000d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7fff expref: 71 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.400961:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:2.0:1786015312.400967:0:7673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015312.401622:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5001f6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.401645:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500101 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e800d expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.401655:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5001f6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.401708:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500101 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e800d expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.401727:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500101 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e800d expref: 29 pid: 5796 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015312.401811:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b748825ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304343168:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015312.401943:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748570a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786015312.407249:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015312.407757:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280350080 00000100:00100000:1.0:1786015312.407802:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280350080 00010000:00010000:1.0:1786015312.407880:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500101 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e800d expref: 30 pid: 5796 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015312.407995:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 190 00000100:00100000:1.0:1786015312.408008:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+30:2354:x1872772280350080:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015312.408030:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015312.408040:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500101 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e800d expref: 30 pid: 5796 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.408056:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500101 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e800d expref: 30 pid: 5796 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.408087:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:1.0:1786015312.408094:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5001f6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.408107:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5001f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.408116:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5001f6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.408140:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015312.408219:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+30:2354:x1872772280350080:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 214us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015312.408227:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 190 00010000:00010000:3.0:1786015312.408601:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500101 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e800d expref: 29 pid: 5796 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015312.408632:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b748825ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304343168:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015312.408663:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5001f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.408673:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5001f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.409364:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5001f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.409402:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5001fd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.409423:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5001fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.409435:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5001fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015312.412964:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 512 00010000:00010000:2.0:1786015312.412996:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5001f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.413009:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5001f6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.413018:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5001f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.413025:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386b000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015312.413030:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5001f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.413039:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5001f6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.413065:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:2.0:1786015312.413068:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015312.413074:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5001f6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.413080:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5001f6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015312.413112:0:7673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2a1c126 reply state 00000000c4fc1966 transno 4294967746 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5001fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015312.413139:0:7673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786015312.413508:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+72:21768:x1872772280349952:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 12690us (13043us total) trans 4294967746 rc 0/0 00000100:00100000:2.0:1786015312.413519:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 680 00000100:00100000:2.0:1786015312.425112:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015312.425289:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280350208 00000100:00100000:1.0:1786015312.425305:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280350208 00000100:00100000:1.0:1786015312.425577:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 681 00000100:00100000:1.0:1786015312.425611:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+72:21769:x1872772280350208:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1786015312.425647:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015312.425895:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500204 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e804c expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.425995:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c50020b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.426012:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c50020b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.426027:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c50020b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015312.426113:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1786015312.426118:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 19 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015312.426149:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c50020b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.426181:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500204 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e804c expref: 74 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.426205:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c50020b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e804c expref: 73 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.426215:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6700) 00010000:00010000:1.0:1786015312.426218:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015312.426222:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bea00, rc 0) 00000100:00100000:1.0:1786015312.426398:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+73:21769:x1872772280350208:12345-192.168.202.56@tcp:101:bash.0 Request processed in 713us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015312.426429:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 681 00010000:00010000:3.0:1786015312.427112:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5001fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.427126:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5001fd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.427133:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5001fd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.427139:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015312.427145:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5001fd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.427165:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5001fd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.427182:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbc29f2cb (ffff8b74a04b5b00) 00010000:00010000:3.0:1786015312.427186:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015312.427191:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5001fd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.427197:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5001fd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015312.433553:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015312.433673:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280350336 00000100:00100000:3.0:1786015312.433745:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280350336 00000100:00100000:2.0:1786015312.434054:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 682 00000100:00100000:2.0:1786015312.434069:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+72:21769:x1872772280350336:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1786015312.434099:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015312.434128:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c500212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8053 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434218:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c500219 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434248:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c500219 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434263:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c500219 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434280:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c500220 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434287:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c500220 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434293:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c500220 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434504:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500227 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434514:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434521:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015312.434564:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 512 00000004:00200000:2.0:1786015312.434569:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015312.434602:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434617:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c500219 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434624:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c500219 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434630:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c500219 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434637:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386ae00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015312.434642:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c500219 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434650:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c500219 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434664:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6700) 00010000:00010000:2.0:1786015312.434673:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015312.434692:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c500219 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434700:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c500219 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434716:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c500220 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434721:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c500220 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434727:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c500220 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434732:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386be00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015312.434735:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c500220 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434740:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c500220 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434748:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbc29f2cb (ffff8b749232d500) 00010000:00010000:2.0:1786015312.434750:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015312.434753:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c500220 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434791:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c500220 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434832:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c500212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8053 expref: 74 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434859:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386bc00/0xb1a5ef690c500227 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8053 expref: 73 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.434867:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:2.0:1786015312.434869:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786015312.434872:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386bc00, rc 0) 00000100:00100000:2.0:1786015312.434965:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+73:21769:x1872772280350336:12345-192.168.202.56@tcp:101:bash.0 Request processed in 899us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015312.434974:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 682 00000100:00100000:0.0:1786015312.442129:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015312.442954:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280350464 00000100:00100000:3.0:1786015312.442972:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280350464 00000100:00100000:1.0:1786015312.443061:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 683 00000100:00100000:1.0:1786015312.443076:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+73:21769:x1872772280350464:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1786015312.443108:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015312.443143:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c50022e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e805a expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443302:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500235 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443335:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500235 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443350:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500235 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443601:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c50023c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443611:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c50023c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443618:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c50023c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443734:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500235 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443742:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500235 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443805:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500235 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443812:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813be200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015312.443817:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500235 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443827:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500235 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443843:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:1.0:1786015312.443847:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015312.443854:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500235 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443861:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500235 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443877:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c50023c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443884:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c50023c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443889:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c50023c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443895:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bfa00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015312.443898:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c50023c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443915:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c50023c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443924:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff8b7483ee6e00) 00010000:00010000:1.0:1786015312.443927:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015312.443930:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c50023c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443936:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c50023c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443983:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c50022e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e805a expref: 74 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.443995:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:1.0:1786015312.443997:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015312.444001:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c50022e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e805a expref: 74 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.444011:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bfc00, rc 0) 00000100:00100000:1.0:1786015312.444098:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+73:21769:x1872772280350464:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1025us (1986us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015312.444108:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 683 00000100:00100000:0.0:1786015312.451181:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015312.451303:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280350592 00000100:00100000:1.0:1786015312.451328:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280350592 00000100:00100000:2.0:1786015312.451571:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 684 00000100:00100000:2.0:1786015312.451588:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+29:21770:x1872772280350592:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015312.451620:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015312.451653:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c500243 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8061 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.451794:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50024a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.451812:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50024a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.451827:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50024a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015312.451921:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1786015312.451926:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 19 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015312.451959:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50024a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.452010:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c500243 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8061 expref: 31 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.452035:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50024a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8061 expref: 30 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.452045:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6700) 00010000:00010000:2.0:1786015312.452049:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015312.452054:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386a200, rc 0) 00000100:00100000:2.0:1786015312.452146:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+30:21770:x1872772280350592:12345-192.168.202.56@tcp:101:rm.0 Request processed in 563us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015312.452155:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 684 00000100:00100000:0.0:1786015312.455048:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015312.455141:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280350720 00000100:00100000:2.0:1786015312.455154:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280350720 00000100:00100000:2.0:1786015312.455237:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 685 00000100:00100000:2.0:1786015312.455251:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+30:21770:x1872772280350720:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015312.455279:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015312.455308:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c500251 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8068 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.455511:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500258 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.455530:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500258 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.455543:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500258 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.455570:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907a00/0xb1a5ef690c50025f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.455579:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907a00/0xb1a5ef690c50025f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.455586:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907a00/0xb1a5ef690c50025f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.455913:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907800/0xb1a5ef690c500266 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.455923:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907800/0xb1a5ef690c500266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.455931:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907800/0xb1a5ef690c500266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015312.455973:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 512 00000004:00200000:2.0:1786015312.455978:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015312.456008:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907800/0xb1a5ef690c500266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.456023:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500258 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.456030:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500258 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.456038:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500258 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.456055:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015312.456060:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500258 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.456068:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500258 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.456083:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6700) 00010000:00010000:2.0:1786015312.456086:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015312.456092:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500258 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.456099:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500258 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.456114:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907a00/0xb1a5ef690c50025f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.456120:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907a00/0xb1a5ef690c50025f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.456125:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907a00/0xb1a5ef690c50025f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.456130:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015312.456132:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907a00/0xb1a5ef690c50025f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.456138:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907a00/0xb1a5ef690c50025f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.456157:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbc29f2cb (ffff8b749232d000) 00010000:00010000:2.0:1786015312.456160:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015312.456163:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907a00/0xb1a5ef690c50025f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.456169:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907a00/0xb1a5ef690c50025f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.456212:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c500251 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8068 expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.456241:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907800/0xb1a5ef690c500266 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8068 expref: 31 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.456249:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:2.0:1786015312.456252:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786015312.456255:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907800, rc 0) 00000100:00100000:2.0:1786015312.456351:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+31:21770:x1872772280350720:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1102us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015312.456360:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 685 00000100:00100000:0.0:1786015312.460556:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015312.460658:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280350848 00000100:00100000:1.0:1786015312.460673:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280350848 00000100:00100000:1.0:1786015312.460784:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 686 00000100:00100000:1.0:1786015312.460796:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+31:21770:x1872772280350848:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:1.0:1786015312.460852:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015312.460888:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c50026d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e806f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.460995:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500274 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461013:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500274 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461027:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500274 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461044:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50027b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461051:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50027b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461058:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50027b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461147:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500274 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461156:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500274 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461163:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500274 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461169:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bfa00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015312.461181:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500274 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461190:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500274 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461204:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:1.0:1786015312.461207:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015312.461212:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500274 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461219:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500274 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461248:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50027b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461255:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50027b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461261:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50027b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461266:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813be200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015312.461269:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50027b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461275:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50027b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461282:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff8b7483ee6e00) 00010000:00010000:1.0:1786015312.461285:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015312.461295:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50027b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461301:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50027b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461345:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c50026d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e806f expref: 32 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461356:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:1.0:1786015312.461359:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015312.461363:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c50026d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e806f expref: 32 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.461373:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bfc00, rc 0) 00000100:00100000:1.0:1786015312.461466:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+31:21770:x1872772280350848:12345-192.168.202.56@tcp:101:rm.0 Request processed in 672us (925us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015312.461476:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 686 00000100:00100000:0.0:1786015312.465281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015312.465387:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280350976 00000100:00100000:1.0:1786015312.465402:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280350976 00000100:00100000:1.0:1786015312.465521:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 687 00000100:00100000:1.0:1786015312.465535:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+31:21770:x1872772280350976:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:1.0:1786015312.465568:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015312.465605:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500282 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8076 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.465887:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c500289 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.465933:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c500289 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.465948:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c500289 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.465968:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500290 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.465976:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.465983:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.466078:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c500289 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.466087:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c500289 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.466095:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c500289 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.466102:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813be000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015312.466107:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c500289 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.466116:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c500289 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.466132:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:1.0:1786015312.466142:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015312.466149:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c500289 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.466156:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c500289 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.466175:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.466181:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500290 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.466187:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.466193:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015312.466197:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.466204:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500290 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.466212:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff8b7483ee6100) 00010000:00010000:1.0:1786015312.466215:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015312.466218:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500290 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.466224:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500290 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.466284:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500282 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8076 expref: 32 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.466303:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:1.0:1786015312.466306:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015312.466310:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500282 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8076 expref: 32 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.466320:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bec00, rc 0) 00000100:00100000:1.0:1786015312.466404:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+31:21770:x1872772280350976:12345-192.168.202.56@tcp:101:rm.0 Request processed in 871us (1138us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015312.466547:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 687 00000100:00100000:0.0:1786015312.488403:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015312.488543:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280351104 00000100:00100000:2.0:1786015312.488557:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280351104 00000100:00100000:2.0:1786015312.488640:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 688 00000100:00100000:2.0:1786015312.488652:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+31:21771:x1872772280351104:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015312.488698:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015312.488734:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907a00/0xb1a5ef690c500297 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e807d expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.488937:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50029e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.488959:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50029e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.488974:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50029e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.488994:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c5002a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.489001:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c5002a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.489007:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c5002a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.489111:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50029e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.489119:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50029e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.489126:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50029e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.489133:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015312.489137:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50029e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.489159:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50029e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.489177:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:2.0:1786015312.489181:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015312.489187:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50029e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.489193:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50029e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.489209:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c5002a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.489215:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c5002a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.489221:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c5002a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.489226:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015312.489240:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c5002a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.489246:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c5002a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.489253:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff8b749232d000) 00010000:00010000:2.0:1786015312.489255:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015312.489257:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c5002a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.489271:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c5002a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.489323:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907a00/0xb1a5ef690c500297 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e807d expref: 32 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.489336:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:2.0:1786015312.489338:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015312.489342:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907a00/0xb1a5ef690c500297 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e807d expref: 32 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.489354:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907a00, rc 0) 00000100:00100000:2.0:1786015312.489439:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+31:21771:x1872772280351104:12345-192.168.202.56@tcp:101:cp.0 Request processed in 788us (1055us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015312.489449:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 688 00000100:00100000:0.0:1786015312.492701:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015312.492914:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280351232 00000100:00100000:2.0:1786015312.492927:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280351232 00000100:00100000:2.0:1786015312.493006:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 689 00000100:00100000:2.0:1786015312.493018:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+31:21771:x1872772280351232:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015312.493049:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015312.493080:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5002ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8084 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493172:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906200/0xb1a5ef690c5002b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493189:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906200/0xb1a5ef690c5002b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493225:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906200/0xb1a5ef690c5002b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493256:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c5002ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493264:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c5002ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493271:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c5002ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493369:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906200/0xb1a5ef690c5002b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493377:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906200/0xb1a5ef690c5002b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493384:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906200/0xb1a5ef690c5002b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493390:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015312.493395:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906200/0xb1a5ef690c5002b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493403:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906200/0xb1a5ef690c5002b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493430:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:2.0:1786015312.493433:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015312.493439:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906200/0xb1a5ef690c5002b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493452:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906200/0xb1a5ef690c5002b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493470:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c5002ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493476:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c5002ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493483:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c5002ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493488:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015312.493491:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c5002ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493497:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c5002ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493505:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff8b749232d500) 00010000:00010000:2.0:1786015312.493507:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015312.493510:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c5002ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493516:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c5002ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493559:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5002ac lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8084 expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493583:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:2.0:1786015312.493585:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015312.493590:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5002ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8084 expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015312.493600:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906000, rc 0) 00000100:00100000:2.0:1786015312.493678:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+31:21771:x1872772280351232:12345-192.168.202.56@tcp:101:cp.0 Request processed in 662us (1004us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015312.493687:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 689 00000100:00100000:0.0:1786015312.498565:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015312.498692:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280351488 00000100:00100000:1.0:1786015312.498707:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280351488 00000100:00100000:1.0:1786015312.499162:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 690 00000100:00100000:1.0:1786015312.499177:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+31:21771:x1872772280351488:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015312.499209:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015312.499249:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5002c1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e808b expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.499572:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5002c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.499590:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5002c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.499604:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5002c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.499624:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5002cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.499649:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5002cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.499656:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5002cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786015312.503265:0:7673:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe:0x0], index 0: 0 00010000:00010000:0.0:1786015312.503876:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5002d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.503902:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5002d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.503919:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5002d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.503978:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5002c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.503987:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5002c8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.504014:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5002c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.504022:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015312.504029:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5002c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.504041:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5002c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.504057:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:0.0:1786015312.504061:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015312.504066:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5002c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.504073:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5002c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015312.504092:0:7673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000068d7045d reply state 00000000f492cd79 transno 4294967747 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5002cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015312.504103:0:7673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786015312.504157:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5002c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e808b expref: 34 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.504176:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5002d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e808b expref: 33 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.504185:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8b7482d4bd00) 00010000:00010000:0.0:1786015312.504194:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015312.504197:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6800, rc 0) 00000100:00100000:0.0:1786015312.504448:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+34:21771:x1872772280351488:12345-192.168.202.56@tcp:101:cp.0 Request processed in 5273us (5898us total) trans 4294967747 rc 0/0 00000100:00100000:0.0:1786015312.504458:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 690 00000100:00100000:0.0:1786015312.509517:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:3.0:1786015312.510093:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5002cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.510110:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5002cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.510119:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5002cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.510127:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813be000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015312.510133:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5002cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.510144:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5002cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.510196:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff8b7483ee6100) 00010000:00010000:3.0:1786015312.510200:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015312.510206:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5002cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.510213:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5002cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015312.510545:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280351616 00000100:00100000:1.0:1786015312.510562:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280351616 00000100:00100000:1.0:1786015312.510655:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 169 00000100:00100000:1.0:1786015312.510669:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280351616:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015312.510695:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015312.510720:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004909ae9a/0xb1a5ef690c5002e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8092 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015312.510755:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786015312.510814:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=547s v=(0 0) 00010000:00010000:1.0:1786015312.510819:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015312.510831:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004909ae9a/0xb1a5ef690c5002e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8092 expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.510854:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004909ae9a/0xb1a5ef690c5002e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8092 expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.510869:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bfc00, rc 0) 00000100:00100000:1.0:1786015312.510965:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280351616:12345-192.168.202.56@tcp:101:cp.0 Request processed in 298us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015312.510987:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 169 00000100:00100000:2.0:1786015312.514521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015312.515252:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280351744 00000100:00100000:0.0:1786015312.515272:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280351744 00000100:00100000:0.0:1786015312.515509:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 170 00000100:00100000:0.0:1786015312.515524:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:21771:x1872772280351744:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015312.515562:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015312.515597:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc3c3574/0xb1a5ef690c5002eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8099 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.515650:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004909ae9a/0xb1a5ef690c5002e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8092 expref: 12 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.515662:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015312.515667:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015312.515674:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc3c3574/0xb1a5ef690c5002eb lrc: 4/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8099 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.515738:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004909ae9a/0xb1a5ef690c5002e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8092 expref: 12 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.515757:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004909ae9a/0xb1a5ef690c5002e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8092 expref: 12 pid: 6591 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015312.515840:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304343296:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015312.515984:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b73826a4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786015312.518508:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304343296:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015312.518568:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fc3c3574/0xb1a5ef690c5002eb lrc: 3/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8099 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.518599:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e7000, rc 0) 00000100:00100000:0.0:1786015312.518687:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:21771:x1872772280351744:12345-192.168.202.56@tcp:101:cp.0 Request processed in 3166us (4189us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015312.518698:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 170 00000100:00100000:2.0:1786015312.521911:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015312.522089:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280351872 00000100:00100000:3.0:1786015312.522104:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280351872 00010000:00010000:3.0:1786015312.522160:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004909ae9a/0xb1a5ef690c5002e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8092 expref: 12 pid: 6591 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015312.522205:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 191 00000100:00100000:3.0:1786015312.522216:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280351872:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015312.522247:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015312.522282:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004909ae9a/0xb1a5ef690c5002e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8092 expref: 12 pid: 6591 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.522300:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004909ae9a/0xb1a5ef690c5002e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8092 expref: 12 pid: 6591 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.522341:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004909ae9a/0xb1a5ef690c5002e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8092 expref: 12 pid: 6591 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.522366:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015312.522387:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015312.522400:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc3c3574/0xb1a5ef690c5002eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8099 expref: 11 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.522422:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc3c3574/0xb1a5ef690c5002eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8099 expref: 11 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.522477:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fc3c3574/0xb1a5ef690c5002eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8099 expref: 11 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015312.522494:0:5781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f1bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5781:1872772304343424:192.168.202.56@tcp:105: 00000100:00100000:3.0:1786015312.522605:0:5781:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7381ffb780 going to sleep for 11 seconds 00000100:00100000:2.0:1786015312.526384:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015312.526496:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280352128 00000100:00100000:1.0:1786015312.526511:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280352128 00000100:00100000:1.0:1786015312.526625:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 141 00000100:00100000:1.0:1786015312.526639:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+33:21771:x1872772280352128:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:1.0:1786015312.527240:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+34:21771:x1872772280352128:12345-192.168.202.56@tcp:35:cp.0 Request processed in 592us (862us total) trans 4294967748 rc 0/0 00000100:00100000:1.0:1786015312.527249:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 141 00000100:00100000:3.0:1786015312.528169:0:5781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f1bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5781:1872772304343424:192.168.202.56@tcp:105: 00010000:00010000:3.0:1786015312.528211:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015312.528280:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280351872:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 6064us (6382us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015312.528294:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 191 00000100:00100000:2.0:1786015312.581722:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015312.581894:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280352256 00000100:00100000:1.0:1786015312.581911:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280352256 00000100:00100000:1.0:1786015312.582006:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 691 00000100:00100000:1.0:1786015312.582019:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+73:21774:x1872772280352256:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015312.582050:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015312.582083:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c5002f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e80a0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582210:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5002f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582238:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5002f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582254:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5002f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582272:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c500300 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582292:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c500300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582299:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c500300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582453:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c500307 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582463:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c500307 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582470:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c500307 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015312.582519:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 158 00000004:00200000:1.0:1786015312.582524:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015312.582550:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c500307 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582564:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c500307 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582575:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5002f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582583:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5002f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582592:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5002f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582612:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bfa00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015312.582617:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5002f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582627:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5002f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582644:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:1.0:1786015312.582647:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015312.582653:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5002f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582659:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5002f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582679:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c500300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582686:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c500300 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582692:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c500300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582698:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bfc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015312.582700:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c500300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582707:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c500300 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582727:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff8b7483ee6000) 00010000:00010000:1.0:1786015312.582730:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015312.582733:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c500300 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582739:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c500300 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582975:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c5002f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80a0 expref: 75 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.582994:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c500307 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80a0 expref: 74 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.583003:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8b7482d4bd00) 00010000:00010000:1.0:1786015312.583006:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015312.583008:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813be000, rc 0) 00000100:00100000:1.0:1786015312.583517:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+74:21774:x1872772280352256:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1496us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015312.583529:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 691 00000100:00100000:2.0:1786015312.598048:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015312.598268:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280352384 00000100:00100000:3.0:1786015312.598284:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280352384 00000100:00100000:3.0:1786015312.598405:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 171 00000100:00100000:3.0:1786015312.598428:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280352384:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015312.598459:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015312.598490:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ece7346/0xb1a5ef690c50030e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e80a7 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015312.598584:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f1bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304343552:192.168.202.56@tcp:106: 00000100:00100000:3.0:1786015312.598744:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7381ffb780 going to sleep for 11 seconds 00000100:00080000:1.0:1786015312.603035:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1786015312.606404:0:6590:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size: 0 -> 158 00002000:00010000:3.0:1786015312.606428:0:6590:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb mtime: 0 -> 1786015312 00002000:00010000:3.0:1786015312.606431:0:6590:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb atime: 0 -> 1786015312 00002000:00010000:3.0:1786015312.606434:0:6590:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb ctime: 0 -> 1786015312 00000100:00100000:3.0:1786015312.606475:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f1bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304343552:192.168.202.56@tcp:106: 00010000:00010000:3.0:1786015312.606533:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006ece7346/0xb1a5ef690c50030e lrc: 1/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80a7 expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.606570:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ece7346/0xb1a5ef690c50030e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80a7 expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015312.606590:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb800, rc 0) 00000100:00100000:3.0:1786015312.606677:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280352384:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 8253us (8646us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015312.606688:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 171 00000100:00100000:3.0:1786015312.615852:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015312.616085:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280352512 00000100:00100000:1.0:1786015312.616102:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280352512 00000100:00100000:1.0:1786015312.616199:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 692 00000100:00100000:1.0:1786015312.616212:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+74:21774:x1872772280352512:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015312.616255:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015312.616292:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500315 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e80ae expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.616443:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c50031c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.616460:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c50031c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.616474:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c50031c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015312.616562:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 512 00000004:00200000:1.0:1786015312.616567:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015312.616598:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c50031c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.616631:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500315 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80ae expref: 76 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.616655:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c50031c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80ae expref: 75 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015312.616664:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:1.0:1786015312.616668:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015312.616672:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bfc00, rc 0) 00000100:00100000:1.0:1786015312.616838:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+75:21774:x1872772280352512:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 627us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015312.616847:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 692 00000040:00080000:2.0:1786015312.620601:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015312.620615:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015312.621657:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015312.621726:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015312.634539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015312.635236:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280352640 00000100:00100000:3.0:1786015312.635252:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280352640 00000100:00100000:3.0:1786015312.635348:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 172 00000100:00100000:3.0:1786015312.635361:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280352640:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015312.635387:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015312.635422:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097efddd7/0xb1a5ef690c500323 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e80b5 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015312.635502:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304343680:192.168.202.56@tcp:106: 00000100:00100000:3.0:1786015312.635638:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7381ffb780 going to sleep for 11 seconds 00000100:00100000:0.0:1786015312.643161:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304343680:192.168.202.56@tcp:106: 00010000:00010000:0.0:1786015312.643223:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000097efddd7/0xb1a5ef690c500323 lrc: 1/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80b5 expref: 11 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.643271:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097efddd7/0xb1a5ef690c500323 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80b5 expref: 11 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015312.643292:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bac00, rc 0) 00000100:00100000:0.0:1786015312.643393:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280352640:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 8033us (8868us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015312.643405:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 172 00000100:00100000:2.0:1786015312.656617:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015312.656728:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280352896 00000100:00100000:0.0:1786015312.656741:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280352896 00000100:00100000:0.0:1786015312.656870:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 693 00000100:00100000:0.0:1786015312.656882:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+75:21774:x1872772280352896:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:0.0:1786015312.657277:0:7673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].16, 136 off10368 00000100:00100000:0.0:1786015312.657402:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+75:21774:x1872772280352896:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 520us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015312.657474:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 693 00010000:00010000:0.0:1786015312.748255:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015313.645102:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015313.645117:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015313.645169:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 17 count 2 00000040:00080000:2.0:1786015313.645180:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015313.645911:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381305f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304343808:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786015313.646040:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748570a780 going to sleep for 11 seconds 00000100:00100000:1.0:1786015313.650741:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381305f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304343808:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015313.654449:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015313.655273:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280353024 00000100:00100000:2.0:1786015313.655292:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280353024 00000100:00100000:2.0:1786015313.655400:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 694 00000100:00100000:2.0:1786015313.655414:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+34:21784:x1872772280353024:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015313.655472:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x12:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015313.655635:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+34:21784:x1872772280353024:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 225us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015313.655644:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 694 00000100:00100000:3.0:1786015313.665064:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015313.666344:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280353280 00000100:00100000:2.0:1786015313.666366:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280353280 00000100:00100000:2.0:1786015313.666472:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 695 00000100:00100000:2.0:1786015313.666484:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+34:21784:x1872772280353280:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015313.666515:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015313.666545:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c50032a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e80bc expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015313.666685:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500331 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015313.666702:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500331 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015313.666718:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500331 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015313.666732:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 158 00010000:00010000:2.0:1786015313.666929:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c50032a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80bc expref: 37 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015313.667086:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500331 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80bc expref: 36 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015313.667097:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8b7482d4bd00) 00010000:00010000:2.0:1786015313.667100:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015313.667104:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906e00, rc 0) 00000100:00100000:2.0:1786015313.667200:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+36:21784:x1872772280353280:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 717us (2152us total) trans 4294967749 rc 0/0 00000100:00100000:2.0:1786015313.667208:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 695 00000100:00100000:3.0:1786015313.672613:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015313.672813:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280353408 00000100:00100000:1.0:1786015313.672841:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280353408 00000100:00100000:1.0:1786015313.672942:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 173 00000100:00100000:1.0:1786015313.672957:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280353408:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015313.673031:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ff7b10d/0xb1a5ef690c50033f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.673061:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc3c3574/0xb1a5ef690c5002eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8099 expref: 11 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.673074:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786015313.673079:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015313.673085:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ff7b10d/0xb1a5ef690c50033f lrc: 4/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786015313.673605:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786015313.675462:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc3c3574/0xb1a5ef690c5002eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8099 expref: 11 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.675500:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc3c3574/0xb1a5ef690c5002eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8099 expref: 11 pid: 14547 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015313.675521:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304343936:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015313.675677:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b03126c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015313.683627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015313.683815:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280353536 00000100:00100000:1.0:1786015313.683829:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280353536 00000100:00100000:1.0:1786015313.683909:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:1.0:1786015313.683921:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+36:2352:x1872772280353536:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015313.683952:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015313.683991:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500331 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80bc expref: 36 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.684013:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8b7482d4bd00) 00010000:00010000:1.0:1786015313.684020:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015313.684094:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+35:2352:x1872772280353536:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 175us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015313.685951:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:0.0:1786015313.686519:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304343936:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015313.686561:0:14547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005ff7b10d/0xb1a5ef690c50033f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015313.703693:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000040:00080000:1.0:1786015313.703923:0:16675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015313.703930:0:16675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015313.703985:0:16675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 17 count 2 00000040:00080000:1.0:1786015313.703995:0:16675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015313.704664:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280353664 00000100:00100000:0.0:1786015313.704693:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280353664 00002000:00100000:0.0:1786015313.704814:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xe:0x0] (0->157) req@ffff8b7381305500 x1872772280353664/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:159/0 lens 648/0 e 0 to 0 dl 1786015324 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015313.704829:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381305500 with x1872772280353664 ext(0->157) 00010000:00010000:0.0:1786015313.704844:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fc3c3574/0xb1a5ef690c5002eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8099 expref: 12 pid: 14547 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015313.704871:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fc3c3574/0xb1a5ef690c5002eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8099 expref: 12 pid: 14547 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015313.704882:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b7381305500 00000100:00100000:0.0:1786015313.704934:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:0.0:1786015313.704948:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280353664:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:2.0:1786015313.708568:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2354:x1872772280353664:12345-192.168.202.56@tcp:4:cp.0 Request processed in 3610us (4874us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1786015313.708583:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 6 00002000:00100000:2.0:1786015313.708595:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xe:0x0] (0->157) req@ffff8b7381305500 x1872772280353664/t4294967326(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:159/0 lens 648/448 e 0 to 0 dl 1786015324 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015313.708606:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381305500 with x1872772280353664 ext(0->157) 00010000:00010000:2.0:1786015313.708618:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fc3c3574/0xb1a5ef690c5002eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8099 expref: 14 pid: 14547 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015313.708643:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fc3c3574/0xb1a5ef690c5002eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8099 expref: 14 pid: 14547 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015313.708651:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b7381305500 00000100:00100000:2.0:1786015313.720595:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015313.720711:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280353792 00000100:00100000:1.0:1786015313.720722:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280353792 00010000:00010000:1.0:1786015313.721041:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc3c3574/0xb1a5ef690c5002eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8099 expref: 14 pid: 14547 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015313.721096:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 192 00000100:00100000:1.0:1786015313.721108:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2353:x1872772280353792:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015313.721127:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015313.721166:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc3c3574/0xb1a5ef690c5002eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8099 expref: 14 pid: 14547 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.721185:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc3c3574/0xb1a5ef690c5002eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8099 expref: 14 pid: 14547 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.721239:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc3c3574/0xb1a5ef690c5002eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8099 expref: 14 pid: 14547 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.721257:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015313.721263:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015313.721269:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ff7b10d/0xb1a5ef690c50033f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.721279:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ff7b10d/0xb1a5ef690c50033f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.721319:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015313.721383:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280353792:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 277us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015313.721391:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 192 00010000:00010000:0.0:1786015313.721960:0:14547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005ff7b10d/0xb1a5ef690c50033f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015313.721973:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ff7b10d/0xb1a5ef690c50033f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015313.722003:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ff7b10d/0xb1a5ef690c50033f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015313.722012:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ff7b10d/0xb1a5ef690c50033f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015313.722021:0:14547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ff7b10d/0xb1a5ef690c50033f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015313.722029:0:14547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813be200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015313.722033:0:14547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ff7b10d/0xb1a5ef690c50033f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015313.722042:0:14547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ff7b10d/0xb1a5ef690c50033f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015313.722057:0:14547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ff7b10d/0xb1a5ef690c50033f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015313.722066:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ff7b10d/0xb1a5ef690c50033f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015313.722166:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280353408:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 49211us (49567us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015313.722175:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 173 00000100:00100000:2.0:1786015313.728873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015313.729009:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280354048 00000100:00100000:1.0:1786015313.729021:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280354048 00000100:00100000:1.0:1786015313.729093:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 696 00000100:00100000:1.0:1786015313.729103:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+35:21784:x1872772280354048:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786015313.729240:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+35:21784:x1872772280354048:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 137us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015313.729249:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 696 00000100:00100000:3.0:1786015313.738480:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015313.738980:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280354176 00000100:00100000:0.0:1786015313.739000:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280354176 00000100:00100000:0.0:1786015313.739068:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 174 00000100:00100000:0.0:1786015313.739079:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280354176:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015313.739100:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015313.739122:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1ed4291/0xb1a5ef690c500346 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e80c3 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015313.739151:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 158, mtime: 0x6a746e50, atime: 0x0, ctime: 0x6a746e50, blocks: 0x1 00010000:00010000:0.0:1786015313.739177:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1786015313.739183:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015313.739193:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1ed4291/0xb1a5ef690c500346 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80c3 expref: 13 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015313.739215:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f1ed4291/0xb1a5ef690c500346 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80c3 expref: 13 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015313.739241:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6600, rc 0) 00000100:00100000:0.0:1786015313.739319:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280354176:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 241us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015313.739327:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 174 00000100:00100000:0.0:1786015313.744845:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015313.745014:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280354432 00000100:00100000:1.0:1786015313.745027:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280354432 00000100:00100000:1.0:1786015313.745095:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 697 00000100:00100000:1.0:1786015313.745115:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+35:21784:x1872772280354432:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786015313.745264:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+35:21784:x1872772280354432:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 150us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015313.745272:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 697 00000100:00100000:2.0:1786015313.758983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015313.760708:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280354560 00000100:00100000:3.0:1786015313.760734:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280354560 00002000:00100000:3.0:1786015313.760841:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe:0x0] (0->4095) req@ffff8b7381305880 x1872772280354560/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:159/0 lens 488/0 e 0 to 0 dl 1786015324 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015313.760854:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381305880 with x1872772280354560 ext(0->4095) 00002000:00010000:3.0:1786015313.760863:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7381305880 00000100:00100000:3.0:1786015313.760912:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:3.0:1786015313.760925:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2352:x1872772280354560:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1786015313.763435:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2352:x1872772280354560:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 2492us (4442us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786015313.763848:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 57 00002000:00100000:3.0:1786015313.763871:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe:0x0] (0->4095) req@ffff8b7381305880 x1872772280354560/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:159/0 lens 488/4536 e 0 to 0 dl 1786015324 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015313.763883:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381305880 with x1872772280354560 ext(0->4095) 00002000:00010000:3.0:1786015313.763892:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7381305880 00010000:00010000:1.0:1786015313.777740:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015313.781701:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015313.782061:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280354688 00000100:00100000:1.0:1786015313.782082:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280354688 00000100:00100000:1.0:1786015313.782179:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 698 00000100:00100000:1.0:1786015313.782191:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+35:21784:x1872772280354688:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015313.782234:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015313.782270:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50034d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e80ca expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.782325:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500354 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.782451:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.782469:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.782615:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50034d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80ca expref: 37 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.782638:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500354 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80ca expref: 36 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.782661:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8b7482d4bd00) 00010000:00010000:1.0:1786015313.782665:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015313.782670:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bfa00, rc 0) 00000100:00100000:1.0:1786015313.784001:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+36:21784:x1872772280354688:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1800us (2299us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015313.784016:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 698 00000100:00100000:0.0:1786015313.800141:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015313.800302:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280354816 00000100:00100000:1.0:1786015313.800316:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280354816 00000100:00100000:1.0:1786015313.800390:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 699 00000100:00100000:1.0:1786015313.800411:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+36:21784:x1872772280354816:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786015313.800447:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x12:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786015313.800569:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+36:21784:x1872772280354816:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 169us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015313.800576:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 699 00000100:00100000:2.0:1786015313.814666:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015313.814828:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280354944 00000100:00100000:3.0:1786015313.814839:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280354944 00000100:00100000:3.0:1786015313.814906:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 175 00000100:00100000:3.0:1786015313.814918:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280354944:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015313.814984:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010bcccaf/0xb1a5ef690c50035b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015313.815004:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786015313.815009:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015313.815016:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010bcccaf/0xb1a5ef690c50035b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015313.815032:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010bcccaf/0xb1a5ef690c50035b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015313.815068:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010bcccaf/0xb1a5ef690c50035b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015313.815076:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010bcccaf/0xb1a5ef690c50035b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015313.815084:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010bcccaf/0xb1a5ef690c50035b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015313.815091:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819ba200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015313.815096:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010bcccaf/0xb1a5ef690c50035b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015313.815104:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010bcccaf/0xb1a5ef690c50035b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015313.815131:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010bcccaf/0xb1a5ef690c50035b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015313.815139:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010bcccaf/0xb1a5ef690c50035b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015313.815234:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280354944:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 318us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015313.815243:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 175 00000100:00100000:3.0:1786015313.817520:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015313.817603:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280355200 00000100:00100000:2.0:1786015313.817613:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280355200 00000100:00100000:2.0:1786015313.817685:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 700 00000100:00100000:2.0:1786015313.817695:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+36:21784:x1872772280355200:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1786015313.817812:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500362 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015313.817830:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500354 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80ca expref: 36 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015313.817839:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500362 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015313.817876:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500354 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80ca expref: 36 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015313.817894:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500354 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80ca expref: 36 pid: 7673 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015313.817907:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381305180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304344064:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015313.817988:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748570ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015313.820199:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015313.822358:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280355328 00000100:00100000:1.0:1786015313.822377:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280355328 00010000:00010000:1.0:1786015313.822520:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500354 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80ca expref: 37 pid: 7673 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015313.822581:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 193 00000100:00100000:1.0:1786015313.822597:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2354:x1872772280355328:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015313.822618:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015313.822628:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500354 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80ca expref: 37 pid: 7673 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.822660:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500354 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80ca expref: 37 pid: 7673 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.822708:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8b7482d4bd00) 00010000:00010000:1.0:1786015313.822715:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500362 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.822729:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500362 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.822739:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500362 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015313.822793:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015313.822852:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500354 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80ca expref: 37 pid: 7673 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015313.822882:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381305180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304344064:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015313.822886:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+36:2354:x1872772280355328:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 292us (2702us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015313.822902:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 193 00010000:00010000:2.0:1786015313.822936:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500362 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015313.822950:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500362 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015313.822956:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500362 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015313.823209:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500362 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015313.823228:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500362 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015313.823235:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500362 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015313.823242:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015313.823247:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500362 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015313.823255:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500362 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015313.823271:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8b7482d4bd00) 00010000:00010000:2.0:1786015313.823275:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015313.823280:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500362 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015313.823287:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500362 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015313.823454:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+36:21784:x1872772280355200:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 5760us (5943us total) trans 4294967750 rc 0/0 00000100:00100000:2.0:1786015313.823465:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 700 00000040:00080000:0.0:1786015313.823941:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015313.823947:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015313.824442:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1786015313.824454:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015313.831389:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015313.831591:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280355584 00000100:00100000:1.0:1786015313.831605:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280355584 00000100:00100000:1.0:1786015313.831706:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 142 00000100:00100000:1.0:1786015313.831718:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+36:21784:x1872772280355584:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015313.832127:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+37:21784:x1872772280355584:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 410us (753us total) trans 4294967751 rc 0/0 00000100:00100000:1.0:1786015313.832137:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 142 00010000:00010000:2.0:1786015314.796214:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015314.860134:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015314.860149:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015314.860194:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 17 count 2 00000040:00080000:0.0:1786015314.860203:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015315.009078:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015315.009151:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015315.009251:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015315.009332:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280355840 00000100:00100000:2.0:1786015315.009348:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280355840 00000100:00100000:2.0:1786015315.009465:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 320 00000100:00100000:2.0:1786015315.009481:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+75:2354:x1872772280355840:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015315.009593:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+75:2354:x1872772280355840:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 116us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015315.009602:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 320 00000100:00080000:2.0:1786015315.009632:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015315.017882:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015315.017927:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015315.023558:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280356096 00000100:00100000:0.0:1786015315.023584:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280356096 00000100:00100000:0.0:1786015315.023715:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280356352 00000100:00100000:0.0:1786015315.023720:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280356352 00000100:00100000:0.0:1786015315.023782:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 276 00000100:00100000:0.0:1786015315.023796:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+9:2354:x1872772280356096:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015315.023933:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+9:2354:x1872772280356096:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 141us (14781us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015315.023941:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 276 00000100:00100000:0.0:1786015315.023965:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 277 00000100:00100000:0.0:1786015315.023971:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280356352:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015315.024023:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280356352:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 52us (14772us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015315.024030:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 277 00000100:00080000:0.0:1786015315.024062:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015315.024067:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015315.024237:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280355712 00000100:00100000:0.0:1786015315.024253:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280355712 00000100:00100000:0.0:1786015315.024286:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 365 00000100:00100000:0.0:1786015315.024293:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280355712:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015315.024319:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280355712:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (6457us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015315.024325:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 365 00000100:00100000:0.0:1786015315.025260:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280355968 00000100:00100000:0.0:1786015315.025272:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280355968 00000100:00100000:0.0:1786015315.025341:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 278 00000100:00100000:0.0:1786015315.025350:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+10:2354:x1872772280355968:12345-192.168.202.56@tcp:400:kworker.0 00000100:00080000:1.0:1786015315.025464:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015315.025563:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+10:2354:x1872772280355968:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 212us (7633us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015315.025571:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 278 00000100:00100000:0.0:1786015315.031519:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015315.031610:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015315.031644:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280356480 00000100:00100000:0.0:1786015315.031657:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280356480 00000100:00100000:0.0:1786015315.031732:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 279 00000100:00100000:0.0:1786015315.031743:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280356480:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015315.031859:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280356480:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 117us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015315.031868:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 279 00000100:00100000:1.0:1786015315.032196:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280356224 00000100:00100000:1.0:1786015315.032202:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280356224 00000100:00100000:1.0:1786015315.032265:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 321 00000100:00100000:1.0:1786015315.032273:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2354:x1872772280356224:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015315.032318:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2354:x1872772280356224:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 47us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015315.032324:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 321 00000100:00080000:1.0:1786015315.032344:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015315.032348:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015315.116829:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304344192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015315.116929:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015315.117343:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304344192 00000100:00100000:2.0:1786015315.117357:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304344192 00000100:00100000:2.0:1786015315.117476:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1786015315.117490:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304344192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015315.117555:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 66387968 pending 3407872 free 3857711104 avail 3855613952 00000100:00080000:1.0:1786015315.117660:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015315.120667:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304344192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3165us (3722us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015315.120689:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1786015315.125550:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304344192:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1786015315.737046:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00010000:00010000:0.0:1786015315.821508:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015315.929634:0:16728:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015315.929647:0:16728:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015315.929704:0:16728:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 17 count 2 00000040:00080000:1.0:1786015315.929714:0:16728:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015316.064485:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015316.064670:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280356736 00000100:00100000:2.0:1786015316.064684:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280356736 00000100:00100000:2.0:1786015316.064785:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 701 00000100:00100000:2.0:1786015316.064800:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+75:21794:x1872772280356736:12345-192.168.202.56@tcp:101:md5sum.0 00010000:00010000:2.0:1786015316.064853:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015316.064886:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500369 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e80d1 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.065051:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907a00/0xb1a5ef690c500370 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.065601:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907a00/0xb1a5ef690c500370 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.065623:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907a00/0xb1a5ef690c500370 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015316.065639:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 158 00010000:00010000:2.0:1786015316.065911:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500369 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80d1 expref: 78 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.065938:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907a00/0xb1a5ef690c500370 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80d1 expref: 77 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.065950:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8b7482d4bd00) 00010000:00010000:2.0:1786015316.065953:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015316.065957:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907a00, rc 0) 00000100:00100000:2.0:1786015316.066045:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+77:21794:x1872772280356736:12345-192.168.202.56@tcp:101:md5sum.0 Request processed in 1248us (1683us total) trans 4294967752 rc 0/0 00000100:00100000:2.0:1786015316.066053:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 701 00000100:00100000:2.0:1786015316.074040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015316.074866:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280356864 00000100:00100000:0.0:1786015316.074884:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280356864 00000100:00100000:0.0:1786015316.075007:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 176 00000100:00100000:0.0:1786015316.075022:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+10:2352:x1872772280356864:12345-192.168.202.56@tcp:101:md5sum.0 00010000:00010000:0.0:1786015316.075058:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015316.075109:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bc6218e/0xb1a5ef690c50037e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e80d8 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.075152:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1786015316.075157:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015316.075170:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bc6218e/0xb1a5ef690c50037e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80d8 expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.075205:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003bc6218e/0xb1a5ef690c50037e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80d8 expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.075225:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e7200, rc 0) 00000100:00100000:0.0:1786015316.075312:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+11:2352:x1872772280356864:12345-192.168.202.56@tcp:101:md5sum.0 Request processed in 294us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015316.075321:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 176 00000100:00100000:2.0:1786015316.090028:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015316.090225:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015316.092602:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280357120 00000100:00100000:3.0:1786015316.092628:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280357120 00002000:00100000:3.0:1786015316.092721:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xe:0x0] (0->4095) req@ffff8b7381304000 x1872772280357120/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:162/0 lens 488/0 e 0 to 0 dl 1786015327 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015316.092735:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381304000 with x1872772280357120 ext(0->4095) 00002000:00010000:3.0:1786015316.092743:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7381304000 00000100:00100000:3.0:1786015316.092802:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:3.0:1786015316.092814:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+11:2351:x1872772280357120:12345-192.168.202.56@tcp:3:md5sum.0 00000100:00100000:3.0:1786015316.093148:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+11:2351:x1872772280357120:12345-192.168.202.56@tcp:3:md5sum.0 Request processed in 335us (2921us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786015316.093169:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 58 00002000:00100000:3.0:1786015316.093177:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xe:0x0] (0->4095) req@ffff8b7381304000 x1872772280357120/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:162/0 lens 488/4536 e 0 to 0 dl 1786015327 ref 1 fl Complete:/600/0 rc 4096/4096 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015316.093186:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381304000 with x1872772280357120 ext(0->4095) 00002000:00010000:3.0:1786015316.093190:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7381304000 00000100:00100000:1.0:1786015316.102655:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280356992 00000100:00100000:1.0:1786015316.102681:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280356992 00000100:00100000:1.0:1786015316.102799:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:1.0:1786015316.102813:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74865aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+77:2353:x1872772280356992:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015316.102835:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015316.102871:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907a00/0xb1a5ef690c500370 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80d1 expref: 77 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.102892:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8b7482d4bd00) 00010000:00010000:1.0:1786015316.102898:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015316.102983:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74865aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+76:2353:x1872772280356992:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 172us (12973us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015316.102999:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:1.0:1786015316.103186:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015316.103359:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280357376 00000100:00100000:1.0:1786015316.103365:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280357376 00000100:00100000:1.0:1786015316.103419:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 143 00000100:00100000:1.0:1786015316.103427:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7487302850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+76:21794:x1872772280357376:12345-192.168.202.56@tcp:35:md5sum.0 00000100:00100000:1.0:1786015316.103715:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7487302850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+77:21794:x1872772280357376:12345-192.168.202.56@tcp:35:md5sum.0 Request processed in 287us (528us total) trans 4294967753 rc 0/0 00000100:00100000:1.0:1786015316.103722:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 143 00000100:00100000:2.0:1786015316.137447:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015316.137693:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280357632 00000100:00100000:1.0:1786015316.137706:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280357632 00000100:00100000:1.0:1786015316.137810:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 702 00000100:00100000:1.0:1786015316.137824:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+77:21795:x1872772280357632:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:1.0:1786015316.137907:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1786015316.137946:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c500307 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80a0 expref: 77 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.137970:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8b7482d4bd00) 00010000:00010000:1.0:1786015316.137984:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c50031c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80ae expref: 76 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.137993:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:1.0:1786015316.137997:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015316.138031:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500385 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.138132:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500385 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.138147:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500385 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.138167:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50038c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.138175:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50038c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.138181:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50038c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.139049:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c500393 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.140205:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5002d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e808b expref: 36 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.140223:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c500393 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.140317:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5002d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e808b expref: 36 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.140337:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5002d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e808b expref: 36 pid: 7673 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015316.140704:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738374ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304344320:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015316.140954:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06540 going to sleep for 11 seconds 00000100:00100000:1.0:1786015316.150158:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738374ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304344320:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015316.150222:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c500393 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015316.155542:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015316.156033:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280357760 00000100:00100000:0.0:1786015316.156050:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280357760 00010000:00010000:0.0:1786015316.156115:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5002d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e808b expref: 37 pid: 7673 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015316.156167:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 194 00000100:00100000:0.0:1786015316.156179:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381307b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2353:x1872772280357760:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015316.156210:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015316.156240:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5002d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e808b expref: 37 pid: 7673 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.156257:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5002d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e808b expref: 37 pid: 7673 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.156296:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5002d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e808b expref: 37 pid: 7673 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.156317:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8b7482d4bd00) 00010000:00010000:0.0:1786015316.156324:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c500393 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.156336:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c500393 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.156344:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c500393 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.156434:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015316.156511:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381307b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+36:2353:x1872772280357760:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 334us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015316.156519:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 194 00010000:00010000:2.0:1786015316.160887:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c500393 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.160909:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c500393 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786015316.165225:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1786015316.165245:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 551416482946ns, next at 552416478603ns, rc = 0 00010000:00010000:2.0:1786015316.170518:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c50039a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.170568:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c50039a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.170593:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c50039a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.170608:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c50039a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.170614:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c50039a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.170622:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c50039a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.170658:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786015316.170712:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c500393 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.170719:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c500393 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.170745:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c500393 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.170752:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015316.170758:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c500393 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.170786:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c500393 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.170803:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8b7482d4bd00) 00010000:00010000:2.0:1786015316.170807:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786015316.170813:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c500393 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.170819:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c500393 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.170852:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500385 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.170858:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500385 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.170864:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500385 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.170869:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015316.170872:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500385 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.170889:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500385 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.170898:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:2.0:1786015316.170901:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015316.170904:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500385 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.170909:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500385 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015316.170920:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e6fefb18 reply state 000000008e48a5a4 transno 4294967754 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50038c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015316.170931:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786015316.171147:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786015316.171157:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c50039a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.171165:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906c00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015316.171170:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c50039a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.171190:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c50039a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.171212:0:8308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8b7482d4bd00) 00010000:00010000:0.0:1786015316.171214:0:8308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786015316.171217:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c50039a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.171222:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c50039a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.171250:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015316.171252:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015316.171255:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015316.171455:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+77:21795:x1872772280357632:12345-192.168.202.56@tcp:36:rm.0 Request processed in 33556us (33946us total) trans 4294967754 rc 0/0 00000100:00100000:2.0:1786015316.171468:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 702 00010000:00010000:0.0:1786015316.177615:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50038c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.177638:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50038c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.177646:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50038c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.177653:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bec00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015316.177658:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50038c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.177666:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50038c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.177687:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff8b7483ee6100) 00010000:00010000:0.0:1786015316.177707:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015316.177714:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50038c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.177721:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50038c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015316.345670:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015316.346470:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280357888 00000100:00100000:0.0:1786015316.346489:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280357888 00000100:00100000:2.0:1786015316.346655:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 703 00000100:00100000:2.0:1786015316.346668:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+76:21811:x1872772280357888:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:2.0:1786015316.346885:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015316.346918:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5003a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e80df expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.347020:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c5003a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.347038:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c5003a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.347072:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c5003a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015316.347246:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 512 00000004:00200000:2.0:1786015316.347253:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015316.347365:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c5003a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.347404:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5003a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80df expref: 78 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.347428:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c5003a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80df expref: 77 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.347438:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:2.0:1786015316.347442:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015316.347447:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906c00, rc 0) 00000100:00100000:2.0:1786015316.347540:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+77:21811:x1872772280357888:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 873us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015316.347549:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 703 00000100:00100000:2.0:1786015316.400118:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015316.400267:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280358016 00000100:00100000:0.0:1786015316.400283:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280358016 00000100:00100000:0.0:1786015316.400364:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 704 00000100:00100000:0.0:1786015316.400385:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+36:21817:x1872772280358016:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015316.400417:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015316.400446:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5003af lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e80e6 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.400530:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5003b6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.400548:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5003b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.400561:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5003b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.400581:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c5003bd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.400588:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c5003bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.400618:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c5003bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401086:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5003c4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401097:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5003c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401105:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5003c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015316.401237:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00000004:00200000:0.0:1786015316.401243:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015316.401335:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5003c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401349:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5003b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401355:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5003b6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401362:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5003b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401367:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e7000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015316.401372:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5003b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401379:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5003b6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401398:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b749802e100) 00010000:00010000:0.0:1786015316.401402:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015316.401407:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5003b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401413:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5003b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401427:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c5003bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401432:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c5003bd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401437:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c5003bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401442:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381935200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015316.401444:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c5003bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401449:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c5003bd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401456:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8b7482d4bd00) 00010000:00010000:0.0:1786015316.401457:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015316.401461:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c5003bd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401466:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c5003bd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401515:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5003af lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80e6 expref: 38 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401529:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935e00/0xb1a5ef690c5003c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80e6 expref: 37 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.401537:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:0.0:1786015316.401539:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015316.401542:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7381935e00, rc 0) 00000100:00100000:0.0:1786015316.401622:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+37:21817:x1872772280358016:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1248us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015316.401631:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 704 00000100:00100000:1.0:1786015316.406934:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015316.407181:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280358144 00000100:00100000:2.0:1786015316.407205:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280358144 00000100:00100000:2.0:1786015316.407294:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 705 00000100:00100000:2.0:1786015316.407306:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+37:21817:x1872772280358144:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015316.407337:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015316.407389:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906200/0xb1a5ef690c5003cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e80ed expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.407630:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906200/0xb1a5ef690c5003cb lrc: 1/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80ed expref: 38 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.407648:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8b749232d900) 00010000:00010000:2.0:1786015316.407652:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015316.407658:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906200/0xb1a5ef690c5003cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80ed expref: 38 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.407696:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906200, rc 0) 00000100:00100000:2.0:1786015316.407817:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+37:21817:x1872772280358144:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 512us (898us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015316.407827:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 705 00000100:00100000:2.0:1786015316.418068:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015316.418297:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280358400 00000100:00100000:1.0:1786015316.418312:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280358400 00000100:00100000:1.0:1786015316.418401:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 706 00000100:00100000:1.0:1786015316.418413:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+77:21817:x1872772280358400:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015316.418444:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015316.418448:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786015316.418489:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906c00/0xb1a5ef690c5003a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80df expref: 77 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.418515:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:1.0:1786015316.418522:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015316.418540:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c5003d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e80f4 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.418721:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.418738:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.418816:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.418838:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5003e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.418846:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5003e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.418854:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5003e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.419695:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5003e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.419710:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5003e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.419720:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5003e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015316.419731:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 0 00010000:00010000:1.0:1786015316.419796:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.419805:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003d9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.419812:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.419820:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813be000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015316.419835:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.419845:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.419859:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:1.0:1786015316.419863:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015316.419867:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.419875:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786015316.419890:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000944f48f9 reply state 000000004f9a0e41 transno 4294967755 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5003e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015316.419901:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786015316.419942:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c5003d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80f4 expref: 79 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.419959:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5003e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80f4 expref: 78 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.419967:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:1.0:1786015316.419970:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015316.419973:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bec00, rc 0) 00000100:00100000:1.0:1786015316.420081:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+79:21817:x1872772280358400:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1670us (2029us total) trans 4294967755 rc 0/0 00000100:00100000:1.0:1786015316.420092:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 706 00010000:00010000:3.0:1786015316.423424:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5003e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.423448:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5003e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.423456:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5003e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.423463:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015316.423468:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5003e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.423477:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5003e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.423499:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff8b7483ee6900) 00010000:00010000:3.0:1786015316.423503:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015316.423509:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5003e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.423515:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf200/0xb1a5ef690c5003e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015316.426627:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015316.426749:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280358656 00000100:00100000:1.0:1786015316.426807:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280358656 00000100:00100000:1.0:1786015316.426885:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 707 00000100:00100000:1.0:1786015316.426897:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+78:21817:x1872772280358656:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015316.426933:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015316.426962:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c5003f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e80fb expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.427108:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.427127:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5003e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80f4 expref: 79 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.427137:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003fc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.427300:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5003e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80f4 expref: 79 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.427317:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5003e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80f4 expref: 79 pid: 5796 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015316.427334:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304344448:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015316.427582:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06540 going to sleep for 11 seconds 00000100:00100000:0.0:1786015316.435204:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015316.435302:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280358784 00000100:00100000:3.0:1786015316.435316:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280358784 00010000:00010000:3.0:1786015316.435391:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5003e7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80f4 expref: 80 pid: 5796 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015316.435448:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 195 00000100:00100000:3.0:1786015316.435460:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+80:2354:x1872772280358784:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015316.435483:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015316.435491:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5003e7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80f4 expref: 80 pid: 5796 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.435509:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5003e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80f4 expref: 80 pid: 5796 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.435539:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:3.0:1786015316.435546:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.435557:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.435565:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003fc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.435591:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015316.435669:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+80:2354:x1872772280358784:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 210us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015316.435677:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 195 00010000:00010000:1.0:1786015316.437707:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5003e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80f4 expref: 79 pid: 5796 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015316.437744:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304344448:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015316.438072:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.438155:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.438174:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015316.438214:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 0 00010000:00010000:0.0:1786015316.438974:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.438988:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.438996:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.439018:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813be000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015316.439024:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.439032:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.439054:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:0.0:1786015316.439058:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015316.439064:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.439072:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5003fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.439158:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c5003f5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80fb expref: 79 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.439184:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:0.0:1786015316.439186:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015316.439198:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfc00/0xb1a5ef690c5003f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80fb expref: 79 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.439210:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bfc00, rc 0) 00000100:00100000:0.0:1786015316.439565:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+78:21817:x1872772280358656:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 12667us (12947us total) trans 4294967756 rc 301/301 00000100:00100000:0.0:1786015316.439576:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 707 00000100:00100000:0.0:1786015316.443055:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015316.443438:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280359040 00000100:00100000:1.0:1786015316.443454:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280359040 00000100:00100000:1.0:1786015316.443597:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 144 00000100:00100000:1.0:1786015316.443611:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+78:21817:x1872772280359040:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015316.444209:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+79:21817:x1872772280359040:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 600us (1167us total) trans 4294967757 rc 0/0 00000100:00100000:1.0:1786015316.444220:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 144 00000100:00100000:0.0:1786015316.447250:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015316.447502:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280359168 00000100:00100000:3.0:1786015316.447517:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280359168 00000100:00100000:3.0:1786015316.447597:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 708 00000100:00100000:3.0:1786015316.447609:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+79:21817:x1872772280359168:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015316.447643:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015316.447675:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c50040a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8102 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.447816:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c50040a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8102 expref: 80 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.447837:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c50040a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8102 expref: 80 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.447865:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:3.0:1786015316.447868:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015316.447873:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb000, rc 0) 00000100:00100000:3.0:1786015316.447948:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+80:21817:x1872772280359168:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 342us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015316.447956:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 708 00000100:00100000:0.0:1786015316.455854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015316.455999:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280359424 00000100:00100000:2.0:1786015316.456015:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280359424 00000100:00100000:2.0:1786015316.456141:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 709 00000100:00100000:2.0:1786015316.456154:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+80:21817:x1872772280359424:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1786015316.456292:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500411 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.456316:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500411 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.456333:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500411 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.456674:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500411 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.456684:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500411 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.456692:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500411 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.456700:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015316.456705:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500411 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.456714:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500411 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.456731:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:2.0:1786015316.456734:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1786015316.456740:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500411 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.456747:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500411 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015316.456941:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+81:21817:x1872772280359424:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 788us (1103us total) trans 4294967758 rc 0/0 00000100:00100000:2.0:1786015316.456952:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 709 00000100:00100000:3.0:1786015316.460981:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015316.461104:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280359680 00000100:00100000:0.0:1786015316.461120:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280359680 00000100:00100000:0.0:1786015316.461215:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 710 00000100:00100000:0.0:1786015316.461228:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+81:21817:x1872772280359680:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786015316.461671:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500418 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.461695:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500418 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015316.461711:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500418 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786015316.461868:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967759 00000004:00010000:0.0:1786015316.461914:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007d4058fa reply state 00000000853500ef transno 4294967760 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500418 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015316.461926:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015316.462051:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+84:21817:x1872772280359680:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 824us (1083us total) trans 4294967760 rc 0/0 00000100:00100000:0.0:1786015316.462061:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 710 00000020:00080000:0.0:1786015316.462067:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786015316.466330:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500418 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.466571:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500418 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.466580:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500418 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.466588:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381935200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015316.466594:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500418 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.466605:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500418 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.466633:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:2.0:1786015316.466637:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786015316.466643:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500418 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.466650:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500418 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015316.467736:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015316.468135:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280359936 00000100:00100000:2.0:1786015316.468156:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280359936 00000100:00100000:2.0:1786015316.468275:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 145 00000100:00100000:2.0:1786015316.468287:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+83:21817:x1872772280359936:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015316.468865:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+84:21817:x1872772280359936:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 575us (1137us total) trans 4294967761 rc 0/0 00000100:00100000:2.0:1786015316.468877:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 145 00000100:00100000:0.0:1786015316.492859:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015316.492964:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280360192 00000100:00100000:1.0:1786015316.492978:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280360192 00000100:00100000:1.0:1786015316.493057:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 711 00000100:00100000:1.0:1786015316.493070:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+84:21819:x1872772280360192:12345-192.168.202.56@tcp:101:md5sum.0 00010000:00010000:1.0:1786015316.493104:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015316.493138:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50041f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8109 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493266:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500426 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493283:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500426 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493297:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500426 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493315:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50042d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493343:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50042d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493351:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50042d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493534:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500434 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493544:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493551:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015316.493564:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 158 00010000:00010000:1.0:1786015316.493700:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500426 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493708:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500426 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493715:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500426 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493722:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015316.493727:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500426 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493735:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500426 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493800:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:1.0:1786015316.493804:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015316.493809:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500426 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493815:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500426 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493831:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50042d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493837:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50042d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493842:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50042d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493847:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015316.493850:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50042d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493856:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50042d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493863:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff8b7483ee6d00) 00010000:00010000:1.0:1786015316.493865:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015316.493868:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50042d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493873:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50042d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493938:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50041f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8109 expref: 87 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493953:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500434 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8109 expref: 86 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.493960:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:1.0:1786015316.493962:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015316.493965:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bfa00, rc 0) 00000100:00100000:1.0:1786015316.494127:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+86:21819:x1872772280360192:12345-192.168.202.56@tcp:101:md5sum.0 Request processed in 1059us (1282us total) trans 4294967762 rc 0/0 00000100:00100000:1.0:1786015316.494136:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 711 00000100:00100000:0.0:1786015316.504579:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015316.504704:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280360448 00000100:00100000:1.0:1786015316.504718:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280360448 00000100:00100000:1.0:1786015316.504826:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:1.0:1786015316.504836:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+86:21819:x1872772280360448:12345-192.168.202.56@tcp:103:md5sum.0 00010000:00010000:1.0:1786015316.504854:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1786015316.504885:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500434 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8109 expref: 86 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.504904:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb000/0xb1a5ef690c50040a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8102 expref: 85 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.504913:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:1.0:1786015316.504923:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015316.505009:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+84:21819:x1872772280360448:12345-192.168.202.56@tcp:103:md5sum.0 Request processed in 174us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015316.505016:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:3.0:1786015316.506912:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015316.507026:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280360576 00000100:00100000:2.0:1786015316.507058:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280360576 00000100:00100000:2.0:1786015316.507207:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 712 00000100:00100000:2.0:1786015316.507219:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+84:21819:x1872772280360576:12345-192.168.202.56@tcp:58:md5sum.0 00010000:00010000:2.0:1786015316.507385:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500442 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.507407:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500442 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.507421:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500442 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786015316.507631:0:12526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].17, 136 off10504 00000100:00100000:2.0:1786015316.507801:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+84:21819:x1872772280360576:12345-192.168.202.56@tcp:58:md5sum.0 Request processed in 582us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015316.507811:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 712 00000100:00100000:2.0:1786015316.509703:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015316.509807:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280360704 00000100:00100000:3.0:1786015316.509820:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280360704 00000100:00100000:3.0:1786015316.509889:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 713 00000100:00100000:3.0:1786015316.509900:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+84:21819:x1872772280360704:12345-192.168.202.56@tcp:101:md5sum.0 00010000:00010000:3.0:1786015316.509954:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015316.509981:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c500449 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8110 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.510047:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500442 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.510056:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c500449 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8110 expref: 85 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.510079:0:7673:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500442 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.510096:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c500449 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8110 expref: 85 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.510113:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8b749232d900) 00010000:00010000:3.0:1786015316.510116:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015316.510120:0:7673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c500449 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8110 expref: 85 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.510129:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bac00, rc 0) 00000100:00100000:3.0:1786015316.510213:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+85:21819:x1872772280360704:12345-192.168.202.56@tcp:101:md5sum.0 Request processed in 314us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015316.510221:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 713 00000100:00100000:0.0:1786015316.661804:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304344576:0@lo:400:kworker.0 00000100:00100000:3.0:1786015316.661845:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304344832:0@lo:400:kworker.0 00000100:00100000:2.0:1786015316.661927:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304344960:0@lo:400:kworker.0 00000100:00100000:1.0:1786015316.664661:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304344704:0@lo:400:kworker.0 00000100:00100000:0.0:1786015316.672727:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015316.672791:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015316.672846:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304345088:0@lo:400:kworker.0 00000100:00100000:2.0:1786015316.672867:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304344960 00000100:00100000:2.0:1786015316.672879:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304344960 00000100:00100000:0.0:1786015316.672910:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015316.672942:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1786015316.672943:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304344576 00000100:00100000:0.0:1786015316.672947:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304344576 00000100:00100000:2.0:1786015316.672953:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304344960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015316.672975:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1786015316.672980:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304344576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015316.673022:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304344960:12345-0@lo:400:kworker.0 Request processed in 71us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015316.673022:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304344576:12345-0@lo:400:kworker.0 Request processed in 41us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015316.673031:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1786015316.673031:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1786015316.673153:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015316.673212:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304345216:0@lo:400:kworker.0 00000100:00100000:1.0:1786015316.673239:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015316.673833:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304345088 00000100:00100000:1.0:1786015316.673840:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304345088 00000100:00100000:1.0:1786015316.673895:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304344704 00000100:00100000:1.0:1786015316.673898:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304344704 00000100:00100000:1.0:1786015316.673926:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1786015316.673934:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304345088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015316.673993:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304345088:12345-0@lo:400:kworker.0 Request processed in 58us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015316.674000:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1786015316.674017:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1786015316.674022:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304344704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015316.674057:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304344704:12345-0@lo:400:kworker.0 Request processed in 35us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015316.674064:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:1.0:1786015316.674098:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015316.674139:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304344704:0@lo:400:kworker.0 00000100:00100000:1.0:1786015316.676751:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304345216 00000100:00100000:1.0:1786015316.676791:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304345216 00000100:00100000:1.0:1786015316.676897:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1786015316.676909:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304345216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015316.677061:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304345216:12345-0@lo:400:kworker.0 Request processed in 155us (3819us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015316.677083:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:1.0:1786015316.677110:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015316.677149:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304345216:0@lo:400:kworker.0 00000100:00100000:2.0:1786015316.677314:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304344960:0@lo:400:kworker.0 00000100:00100000:0.0:1786015316.677798:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304344576:0@lo:400:kworker.0 00000100:00100000:0.0:1786015316.677828:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304345088:0@lo:400:kworker.0 00000100:00100000:3.0:1786015316.685643:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015316.686896:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304344832 00000100:00100000:1.0:1786015316.686915:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304344832 00000100:00100000:1.0:1786015316.687034:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1786015316.687047:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304344832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015316.688013:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304344832:12345-0@lo:400:kworker.0 Request processed in 963us (2376us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015316.688026:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00080000:2.0:1786015316.688543:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015316.688685:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304344832:0@lo:400:kworker.0 00010000:00010000:1.0:1786015316.847080:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015316.908357:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015316.908381:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015316.908440:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 18 count 3 00000040:00080000:1.0:1786015316.908453:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015316.908657:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af069880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304345344:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015316.908958:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786015316.922747:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015316.922878:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280360832 00000100:00100000:3.0:1786015316.922892:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280360832 00000100:00100000:3.0:1786015316.923015:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 714 00000100:00100000:3.0:1786015316.923029:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+38:21821:x1872772280360832:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015316.923105:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x2c:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015316.923349:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+38:21821:x1872772280360832:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 322us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015316.923359:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 714 00000100:00100000:1.0:1786015316.923464:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af069880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304345344:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786015316.936867:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015316.937081:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280360960 00000100:00100000:3.0:1786015316.937097:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280360960 00000100:00100000:3.0:1786015316.937209:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 715 00000100:00100000:3.0:1786015316.937222:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+37:21821:x1872772280360960:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1786015316.937809:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c500450 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.937837:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c500450 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.937855:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c500450 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.937878:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c500457 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.937886:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c500457 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.937893:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c500457 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.937953:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c50045e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.937962:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c50045e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.937969:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c50045e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015316.938036:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 158 00000004:00200000:3.0:1786015316.938042:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015316.938063:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c50045e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938078:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c500450 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938086:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c500450 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938093:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c500450 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938100:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015316.938104:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c500450 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938112:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c500450 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938128:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:3.0:1786015316.938138:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015316.938146:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c500450 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938154:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c500450 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938192:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c500457 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938199:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c500457 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938206:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c500457 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938211:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015316.938214:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c500457 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938221:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c500457 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938230:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x7d5aa0c7 (ffff8b74a04b5100) 00010000:00010000:3.0:1786015316.938233:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015316.938235:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c500457 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938241:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c500457 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938257:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c50045e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938285:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c50045e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938297:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c50045e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938302:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819ba200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015316.938312:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c50045e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938319:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c50045e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938328:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8b749232d900) 00010000:00010000:3.0:1786015316.938330:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015316.938333:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c50045e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.938338:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c50045e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015316.938489:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+37:21821:x1872772280360960:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 1265us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015316.938501:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 715 00000100:00100000:0.0:1786015316.942814:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015316.943020:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280361216 00000100:00100000:1.0:1786015316.943033:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280361216 00000100:00100000:1.0:1786015316.943117:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 716 00000100:00100000:1.0:1786015316.943132:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+37:21821:x1872772280361216:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015316.943180:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015316.943250:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500465 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8117 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.943655:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50046c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.943673:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50046c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.943686:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50046c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015316.943697:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 158 00010000:00010000:1.0:1786015316.944736:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50046c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.944753:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50046c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.944781:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50046c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.944789:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bec00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015316.944794:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50046c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.944805:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50046c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.944823:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8b749232d900) 00010000:00010000:1.0:1786015316.944826:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015316.944832:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50046c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.944856:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50046c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.944930:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500465 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8117 expref: 39 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.944943:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:1.0:1786015316.944946:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786015316.944950:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500465 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8117 expref: 39 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.944962:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bfa00, rc 0) 00000100:00100000:1.0:1786015316.945053:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+38:21821:x1872772280361216:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1923us (2301us total) trans 4294967763 rc 301/301 00000100:00100000:1.0:1786015316.945063:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 716 00000100:00100000:0.0:1786015316.951574:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015316.952002:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280361344 00000100:00100000:3.0:1786015316.952019:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280361344 00000100:00100000:3.0:1786015316.952098:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 717 00000100:00100000:3.0:1786015316.952111:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+38:21821:x1872772280361344:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015316.952180:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x2c:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015316.952429:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+38:21821:x1872772280361344:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 319us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015316.952439:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 717 00000100:00100000:0.0:1786015316.957435:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015316.957806:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280361600 00000100:00100000:3.0:1786015316.957823:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280361600 00000100:00100000:3.0:1786015316.957919:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 718 00000100:00100000:3.0:1786015316.957933:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+38:21821:x1872772280361600:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015316.957966:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015316.958000:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c50047a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e811e expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786015316.958941:0:7673:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x10:0x0], index 1: 0 00010000:00010000:3.0:1786015316.959337:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c500481 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.959360:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c500481 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.959377:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c500481 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.959478:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819ba200/0xb1a5ef690c50047a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e811e expref: 41 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.959500:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c500481 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e811e expref: 40 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.959511:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:3.0:1786015316.959514:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015316.959530:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb200, rc 0) 00000100:00100000:3.0:1786015316.959639:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+40:21821:x1872772280361600:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1709us (2223us total) trans 4294967764 rc 0/0 00000100:00100000:3.0:1786015316.959649:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 718 00000100:00100000:1.0:1786015316.964103:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015316.964438:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280361856 00000100:00100000:3.0:1786015316.964456:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280361856 00000100:00100000:3.0:1786015316.964536:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 719 00000100:00100000:3.0:1786015316.964548:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+40:21821:x1872772280361856:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786015316.964638:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015316.964678:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c500481 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e811e expref: 40 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.964704:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:3.0:1786015316.964718:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015316.964752:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50048f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.964806:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50048f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.964820:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50048f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.964876:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500496 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xfde45f2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.964884:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500496 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xfde45f2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.964891:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500496 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xfde45f2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.965032:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50048f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.965040:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50048f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.965047:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50048f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.965055:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015316.965060:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50048f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.965069:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50048f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.965078:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8b749232d200) 00010000:00010000:3.0:1786015316.965081:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015316.965085:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50048f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.965091:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50048f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.965099:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500496 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xfde45f2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.965104:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500496 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xfde45f2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.965110:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500496 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xfde45f2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.965123:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819baa00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015316.965127:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500496 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xfde45f2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.965134:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500496 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xfde45f2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.965143:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xfde45f2c (ffff8b74a04b5200) 00010000:00010000:3.0:1786015316.965145:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015316.965148:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500496 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xfde45f2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.965577:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500496 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xfde45f2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015316.965721:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+39:21821:x1872772280361856:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 1170us (1631us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786015316.965732:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 719 00000100:00100000:0.0:1786015316.968960:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015316.969272:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280361984 00000100:00100000:1.0:1786015316.969293:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280361984 00000100:00100000:1.0:1786015316.969378:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 720 00000100:00100000:1.0:1786015316.969392:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+39:21821:x1872772280361984:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015316.969425:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015316.969460:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c50049d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8125 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.969512:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5004a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.969553:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5004a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.969566:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5004a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.970131:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c50049d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8125 expref: 41 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.970420:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5004a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8125 expref: 40 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.970433:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8b7483ee6d00) 00010000:00010000:1.0:1786015316.970437:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015316.970442:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bec00, rc 0) 00000100:00100000:1.0:1786015316.970532:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+40:21821:x1872772280361984:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1142us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015316.970542:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 720 00000100:00100000:0.0:1786015316.974623:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015316.974750:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280362240 00000100:00100000:2.0:1786015316.974795:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280362240 00000100:00100000:2.0:1786015316.974881:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 721 00000100:00100000:2.0:1786015316.974893:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+40:21821:x1872772280362240:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786015316.975030:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c5004ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.975053:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c5004ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015316.975067:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c5004ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786015316.975715:0:12526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8752 00000004:00080000:2.0:1786015316.975731:0:12526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 552226969302ns, next at 553226965810ns, rc = 0 00000004:00010000:2.0:1786015316.975891:0:12526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c1d2ba36 reply state 0000000053b3d837 transno 4294967765 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c5004ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015316.975903:0:12526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786015316.976060:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+42:21821:x1872772280362240:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 1165us (1450us total) trans 4294967765 rc 0/0 00000100:00100000:2.0:1786015316.976069:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 721 00010000:00010000:3.0:1786015316.979530:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c5004ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.979557:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c5004ab lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.979566:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c5004ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.979573:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015316.979579:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c5004ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.979614:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c5004ab lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.979640:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8b7483ee6d00) 00010000:00010000:3.0:1786015316.979644:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786015316.979650:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c5004ab lrc: 2/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015316.979657:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c5004ab lrc: 0/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015316.981732:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015316.981870:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280362368 00000100:00100000:1.0:1786015316.981885:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280362368 00000100:00100000:1.0:1786015316.981967:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 722 00000100:00100000:1.0:1786015316.981981:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+41:21821:x1872772280362368:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015316.982024:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015316.982057:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5004b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e812c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.982146:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5004b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e812c expref: 42 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.982205:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5004b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e812c expref: 42 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015316.982234:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8b7483ee6d00) 00010000:00010000:1.0:1786015316.982238:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015316.982242:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bfa00, rc 0) 00000100:00100000:1.0:1786015316.982329:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+42:21821:x1872772280362368:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 351us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015316.982337:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 722 00000100:00100000:0.0:1786015316.987663:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015316.987798:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280362496 00000100:00100000:2.0:1786015316.987814:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280362496 00000100:00100000:2.0:1786015316.987888:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 177 00000100:00100000:2.0:1786015316.987900:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280362496:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1786015316.989083:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280362496:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 1175us (1426us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1786015316.989120:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 177 00000100:00100000:0.0:1786015316.992658:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015316.992842:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280362752 00000100:00100000:2.0:1786015316.992856:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280362752 00000100:00100000:2.0:1786015316.992953:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 146 00000100:00100000:2.0:1786015316.992966:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+42:21821:x1872772280362752:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015316.993862:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+43:21821:x1872772280362752:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 894us (1215us total) trans 4294967766 rc 0/0 00000100:00100000:2.0:1786015316.993874:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 146 00000100:00100000:0.0:1786015316.997443:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015316.997587:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280363008 00000100:00100000:1.0:1786015316.997602:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280363008 00000100:00100000:1.0:1786015316.997864:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 723 00000100:00100000:1.0:1786015316.997881:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:21821:x1872772280363008:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786015316.998051:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:21821:x1872772280363008:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 175us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015316.998061:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 723 00000100:00100000:0.0:1786015317.001878:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015317.002023:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280363136 00000100:00100000:3.0:1786015317.002040:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280363136 00000100:00100000:3.0:1786015317.002200:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 724 00000100:00100000:3.0:1786015317.002217:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+43:21821:x1872772280363136:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015317.002249:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015317.002302:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5004b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8133 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.002666:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5004c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.002686:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5004c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.002701:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5004c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015317.002805:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015317.002862:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5004c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.002898:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5004b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8133 expref: 45 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.002922:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5004c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8133 expref: 44 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.002932:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8b7483ee6d00) 00010000:00010000:3.0:1786015317.002935:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786015317.002940:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb800, rc 0) 00000100:00100000:3.0:1786015317.003038:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+44:21821:x1872772280363136:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 826us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015317.003047:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 724 00000100:00100000:0.0:1786015317.006905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015317.007023:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280363264 00000100:00100000:1.0:1786015317.007037:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280363264 00000100:00080000:2.0:1786015317.007129:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015317.007235:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015317.007661:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 178 00000100:00100000:1.0:1786015317.007677:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280363264:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015317.007705:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015317.007738:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010ad2002/0xb1a5ef690c5004c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e813a expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015317.007802:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a746e55, blocks: 0x1 00010000:00010000:1.0:1786015317.007861:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1786015317.007867:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015317.007880:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010ad2002/0xb1a5ef690c5004c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e813a expref: 11 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.007903:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000010ad2002/0xb1a5ef690c5004c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e813a expref: 11 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.007921:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf600, rc 0) 00000100:00100000:1.0:1786015317.008010:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280363264:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 337us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015317.008019:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 178 00000100:00100000:0.0:1786015317.013499:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015317.013592:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280363520 00000100:00100000:3.0:1786015317.013605:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280363520 00000100:00100000:3.0:1786015317.013682:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 725 00000100:00100000:3.0:1786015317.013693:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:21821:x1872772280363520:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786015317.013879:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:21821:x1872772280363520:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 187us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015317.013888:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 725 00000100:00100000:2.0:1786015317.020266:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015317.020693:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280363648 00000100:00100000:1.0:1786015317.020709:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280363648 00000100:00100000:1.0:1786015317.020827:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 179 00000100:00100000:1.0:1786015317.020840:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:21821:x1872772280363648:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015317.020868:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015317.020898:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e244fc83/0xb1a5ef690c5004ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8141 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.020949:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010ad2002/0xb1a5ef690c5004c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e813a expref: 12 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.020960:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015317.020964:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015317.020971:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e244fc83/0xb1a5ef690c5004ce lrc: 4/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8141 expref: 12 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.021048:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010ad2002/0xb1a5ef690c5004c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e813a expref: 12 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.021065:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010ad2002/0xb1a5ef690c5004c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e813a expref: 12 pid: 11384 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015317.021081:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304345472:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015317.021734:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015317.027484:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015317.027588:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280363776 00000100:00100000:3.0:1786015317.027604:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280363776 00010000:00010000:3.0:1786015317.027667:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010ad2002/0xb1a5ef690c5004c7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e813a expref: 13 pid: 11384 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015317.027749:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 196 00000100:00100000:3.0:1786015317.027784:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280363776:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015317.027810:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015317.027845:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010ad2002/0xb1a5ef690c5004c7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e813a expref: 13 pid: 11384 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.027862:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010ad2002/0xb1a5ef690c5004c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e813a expref: 13 pid: 11384 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.027898:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015317.027903:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015317.027915:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e244fc83/0xb1a5ef690c5004ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8141 expref: 13 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.027928:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e244fc83/0xb1a5ef690c5004ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8141 expref: 13 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.027985:0:6607:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e244fc83/0xb1a5ef690c5004ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8141 expref: 13 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015317.028007:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6607:1872772304345600:192.168.202.56@tcp:105: 00000100:00100000:3.0:1786015317.028152:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7381ffb0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1786015317.029509:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010ad2002/0xb1a5ef690c5004c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e813a expref: 13 pid: 11384 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015317.029538:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304345472:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015317.029576:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e244fc83/0xb1a5ef690c5004ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8141 expref: 12 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.029595:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf800, rc 0) 00000100:00100000:1.0:1786015317.029677:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:21821:x1872772280363648:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 8839us (9430us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015317.029695:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 179 00000100:00100000:3.0:1786015317.037101:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6607:1872772304345600:192.168.202.56@tcp:105: 00010000:00010000:3.0:1786015317.037200:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015317.037818:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280363776:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 10052us (10341us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015317.037834:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 196 00000100:00100000:0.0:1786015317.043580:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015317.045007:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280363904 00000100:00100000:2.0:1786015317.045033:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280363904 00002000:00100000:2.0:1786015317.045121:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x10:0x0] (0->157) req@ffff8b74aeba0700 x1872772280363904/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:163/0 lens 648/0 e 0 to 0 dl 1786015328 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015317.045149:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aeba0700 with x1872772280363904 ext(0->157) 00002000:00010000:2.0:1786015317.045166:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74aeba0700 00000100:00100000:2.0:1786015317.045227:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:2.0:1786015317.045239:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280363904:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1786015317.048895:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280363904:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 3635us (5311us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1786015317.048917:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 59 00002000:00100000:2.0:1786015317.048936:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x10:0x0] (0->157) req@ffff8b74aeba0700 x1872772280363904/t4294967332(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:163/0 lens 648/448 e 0 to 0 dl 1786015328 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015317.048972:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aeba0700 with x1872772280363904 ext(0->157) 00002000:00010000:2.0:1786015317.048982:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74aeba0700 00000100:00100000:2.0:1786015317.060578:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015317.060690:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280364032 00000100:00100000:1.0:1786015317.060703:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280364032 00000100:00100000:1.0:1786015317.060825:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 726 00000100:00100000:1.0:1786015317.060837:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+44:21821:x1872772280364032:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1786015317.117001:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967760 is committed 00000001:00080000:3.0:1786015317.117034:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967747 is committed 00000001:00080000:3.0:1786015317.117046:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967763 is committed 00000001:00080000:3.0:1786015317.117058:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967762 is committed 00000001:00080000:3.0:1786015317.117083:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967766 is committed 00000004:00080000:3.0:1786015317.117092:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 11 committed 00000004:00080000:3.0:1786015317.117116:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:3.0:1786015317.117378:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304345728:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786015317.117482:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015317.117572:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304345728 00000100:00100000:3.0:1786015317.117584:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304345728 00000100:00100000:3.0:1786015317.117660:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1786015317.117671:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304345728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786015317.117714:0:14547:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:14 count 1 00010000:00010000:3.0:1786015317.117754:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057343068/0xb1a5ef690c5004d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.117812:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f1ed4291/0xb1a5ef690c500346 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80c3 expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.117822:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003bc6218e/0xb1a5ef690c50037e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80d8 expref: 10 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.117855:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786015317.117860:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015317.117865:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057343068/0xb1a5ef690c5004d5 lrc: 5/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.117899:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003bc6218e/0xb1a5ef690c50037e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80d8 expref: 10 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.117914:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003bc6218e/0xb1a5ef690c50037e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80d8 expref: 10 pid: 6591 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015317.117928:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304345856:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015317.118028:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f1ed4291/0xb1a5ef690c500346 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80c3 expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.118038:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f1ed4291/0xb1a5ef690c500346 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80c3 expref: 8 pid: 6590 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015317.118049:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304345984:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015317.118077:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482d78780 going to sleep for 11 seconds 00000100:00080000:3.0:1786015317.118095:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015317.122219:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786015317.122278:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304346112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786015317.122522:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015317.122604:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304346112 00000100:00100000:0.0:1786015317.122615:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304346112 00000100:00100000:0.0:1786015317.122750:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1786015317.122813:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304346112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786015317.123075:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1786015317.123080:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb mtime from disk: 0 -> 1786015317 00002000:00010000:0.0:1786015317.123082:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786015317.123085:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb ctime from disk: 1786015317 -> 1786015317 00002000:00010000:0.0:1786015317.123087:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1786015317.123143:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304346112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 383us (622us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1786015317.123307:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000004:00080000:0.0:1786015317.123571:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b74aeba2680/2, rc 0, transno 4294967333 00000100:00100000:0.0:1786015317.123579:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304346112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786015317.124020:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+34:21821:x1872772280364032:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 63179us (63452us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015317.124033:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 726 00000100:00100000:3.0:1786015317.124467:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015317.124493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015317.124527:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280364160 00000100:00100000:3.0:1786015317.124554:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280364160 00010000:00010000:3.0:1786015317.124606:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003bc6218e/0xb1a5ef690c50037e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80d8 expref: 11 pid: 6591 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015317.124638:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280364288 00000100:00100000:3.0:1786015317.124640:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280364288 00010000:00010000:3.0:1786015317.124656:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f1ed4291/0xb1a5ef690c500346 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80c3 expref: 9 pid: 6590 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015317.124677:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 197 00000100:00100000:3.0:1786015317.124700:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+11:2353:x1872772280364160:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015317.124716:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015317.124723:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003bc6218e/0xb1a5ef690c50037e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80d8 expref: 11 pid: 6591 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.124737:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003bc6218e/0xb1a5ef690c50037e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80d8 expref: 11 pid: 6591 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.124793:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015317.124833:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+11:2353:x1872772280364160:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 135us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015317.124840:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 197 00000100:00100000:3.0:1786015317.124857:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 198 00000100:00100000:3.0:1786015317.124863:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280364288:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015317.124871:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015317.124876:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f1ed4291/0xb1a5ef690c500346 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80c3 expref: 9 pid: 6590 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.124895:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f1ed4291/0xb1a5ef690c500346 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80c3 expref: 9 pid: 6590 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.124913:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015317.124917:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015317.124924:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000057343068/0xb1a5ef690c5004d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.124937:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057343068/0xb1a5ef690c5004d5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.124960:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015317.124978:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280364288:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 116us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015317.124984:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 198 00000100:00080000:3.0:1786015317.125013:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786015317.128327:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bc6218e/0xb1a5ef690c50037e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80d8 expref: 10 pid: 6591 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015317.128361:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304345856:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015317.128389:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1ed4291/0xb1a5ef690c500346 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e80c3 expref: 8 pid: 6590 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015317.128401:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304345984:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015317.128435:0:14547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000057343068/0xb1a5ef690c5004d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.128449:0:14547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000057343068/0xb1a5ef690c5004d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.128457:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057343068/0xb1a5ef690c5004d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.128471:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057343068/0xb1a5ef690c5004d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.128478:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057343068/0xb1a5ef690c5004d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.128539:0:14547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786015317.129586:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304345728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11909us (12097us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1786015317.129601:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00010000:00010000:1.0:1786015317.129654:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786015317.129662:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057343068/0xb1a5ef690c5004d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.129675:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819baa00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015317.129680:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057343068/0xb1a5ef690c5004d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.129692:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057343068/0xb1a5ef690c5004d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.129717:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057343068/0xb1a5ef690c5004d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.129724:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057343068/0xb1a5ef690c5004d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.129749:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015317.129752:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015317.129754:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1786015317.129827:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b74b8c7f480/2, rc 0, transno 4294967327 00000100:00100000:1.0:1786015317.129836:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304345728:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786015317.130417:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015317.131125:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280364416 00000100:00100000:1.0:1786015317.131141:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280364416 00000100:00100000:1.0:1786015317.131403:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 182 00000100:00100000:1.0:1786015317.131416:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280364416:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1786015317.165177:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304346240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015317.165305:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015317.165401:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304346240 00000100:00100000:0.0:1786015317.165413:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304346240 00000100:00100000:0.0:1786015317.165486:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1786015317.165496:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304346240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015317.165528:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 61276160 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015317.165584:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304346240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015317.165595:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1786015317.166456:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304346240:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1786015317.196679:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967333 is committed 00000001:00080000:3.0:1786015317.196706:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967332 is committed 00000100:00100000:1.0:1786015317.197197:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280364416:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 65764us (66764us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015317.197214:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 182 00000100:00100000:3.0:1786015317.204017:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015317.204336:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280364672 00000100:00100000:1.0:1786015317.204354:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280364672 00000100:00100000:1.0:1786015317.204571:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 727 00000100:00100000:1.0:1786015317.204584:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+34:21821:x1872772280364672:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786015317.204660:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015317.205029:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5004c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8133 expref: 34 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.205055:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8b7483ee6d00) 00010000:00010000:1.0:1786015317.205061:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015317.205468:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5004dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.205492:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5004dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.205507:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5004dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786015317.206017:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec08df0f reply state 0000000063c4e969 transno 4294967767 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5004dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015317.206057:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786015317.206554:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+35:21821:x1872772280364672:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 1967us (2551us total) trans 4294967767 rc 0/0 00000100:00100000:1.0:1786015317.206565:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 727 00000100:00100000:0.0:1786015317.211715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:2.0:1786015317.212395:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5004dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.212414:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5004dc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.212422:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5004dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.212429:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015317.212434:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5004dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.212443:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5004dc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.212468:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8b7483ee6d00) 00010000:00010000:2.0:1786015317.212471:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015317.212477:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5004dc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.212483:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5004dc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015317.212651:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280364800 00000100:00100000:1.0:1786015317.212668:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280364800 00000100:00100000:1.0:1786015317.212883:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 183 00000100:00100000:1.0:1786015317.212897:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280364800:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1786015317.213334:0:6590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb size from disk: 158 -> 158 00002000:00010000:1.0:1786015317.213340:0:6590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb mtime from disk: 1786015317 -> 1786015312 00002000:00010000:1.0:1786015317.213343:0:6590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb atime from disk: 0 -> 1786015312 00002000:00010000:1.0:1786015317.213345:0:6590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb ctime from disk: 1786015317 -> 1786015316 00002000:00010000:1.0:1786015317.213347:0:6590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1786015317.213477:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280364800:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 582us (1780us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1786015317.213489:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 183 00000100:00100000:2.0:1786015317.221613:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015317.221716:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280365056 00000100:00100000:1.0:1786015317.222253:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280365056 00000100:00100000:2.0:1786015317.222626:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 728 00000100:00100000:2.0:1786015317.222641:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+34:21821:x1872772280365056:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1786015317.222820:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c5004e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.222844:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5004a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8125 expref: 34 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.222855:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c5004e3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.222921:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5004a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8125 expref: 34 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.222938:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5004a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8125 expref: 34 pid: 5795 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015317.222958:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304346368:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015317.223098:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b7e16900 going to sleep for 11 seconds 00000100:00100000:2.0:1786015317.226653:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304346368:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015317.226700:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c5004e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015317.227856:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015317.228470:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280365184 00000100:00100000:0.0:1786015317.228486:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280365184 00010000:00010000:0.0:1786015317.228550:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5004a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8125 expref: 35 pid: 5795 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015317.228605:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 199 00000100:00100000:0.0:1786015317.228617:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74865ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+35:2354:x1872772280365184:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015317.228639:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015317.228647:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5004a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8125 expref: 35 pid: 5795 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.228661:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5004a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8125 expref: 35 pid: 5795 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.228694:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5004a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8125 expref: 35 pid: 5795 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.228719:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8b7483ee6d00) 00010000:00010000:0.0:1786015317.228739:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c5004e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.228752:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c5004e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.228782:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c5004e3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.228848:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015317.228928:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74865ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+34:2354:x1872772280365184:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 313us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015317.228937:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 199 00010000:00010000:0.0:1786015317.229134:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c5004e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.229143:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c5004e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.229985:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c5004e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.229999:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c5004e3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.230009:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c5004e3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.230021:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015317.230027:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c5004e3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.230036:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c5004e3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.230053:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8b7483ee6d00) 00010000:00010000:0.0:1786015317.230056:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1786015317.230061:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c5004e3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.230089:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c5004e3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015317.230403:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+33:21821:x1872772280365056:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 7760us (8798us total) trans 0 rc -22/-22 00000100:00100000:0.0:1786015317.230428:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 728 00000100:00100000:2.0:1786015317.248202:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015317.248499:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280365312 00000100:00100000:1.0:1786015317.248516:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280365312 00000100:00100000:1.0:1786015317.248600:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 184 00000100:00100000:1.0:1786015317.248613:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280365312:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015317.248679:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c5004ea lrc: 3/1,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.248747:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e244fc83/0xb1a5ef690c5004ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8141 expref: 11 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.248913:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015317.248920:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015317.248926:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c5004ea lrc: 4/1,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.248980:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e244fc83/0xb1a5ef690c5004ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8141 expref: 11 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.249000:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e244fc83/0xb1a5ef690c5004ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8141 expref: 11 pid: 6591 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015317.249021:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304346496:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015317.249447:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015317.259045:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304346496:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015317.259099:0:14547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c5004ea lrc: 3/1,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015317.261441:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015317.261864:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280365440 00000100:00100000:3.0:1786015317.261881:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280365440 00010000:00010000:3.0:1786015317.261943:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e244fc83/0xb1a5ef690c5004ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8141 expref: 12 pid: 6591 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015317.261995:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 200 00000100:00100000:3.0:1786015317.262030:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280365440:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015317.262052:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015317.262085:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e244fc83/0xb1a5ef690c5004ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8141 expref: 12 pid: 6591 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.262103:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e244fc83/0xb1a5ef690c5004ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8141 expref: 12 pid: 6591 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.262136:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e244fc83/0xb1a5ef690c5004ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8141 expref: 12 pid: 6591 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.262171:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015317.262175:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015317.262191:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c5004ea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.262204:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c5004ea lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.262254:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015317.262342:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280365440:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 313us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015317.262351:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 200 00010000:00010000:0.0:1786015317.262457:0:14547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c5004ea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.262467:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c5004ea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.262497:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c5004ea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.262506:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c5004ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.262514:0:14547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c5004ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.262522:0:14547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813be200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015317.262526:0:14547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c5004ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.262534:0:14547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c5004ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.262557:0:14547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c5004ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.262564:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ff7b10d/0xb1a5ef690c5004ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015317.262620:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2352:x1872772280365312:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 14011us (14443us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015317.262629:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 184 00000100:00100000:2.0:1786015317.273538:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015317.273677:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280365696 00000100:00100000:1.0:1786015317.273692:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280365696 00000100:00100000:3.0:1786015317.274070:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 729 00000100:00100000:3.0:1786015317.274086:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+33:21821:x1872772280365696:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786015317.274699:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5004f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.274919:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5004f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.274938:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5004f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.276550:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c5004f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.276606:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5004b2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e812c expref: 34 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.276616:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c5004f8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.276681:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5004b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e812c expref: 34 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.276706:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5004b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e812c expref: 34 pid: 5794 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015317.276846:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304346624:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015317.276983:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b7e16240 going to sleep for 11 seconds 00000100:00100000:2.0:1786015317.282550:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015317.282798:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304346624:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015317.282838:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c5004f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015317.283056:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280365824 00000100:00100000:3.0:1786015317.283067:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280365824 00010000:00010000:3.0:1786015317.283119:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5004b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e812c expref: 35 pid: 5794 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015317.283170:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 201 00000100:00100000:3.0:1786015317.283181:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+35:2354:x1872772280365824:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015317.283213:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015317.283222:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5004b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e812c expref: 35 pid: 5794 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.283237:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5004b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e812c expref: 35 pid: 5794 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.283267:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5004b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e812c expref: 35 pid: 5794 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.283287:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8b7483ee6d00) 00010000:00010000:3.0:1786015317.283293:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c5004f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.283306:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c5004f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.283332:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c5004f8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.283369:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015317.283436:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+34:2354:x1872772280365824:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 257us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015317.283444:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 201 00010000:00010000:0.0:1786015317.285595:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c5004f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.285620:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c5004f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786015317.286305:0:7673:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967768 00000001:00080000:0.0:1786015317.286645:0:7673:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967769 00000001:00080000:0.0:1786015317.288064:0:7673:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967770 00000100:00100000:0.0:1786015317.289142:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7673:1872772304346752:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786015317.296973:0:7673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015317.297049:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7381ffba80 going to sleep for 11 seconds 00000100:00100000:1.0:1786015317.297229:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304346752 00000100:00100000:1.0:1786015317.297243:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304346752 00000100:00100000:1.0:1786015317.297325:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1786015317.297354:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7673:x1872772304346752:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1786015317.297492:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7673:x1872772304346752:12345-0@lo:1000:mdt00_003.0 Request processed in 142us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015317.297500:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786015317.297809:0:7673:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967333 gen 2 00000004:00080000:0.0:1786015317.297823:0:7673:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b74aeba2680, transno 4294967333 00000100:00100000:0.0:1786015317.297845:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7673:1872772304346752:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1786015317.300439:0:7673:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967771 00000100:00100000:1.0:1786015317.305490:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7673:1872772304346880:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1786015317.305622:0:7673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015317.305664:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54e180 going to sleep for 11 seconds 00000100:00100000:2.0:1786015317.305787:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304346880 00000100:00100000:2.0:1786015317.305805:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304346880 00000100:00100000:2.0:1786015317.305906:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1786015317.305919:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7673:x1872772304346880:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786015317.306499:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7673:x1872772304346880:12345-0@lo:1000:mdt00_003.0 Request processed in 579us (874us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1786015317.306510:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786015317.306824:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7673:1872772304346880:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1786015317.306893:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c5004f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.306906:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c5004f8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.306915:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c5004f8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.306921:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015317.306927:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c5004f8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.306936:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c5004f8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.306956:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8b7483ee6d00) 00010000:00010000:3.0:1786015317.306960:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015317.306966:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c5004f8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.306974:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c5004f8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.307033:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500442 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.307041:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500442 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.307047:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500442 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.307052:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015317.307056:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500442 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.307063:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500442 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.307073:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8b749232d900) 00010000:00010000:3.0:1786015317.307076:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015317.307086:0:7673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c500449 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8110 expref: 72 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.307101:0:7673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c500449 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8110 expref: 72 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.307113:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c500449 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8110 expref: 72 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.307176:0:7673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bac00/0xb1a5ef690c500449 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8110 expref: 72 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015317.307219:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304347008:192.168.202.56@tcp:105: 00000100:00100000:3.0:1786015317.307347:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7483ea6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786015317.313312:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304347008:192.168.202.56@tcp:105: 00010000:00010000:3.0:1786015317.313375:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500442 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.313388:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500442 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.313448:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c5004ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.313465:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c5004ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.313480:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c5004ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.313493:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c5004ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.313499:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c5004ff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.313507:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c5004ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.313514:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015317.313518:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c5004ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.313544:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c5004ff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.313559:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8b749232d900) 00010000:00010000:3.0:1786015317.313562:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015317.313565:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c5004ff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.313570:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb200/0xb1a5ef690c5004ff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.313582:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5004f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.313587:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5004f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.313593:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5004f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.313598:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819baa00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015317.313601:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5004f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.313608:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5004f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.313616:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8b749232d900) 00010000:00010000:3.0:1786015317.313619:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786015317.313622:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5004f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015317.313638:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5004f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015317.314241:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+37:21821:x1872772280365696:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 40153us (40878us total) trans 4294967772 rc 0/0 00000100:00100000:3.0:1786015317.314255:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 729 00000020:00080000:3.0:1786015317.314264:0:7673:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1786015317.315460:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015317.315470:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015317.316796:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1786015317.316823:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015317.324519:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015317.324737:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280365952 00000100:00100000:1.0:1786015317.324757:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280365952 00000100:00100000:1.0:1786015317.324925:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 147 00000100:00100000:1.0:1786015317.324938:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+73:21819:x1872772280365952:12345-192.168.202.56@tcp:49:md5sum.0 00000100:00100000:1.0:1786015317.325167:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+73:21819:x1872772280365952:12345-192.168.202.56@tcp:49:md5sum.0 Request processed in 230us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015317.325176:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 147 00000100:00080000:3.0:1786015317.325291:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015317.337143:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015317.339319:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280366208 00000100:00100000:1.0:1786015317.339349:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280366208 00000100:00100000:1.0:1786015317.339492:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 148 00000100:00100000:1.0:1786015317.339504:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+37:21821:x1872772280366208:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1786015317.348374:0:5798:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x13:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1786015317.350974:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967773 00010000:00010000:1.0:1786015317.351112:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500506 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.351158:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500506 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.351174:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500506 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.351195:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500506 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.351202:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500506 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.351210:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500506 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015317.351248:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786015317.351673:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015317.351724:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280366336 00000100:00100000:0.0:1786015317.351735:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280366336 00000100:00100000:0.0:1786015317.351851:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 185 00000100:00100000:0.0:1786015317.351863:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+9:21819:x1872772280366336:12345-192.168.202.56@tcp:101:md5sum.0 00010000:00010000:0.0:1786015317.351888:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015317.351912:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfc0e6c3/0xb1a5ef690c50050d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8148 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015317.351946:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 158, mtime: 0x6a746e50, atime: 0x6a746e50, ctime: 0x6a746e54, blocks: 0xb 00010000:00010000:0.0:1786015317.351975:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1786015317.351980:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015317.351992:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfc0e6c3/0xb1a5ef690c50050d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8148 expref: 10 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.352010:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dfc0e6c3/0xb1a5ef690c50050d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8148 expref: 10 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015317.352027:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7381935600, rc 0) 00000100:00100000:0.0:1786015317.352112:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+10:21819:x1872772280366336:12345-192.168.202.56@tcp:101:md5sum.0 Request processed in 250us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015317.352119:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 185 00000100:00080000:0.0:1786015317.352146:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1786015317.353027:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786015317.353043:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500506 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.353073:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf800 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015317.353077:0:6606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500506 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.353087:0:6606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500506 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.353107:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:2.0:1786015317.353110:0:6606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786015317.353127:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500506 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.353133:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500506 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015317.353162:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015317.353165:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015317.353166:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015317.358507:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+39:21821:x1872772280366208:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 18985us (21372us total) trans 4294967774 rc 0/0 00000100:00100000:0.0:1786015317.358527:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 148 00000020:00080000:0.0:1786015317.358536:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786015317.363874:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015317.364087:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280366464 00000100:00100000:2.0:1786015317.364102:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280366464 00002000:00100000:2.0:1786015317.364177:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x10:0x0] (0->4095) req@ffff8b7381307b80 x1872772280366464/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:163/0 lens 488/0 e 0 to 0 dl 1786015328 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015317.364199:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381307b80 with x1872772280366464 ext(0->4095) 00002000:00010000:2.0:1786015317.364208:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7381307b80 00000100:00100000:2.0:1786015317.364258:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:2.0:1786015317.364269:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41677fca-39fb-471c-b582-96bce6540a36+10:2354:x1872772280366464:12345-192.168.202.56@tcp:3:md5sum.0 00000100:00100000:2.0:1786015317.364694:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41677fca-39fb-471c-b582-96bce6540a36+10:2354:x1872772280366464:12345-192.168.202.56@tcp:3:md5sum.0 Request processed in 424us (838us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786015317.364712:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 60 00002000:00100000:2.0:1786015317.364721:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x10:0x0] (0->4095) req@ffff8b7381307b80 x1872772280366464/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:163/0 lens 488/4536 e 0 to 0 dl 1786015328 ref 1 fl Complete:/600/0 rc 4096/4096 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015317.364743:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381307b80 with x1872772280366464 ext(0->4095) 00002000:00010000:2.0:1786015317.364747:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7381307b80 00000100:00100000:2.0:1786015317.375456:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015317.375571:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280366720 00000100:00100000:1.0:1786015317.375585:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280366720 00000100:00100000:1.0:1786015317.375692:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 149 00000100:00100000:1.0:1786015317.375705:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916b4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+73:21819:x1872772280366720:12345-192.168.202.56@tcp:35:md5sum.0 00000100:00100000:2.0:1786015317.376646:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916b4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+74:21819:x1872772280366720:12345-192.168.202.56@tcp:35:md5sum.0 Request processed in 935us (1199us total) trans 4294967775 rc 0/0 00000100:00100000:2.0:1786015317.376659:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 149 00010000:00010000:0.0:1786015317.868122:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015318.895834:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015319.916004:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015320.144564:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015320.144625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015320.144668:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015320.144694:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015320.144718:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015320.144741:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015320.144807:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015320.144860:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280367104 00000100:00100000:0.0:1786015320.144873:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280367104 00000100:00100000:0.0:1786015320.144944:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280367616 00000100:00100000:0.0:1786015320.144948:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280367616 00000100:00100000:0.0:1786015320.144966:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280367232 00000100:00100000:0.0:1786015320.144968:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280367232 00000100:00100000:0.0:1786015320.144984:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280367488 00000100:00100000:0.0:1786015320.144987:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280367488 00000100:00100000:0.0:1786015320.145005:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 282 00000100:00100000:0.0:1786015320.145016:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280367104:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015320.145123:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280367104:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 107us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015320.145132:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 282 00000100:00100000:0.0:1786015320.145238:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 283 00000100:00100000:0.0:1786015320.145325:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280367616:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015320.145446:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280367616:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 200us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015320.145454:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 283 00000100:00100000:0.0:1786015320.145468:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 284 00000100:00100000:0.0:1786015320.145477:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280367232:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015320.145508:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280367232:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015320.145515:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 284 00000100:00100000:0.0:1786015320.145528:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 285 00000100:00100000:0.0:1786015320.145535:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280367488:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015320.145561:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280367488:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015320.145569:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 285 00000100:00100000:0.0:1786015320.145594:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280367360 00000100:00100000:0.0:1786015320.145599:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280367360 00000100:00100000:0.0:1786015320.145638:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280366976 00000100:00100000:0.0:1786015320.145641:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280366976 00000100:00100000:0.0:1786015320.145665:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 325 00000100:00100000:0.0:1786015320.145671:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+39:2353:x1872772280367360:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015320.145707:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+39:2353:x1872772280367360:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 36us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015320.145713:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 325 00000100:00100000:0.0:1786015320.145726:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 326 00000100:00100000:0.0:1786015320.145732:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+74:2353:x1872772280366976:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015320.145798:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+74:2353:x1872772280366976:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 66us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015320.145805:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 326 00000100:00080000:0.0:1786015320.145848:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015320.145853:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015320.145855:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015320.146665:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280366848 00000100:00100000:3.0:1786015320.146674:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280366848 00000100:00100000:3.0:1786015320.146723:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 367 00000100:00100000:3.0:1786015320.146732:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280366848:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015320.146803:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280366848:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 72us (2255us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015320.146810:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 367 00000100:00100000:0.0:1786015320.249219:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304347136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015320.249331:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015320.250125:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304347136 00000100:00100000:2.0:1786015320.250141:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304347136 00000100:00100000:2.0:1786015320.250262:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1786015320.250276:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304347136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015320.250331:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015320.250428:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304347136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015320.250436:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:3.0:1786015320.250724:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015320.251078:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304347136:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1786015320.887021:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967327 is committed 00010000:00010000:2.0:1786015320.944015:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015321.783705:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304347392:0@lo:400:kworker.0 00000100:00100000:1.0:1786015321.783857:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015321.784043:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304347264:0@lo:400:kworker.0 00000100:00100000:0.0:1786015321.784095:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015321.784152:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304347264 00000100:00100000:0.0:1786015321.784163:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304347264 00000100:00100000:0.0:1786015321.784243:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1786015321.784255:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304347264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015321.784344:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304347264:12345-0@lo:400:kworker.0 Request processed in 91us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015321.784354:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1786015321.784424:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304347520:0@lo:400:kworker.0 00000100:00100000:0.0:1786015321.784452:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015321.784476:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304347392 00000100:00100000:0.0:1786015321.784480:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304347392 00000100:00100000:0.0:1786015321.784515:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304347520 00000100:00100000:0.0:1786015321.784518:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304347520 00000100:00100000:0.0:1786015321.784801:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1786015321.784809:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304347392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015321.784851:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304347392:12345-0@lo:400:kworker.0 Request processed in 44us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015321.784878:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1786015321.784894:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1786015321.784901:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304347520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015321.785082:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304347520:12345-0@lo:400:kworker.0 Request processed in 181us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015321.785089:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00080000:0.0:1786015321.785117:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015321.785486:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304347392:0@lo:400:kworker.0 00000100:00100000:1.0:1786015321.785498:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304347904:0@lo:400:kworker.0 00000100:00100000:1.0:1786015321.785541:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015321.785578:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304347904 00000100:00100000:1.0:1786015321.785583:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304347904 00000100:00100000:1.0:1786015321.785640:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1786015321.785647:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304347904:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786015321.785888:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015321.786039:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304347904:12345-0@lo:400:kworker.0 Request processed in 390us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015321.786046:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1786015321.786157:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304347648:0@lo:400:kworker.0 00000100:00100000:2.0:1786015321.786199:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015321.787055:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304347648 00000100:00100000:1.0:1786015321.787067:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304347648 00000100:00100000:1.0:1786015321.787116:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1786015321.787126:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304347648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015321.787220:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304347648:12345-0@lo:400:kworker.0 Request processed in 95us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015321.788149:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304347264:0@lo:400:kworker.0 00000100:00100000:0.0:1786015321.788169:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304347776:0@lo:400:kworker.0 00000100:00100000:0.0:1786015321.788242:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015321.788501:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304347776 00000100:00100000:0.0:1786015321.788508:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304347776 00000100:00100000:0.0:1786015321.788579:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1786015321.788587:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304347776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015321.788647:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304347776:12345-0@lo:400:kworker.0 Request processed in 61us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015321.788655:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00080000:3.0:1786015321.789077:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015321.789133:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304347520:0@lo:400:kworker.0 00000100:00100000:3.0:1786015321.789201:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304347904:0@lo:400:kworker.0 00000100:00100000:1.0:1786015321.789597:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1786015321.789659:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967327 gen 2 00000004:00080000:1.0:1786015321.789668:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b74b8c7f480, transno 4294967327 00000100:00100000:0.0:1786015321.790463:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304347776:0@lo:400:kworker.0 00000100:00100000:1.0:1786015321.790613:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304347648:0@lo:400:kworker.0 00010000:00010000:1.0:1786015321.971497:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015322.292805:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304348032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015322.292941:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015322.293195:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304348032 00000100:00100000:3.0:1786015322.293207:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304348032 00000100:00100000:3.0:1786015322.293269:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1786015322.293280:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304348032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015322.293353:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015322.293413:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304348032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015322.293421:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1786015322.293489:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304348032:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1786015322.416199:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967334 is committed 00000001:00080000:3.0:1786015322.416705:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967335 is committed 00000001:00080000:2.0:1786015322.453441:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967772 is committed 00000020:00080000:2.0:1786015322.453462:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b7381ffb0c0 refcount 2 committed 0 result 0 batchid 10 00000020:00080000:2.0:1786015322.453480:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b7488337d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b7381ffba80 00000020:00080000:2.0:1786015322.453484:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b7488337c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b7485016000 00000001:00080000:2.0:1786015322.453521:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967774 is committed 00000001:00080000:2.0:1786015322.453557:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967775 is committed 00000020:00080000:1.0:1786015322.454060:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 10 committed batchid 9 00000020:00080000:1.0:1786015322.454346:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 9 00000100:00100000:0.0:1786015322.684526:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015322.684653:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280367744 00000100:00100000:1.0:1786015322.684667:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280367744 00000100:00100000:1.0:1786015322.684778:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 730 00000100:00100000:1.0:1786015322.684792:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+31:21767:x1872772280367744:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1786015322.684931:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+31:21767:x1872772280367744:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 143us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015322.684939:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 730 00000100:00080000:2.0:1786015322.685098:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015322.689399:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015322.689535:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280368000 00000100:00100000:1.0:1786015322.689570:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280368000 00000100:00100000:0.0:1786015322.690036:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 150 00000100:00100000:0.0:1786015322.690052:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+31:21767:x1872772280368000:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786015322.690745:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+32:21767:x1872772280368000:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 694us (1359us total) trans 4294967776 rc 0/0 00000100:00100000:0.0:1786015322.690809:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 150 00010000:00010000:1.0:1786015322.988216:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015324.012563:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786015324.194496:0:16930:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 11c: Import a file to a directory with a pool ========================================================== 07:22:03 (1786015323) 00000040:00080000:1.0:1786015324.460698:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015324.460713:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015324.461152:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 18 count 2 00000040:00080000:1.0:1786015324.461163:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786015325.036451:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015325.247562:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015325.247627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015325.247653:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015325.247683:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015325.247701:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015325.247719:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015325.247746:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015325.247805:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280368512 00000100:00100000:2.0:1786015325.247806:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280368256 00000100:00100000:2.0:1786015325.247818:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280368256 00000100:00100000:1.0:1786015325.247818:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280368512 00000100:00100000:2.0:1786015325.247889:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280368640 00000100:00100000:1.0:1786015325.247889:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280368768 00000100:00100000:2.0:1786015325.247892:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280368640 00000100:00100000:1.0:1786015325.247892:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280368768 00000100:00100000:1.0:1786015325.247905:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280368384 00000100:00100000:1.0:1786015325.247908:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280368384 00000100:00100000:2.0:1786015325.247919:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 330 00000100:00100000:1.0:1786015325.247920:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280368896 00000100:00100000:1.0:1786015325.247922:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280368896 00000100:00100000:1.0:1786015325.247936:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 288 00000100:00100000:2.0:1786015325.247941:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+73:2352:x1872772280368256:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015325.247942:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2352:x1872772280368512:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015325.248048:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+73:2352:x1872772280368256:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 120us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015325.248058:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 330 00000100:00100000:2.0:1786015325.248079:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 331 00000100:00100000:2.0:1786015325.248086:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+32:2352:x1872772280368640:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015325.254639:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2352:x1872772280368512:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 6674us (6988us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015325.254663:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 288 00000100:00100000:1.0:1786015325.254723:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 289 00000100:00100000:1.0:1786015325.254742:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280368768:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015325.254836:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280368768:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 103us (7180us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015325.254854:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 289 00000100:00100000:1.0:1786015325.254870:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 290 00000100:00100000:1.0:1786015325.254878:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2352:x1872772280368384:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015325.254909:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2352:x1872772280368384:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (7207us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015325.254915:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 290 00000100:00100000:1.0:1786015325.254928:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 291 00000100:00100000:1.0:1786015325.254936:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280368896:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015325.254965:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280368896:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (7218us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015325.254971:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 291 00000100:00100000:1.0:1786015325.255016:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280368128 00000100:00100000:1.0:1786015325.255029:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280368128 00000100:00100000:1.0:1786015325.255092:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 369 00000100:00100000:1.0:1786015325.255099:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280368128:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015325.255144:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280368128:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 45us (7459us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015325.255152:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 369 00000100:00080000:1.0:1786015325.255475:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015325.255485:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015325.255489:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015325.266201:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+32:2352:x1872772280368640:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 18088us (18454us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015325.266224:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 331 00000100:00100000:0.0:1786015325.356045:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786015325.356083:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304348160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015325.356215:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015325.356522:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304348160 00000100:00100000:0.0:1786015325.356535:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304348160 00000100:00100000:0.0:1786015325.356793:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1786015325.356804:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304348160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015325.356859:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015325.356927:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304348160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015325.356936:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1786015325.357000:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304348160:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786015325.362445:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1786015325.466728:0:16978:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd24b09cb0 20000000:00000080:0.0:1786015325.466756:0:16978:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8b74c1016800 uarg=0000000000000000 00000040:00100000:0.0:1786015325.469604:0:16978:0:(llog.c:1072:llog_reverse_process()) index 41 : idx 1 00000040:00080000:0.0:1786015325.472234:0:16978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 224 off15448 20000000:01000000:0.0:1786015325.472444:0:16978:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre test_11c (null) (null) 00000040:00080000:0.0:1786015325.472546:0:16978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 112 off15560 00000040:00080000:0.0:1786015325.472586:0:16978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15784 00000040:00080000:0.0:1786015325.473847:0:16978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 224 off14712 20000000:01000000:0.0:1786015325.473880:0:16978:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre test_11c (null) (null) 00000040:00080000:0.0:1786015325.473911:0:16978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 120 off14832 00000040:00080000:0.0:1786015325.473962:0:16978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off15056 10000000:01000000:0.0:1786015325.473986:0:16978:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1786015325.474433:0:16978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500514 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.474473:0:16978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7480030400/0xb1a5ef690c4fd62f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c4fd628 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.474483:0:16978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b74bf9e7e00/0xb1a5ef690c4fd63d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c4fd636 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.474490:0:16978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c4fd64b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c4fd644 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.474497:0:16978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b74c2179200/0xb1a5ef690c4fd659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c4fd652 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.474503:0:16978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7480031000/0xb1a5ef690c4fd667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c4fd660 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.474511:0:16978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7480031200/0xb1a5ef690c4fd675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c4fd66e expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.474518:0:16978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7488061800/0xb1a5ef690c4fd683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c4fd67c expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.474530:0:16978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b74bf9e6000/0xb1a5ef690c4fd68a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73a3 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.474537:0:16978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b74bf9e6c00/0xb1a5ef690c4fd691 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73aa expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.474545:0:16978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7488061e00/0xb1a5ef690c4fd6d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73b8 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.474564:0:16978:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500514 lrc: 13/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.474635:0:16978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7488061e00/0xb1a5ef690c4fd6d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73b8 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.474657:0:16978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b7488061e00/0xb1a5ef690c4fd6d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73b8 expref: 12 pid: 5789 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015325.474680:0:16978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304348288:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015325.474948:0:16978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b74bf9e6c00/0xb1a5ef690c4fd691 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73aa expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.474958:0:16978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b74bf9e6c00/0xb1a5ef690c4fd691 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73aa expref: 12 pid: 5787 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015325.474968:0:16978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304348416:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015325.474998:0:16978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b74bf9e6000/0xb1a5ef690c4fd68a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73a3 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.475017:0:16978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b74bf9e6000/0xb1a5ef690c4fd68a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73a3 expref: 12 pid: 5787 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015325.475026:0:16978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304348544:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015325.475051:0:16978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7488061800/0xb1a5ef690c4fd683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c4fd67c expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.475060:0:16978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7488061800/0xb1a5ef690c4fd683 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd67c expref: 18 pid: 5790 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015325.475077:0:16978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304348672:0@lo:104: 00000100:00100000:0.0:1786015325.475137:0:16978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786015325.475184:0:16978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7480031200/0xb1a5ef690c4fd675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c4fd66e expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.475201:0:16978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7480031200/0xb1a5ef690c4fd675 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd66e expref: 18 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015325.475209:0:16978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304348800:0@lo:104: 00000100:00100000:0.0:1786015325.475229:0:16978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786015325.475261:0:16978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7480031000/0xb1a5ef690c4fd667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c4fd660 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.475269:0:16978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7480031000/0xb1a5ef690c4fd667 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd660 expref: 18 pid: 5790 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015325.475277:0:16978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304348928:0@lo:104: 00000100:00100000:3.0:1786015325.475445:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304348672 00000100:00100000:3.0:1786015325.475455:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304348672 00000100:00100000:3.0:1786015325.475518:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304348800 00000100:00100000:3.0:1786015325.475520:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304348800 00000100:00100000:3.0:1786015325.475534:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786015325.475543:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+4:16978:x1872772304348672:12345-0@lo:104: 00010000:00010000:3.0:1786015325.475560:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b7488060a00/0xb1a5ef690c4fd67c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c4fd683 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.475620:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786015325.475626:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+4:16978:x1872772304348672:12345-0@lo:104: Request processed in 85us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015325.475633:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786015325.475651:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1786015325.475656:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+3:16978:x1872772304348800:12345-0@lo:104: 00010000:00010000:3.0:1786015325.475663:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c4fd66e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c4fd675 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.475691:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1786015325.475695:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+3:16978:x1872772304348800:12345-0@lo:104: Request processed in 40us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015325.475709:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1786015325.475801:0:16978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786015325.475839:0:16978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b74c2179200/0xb1a5ef690c4fd659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c4fd652 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.475848:0:16978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b74c2179200/0xb1a5ef690c4fd659 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd652 expref: 18 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015325.475857:0:16978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304349056:0@lo:104: 00000100:00100000:0.0:1786015325.475879:0:16978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786015325.475892:0:16978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c4fd64b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c4fd644 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.475911:0:16978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c4fd64b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd644 expref: 18 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015325.475920:0:16978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9adc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304349184:0@lo:104: 00000100:00100000:0.0:1786015325.475938:0:16978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786015325.475955:0:16978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b74bf9e7e00/0xb1a5ef690c4fd63d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c4fd636 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.475963:0:16978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b74bf9e7e00/0xb1a5ef690c4fd63d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd636 expref: 18 pid: 5790 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015325.475970:0:16978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304349312:0@lo:104: 00000100:00100000:0.0:1786015325.475986:0:16978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786015325.475997:0:16978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7480030400/0xb1a5ef690c4fd62f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c4fd628 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.476004:0:16978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7480030400/0xb1a5ef690c4fd62f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd628 expref: 18 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015325.476012:0:16978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304349440:0@lo:104: 00000100:00100000:0.0:1786015325.476029:0:16978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015325.476037:0:16978:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b8e29300 going to sleep for 11 seconds 00000100:00100000:0.0:1786015325.476063:0:16978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304348672:0@lo:104: 00000100:00100000:0.0:1786015325.476070:0:16978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304348800:0@lo:104: 00010000:00010000:0.0:1786015325.476124:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786015325.476132:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b7488060a00/0xb1a5ef690c4fd67c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c4fd683 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.476154:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488060a00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1786015325.476159:0:8308:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b7488060a00/0xb1a5ef690c4fd67c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c4fd683 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.476169:0:8308:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b7488060a00/0xb1a5ef690c4fd67c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c4fd683 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786015325.476177:0:8308:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b7488060a00/0xb1a5ef690c4fd67c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c4fd683 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786015325.476183:0:8308:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1786015325.476353:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304348928 00000100:00100000:2.0:1786015325.476360:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304348928 00000100:00100000:2.0:1786015325.476388:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304349056 00000100:00100000:2.0:1786015325.476391:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304349056 00000100:00100000:2.0:1786015325.476413:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304349184 00000100:00100000:2.0:1786015325.476416:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304349184 00000100:00100000:2.0:1786015325.476427:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304349312 00000100:00100000:3.0:1786015325.476429:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304349440 00000100:00100000:2.0:1786015325.476429:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304349312 00000100:00100000:3.0:1786015325.476433:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304349440 00000100:00100000:2.0:1786015325.476441:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786015325.476448:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+7:16978:x1872772304348928:12345-0@lo:104: 00000100:00100000:3.0:1786015325.476449:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1786015325.476454:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+7:16978:x1872772304349056:12345-0@lo:104: 00010000:00010000:2.0:1786015325.476458:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b7480031a00/0xb1a5ef690c4fd660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c4fd667 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.476460:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c4fd652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c4fd659 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015325.476512:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1786015325.476518:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+7:16978:x1872772304348928:12345-0@lo:104: Request processed in 71us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015325.476524:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1786015325.476538:0:8308:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b7488060a00/0xb1a5ef690c4fd67c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd683 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015325.476539:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1786015325.476544:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+6:16978:x1872772304349184:12345-0@lo:104: 00010000:00010000:0.0:1786015325.476545:0:8308:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786015325.476552:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b7488060c00/0xb1a5ef690c4fd644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c4fd64b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.476569:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b7488060a00/0xb1a5ef690c4fd67c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd683 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.476576:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b7488060a00/0xb1a5ef690c4fd67c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd683 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.476598:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786015325.476603:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c4fd66e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c4fd675 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.476609:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178600 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1786015325.476612:0:8308:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c4fd66e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c4fd675 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.476632:0:8308:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c4fd66e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c4fd675 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786015325.476639:0:8308:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c4fd66e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c4fd675 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786015325.476644:0:8308:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1786015325.476660:0:8308:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c4fd66e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd675 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.476665:0:8308:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786015325.476682:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c4fd66e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd675 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.476690:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c4fd66e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd675 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.476702:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786015325.476705:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b7480031a00/0xb1a5ef690c4fd660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c4fd667 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.476711:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7480031a00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1786015325.476713:0:8308:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b7480031a00/0xb1a5ef690c4fd660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c4fd667 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.476719:0:8308:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b7480031a00/0xb1a5ef690c4fd660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c4fd667 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786015325.476725:0:8308:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b7480031a00/0xb1a5ef690c4fd660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c4fd667 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786015325.476738:0:8308:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1786015325.476753:0:8308:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b7480031a00/0xb1a5ef690c4fd660 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd667 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.476811:0:8308:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786015325.476819:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b7480031a00/0xb1a5ef690c4fd660 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd667 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.476826:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b7480031a00/0xb1a5ef690c4fd660 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd667 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.476838:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015325.476840:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015325.476842:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015325.476861:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304349568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786015325.476899:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015325.481608:0:16978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304348928:0@lo:104: 00000100:00100000:0.0:1786015325.481640:0:16978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304349056:0@lo:104: 00000100:00100000:0.0:1786015325.481651:0:16978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9adc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304349184:0@lo:104: 00000100:00100000:0.0:1786015325.481722:0:16978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304348288:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015325.481843:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015325.481879:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304349568 00000100:00100000:0.0:1786015325.481891:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304349568 00010000:00010000:0.0:1786015325.481955:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7488061800/0xb1a5ef690c4fd683 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd67c expref: 19 pid: 5790 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015325.482028:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1786015325.482063:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304349568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786015325.482086:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015325.482093:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7488061800/0xb1a5ef690c4fd683 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd67c expref: 19 pid: 5790 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.482117:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7488061800/0xb1a5ef690c4fd683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd67c expref: 19 pid: 5790 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.482140:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7488061800/0xb1a5ef690c4fd683 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c4fd67c expref: 19 pid: 5790 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.482164:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015325.485545:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786015325.485571:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+6:16978:x1872772304349056:12345-0@lo:104: Request processed in 9106us (9681us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015325.485589:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1786015325.485643:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1786015325.485658:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+5:16978:x1872772304349312:12345-0@lo:104: 00010000:00010000:3.0:1786015325.485679:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b7488061a00/0xb1a5ef690c4fd636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c4fd63d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.485810:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1786015325.485816:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+5:16978:x1872772304349312:12345-0@lo:104: Request processed in 165us (9829us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015325.485823:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1786015325.485837:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1786015325.485844:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74afab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+4:16978:x1872772304349440:12345-0@lo:104: 00010000:00010000:3.0:1786015325.485853:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b74bf9e6a00/0xb1a5ef690c4fd628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c4fd62f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.485891:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1786015325.485916:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74afab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+4:16978:x1872772304349440:12345-0@lo:104: Request processed in 72us (9885us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015325.485922:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1786015325.485986:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304349696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015325.486181:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015325.486244:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786015325.486252:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304349824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015325.486276:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015325.486732:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304349696 00000100:00100000:3.0:1786015325.486744:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304349696 00010000:00010000:3.0:1786015325.486808:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7480031200/0xb1a5ef690c4fd675 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd66e expref: 19 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015325.486833:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304349824 00000100:00100000:3.0:1786015325.486836:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304349824 00010000:00010000:3.0:1786015325.486853:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7480031000/0xb1a5ef690c4fd667 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd660 expref: 20 pid: 5790 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015325.486865:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1786015325.486872:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+20:3312:x1872772304349696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786015325.486886:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015325.486892:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7480031200/0xb1a5ef690c4fd675 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd66e expref: 20 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.486904:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7480031200/0xb1a5ef690c4fd675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd66e expref: 20 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.486930:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7480031200/0xb1a5ef690c4fd675 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c4fd66e expref: 20 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.486968:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015325.487096:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304349696:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015325.487114:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1786015325.487133:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1786015325.487140:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:3312:x1872772304349824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786015325.487148:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015325.487153:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7480031000/0xb1a5ef690c4fd667 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd660 expref: 18 pid: 5790 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.487162:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7480031000/0xb1a5ef690c4fd667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd660 expref: 18 pid: 5790 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.487173:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7480031000/0xb1a5ef690c4fd667 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c4fd660 expref: 18 pid: 5790 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.487181:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015325.487220:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:3312:x1872772304349824:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015325.487226:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00010000:00010000:3.0:1786015325.487276:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786015325.487404:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c4fd652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c4fd659 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.487414:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7480031800 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:3.0:1786015325.487420:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c4fd652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c4fd659 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.487442:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c4fd652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c4fd659 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786015325.487449:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c4fd652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c4fd659 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786015325.487456:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786015325.487498:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c4fd652 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd659 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.487506:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786015325.487529:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c4fd652 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd659 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.487538:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c4fd652 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd659 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.487551:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786015325.487555:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b7488061a00/0xb1a5ef690c4fd636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c4fd63d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.487561:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061a00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:3.0:1786015325.487564:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b7488061a00/0xb1a5ef690c4fd636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c4fd63d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.487571:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b7488061a00/0xb1a5ef690c4fd636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c4fd63d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786015325.487578:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b7488061a00/0xb1a5ef690c4fd636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c4fd63d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786015325.487591:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786015325.487607:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b7488061a00/0xb1a5ef690c4fd636 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd63d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.487613:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786015325.487620:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b7488061a00/0xb1a5ef690c4fd636 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd63d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.487627:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b7488061a00/0xb1a5ef690c4fd636 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd63d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.487637:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786015325.487640:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b74bf9e6a00/0xb1a5ef690c4fd628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c4fd62f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.487646:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6a00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:3.0:1786015325.487648:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b74bf9e6a00/0xb1a5ef690c4fd628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c4fd62f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.487655:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b74bf9e6a00/0xb1a5ef690c4fd628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c4fd62f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786015325.487660:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b74bf9e6a00/0xb1a5ef690c4fd628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c4fd62f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786015325.487666:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786015325.487678:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b74bf9e6a00/0xb1a5ef690c4fd628 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd62f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.487683:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786015325.487701:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b74bf9e6a00/0xb1a5ef690c4fd628 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd62f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.487708:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b74bf9e6a00/0xb1a5ef690c4fd628 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd62f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.487718:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015325.487720:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015325.487722:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015325.487742:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304350080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015325.487814:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015325.487842:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786015325.487848:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304349952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015325.487873:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015325.487899:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304350080 00000100:00100000:3.0:1786015325.487905:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304350080 00010000:00010000:3.0:1786015325.487927:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b74bf9e7e00/0xb1a5ef690c4fd63d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd636 expref: 17 pid: 5790 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015325.487946:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304349952 00000100:00100000:3.0:1786015325.487950:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304349952 00010000:00010000:3.0:1786015325.487961:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b74c2179200/0xb1a5ef690c4fd659 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd652 expref: 18 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015325.487976:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1786015325.487984:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:3315:x1872772304350080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786015325.487994:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015325.488000:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b74bf9e7e00/0xb1a5ef690c4fd63d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd636 expref: 18 pid: 5790 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.488117:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b74bf9e7e00/0xb1a5ef690c4fd63d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd636 expref: 18 pid: 5790 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.488132:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015325.488168:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:3315:x1872772304350080:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015325.488176:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1786015325.488272:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1786015325.488281:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74865abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:3315:x1872772304349952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786015325.488361:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015325.488367:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b74c2179200/0xb1a5ef690c4fd659 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd652 expref: 17 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.488377:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b74c2179200/0xb1a5ef690c4fd659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd652 expref: 17 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.488387:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b74c2179200/0xb1a5ef690c4fd659 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c4fd652 expref: 17 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.488400:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015325.488425:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74865abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:3315:x1872772304349952:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015325.488431:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1786015325.488451:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786015325.488461:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304350208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015325.488491:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015325.488549:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304349952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015325.488574:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304350080:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786015325.488604:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015325.488622:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304349824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015325.488630:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304349696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015325.488650:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304350208 00000100:00100000:3.0:1786015325.488654:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304350208 00010000:00010000:3.0:1786015325.488668:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7480030400/0xb1a5ef690c4fd62f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd628 expref: 16 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015325.488684:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1786015325.488690:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:3313:x1872772304350208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786015325.488703:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015325.488707:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7480030400/0xb1a5ef690c4fd62f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd628 expref: 16 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.488714:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7480030400/0xb1a5ef690c4fd62f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd628 expref: 16 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.488724:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015325.488753:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:3313:x1872772304350208:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015325.488787:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1786015325.488814:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304350208:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786015325.488869:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015325.488880:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015325.488962:0:16978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b74bf9e7e00/0xb1a5ef690c4fd63d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c4fd636 expref: 15 pid: 5790 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015325.488981:0:16978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304349312:0@lo:104: 00010000:00010000:3.0:1786015325.488997:0:16978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7480030400/0xb1a5ef690c4fd62f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c4fd628 expref: 14 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015325.491424:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015325.491469:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015325.492567:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:3315:x1872772304349568:12345-0@lo:103:ldlm_bl.0 Request processed in 10498us (15658us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015325.492584:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1786015325.492704:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304349568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786015325.492824:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280369024 00000100:00100000:0.0:1786015325.492833:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280369024 00010000:00010000:0.0:1786015325.492875:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7488061e00/0xb1a5ef690c4fd6d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73b8 expref: 13 pid: 5789 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015325.492915:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280369280 00000100:00100000:0.0:1786015325.492920:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280369280 00010000:00010000:0.0:1786015325.492935:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b74bf9e6000/0xb1a5ef690c4fd68a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73a3 expref: 14 pid: 5787 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015325.492954:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 208 00000100:00100000:0.0:1786015325.492963:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+14:2354:x1872772280369024:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015325.492985:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1786015325.493145:0:16978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304349440:0@lo:104: 00000100:00100000:1.0:1786015325.493589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015325.493679:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280369152 00000100:00100000:1.0:1786015325.493685:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280369152 00010000:00010000:1.0:1786015325.493711:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b74bf9e6c00/0xb1a5ef690c4fd691 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73aa expref: 15 pid: 5787 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015325.493733:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 209 00000100:00100000:1.0:1786015325.493741:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+15:2354:x1872772280369280:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015325.493753:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015325.493781:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b74bf9e6000/0xb1a5ef690c4fd68a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73a3 expref: 15 pid: 5787 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015325.493795:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b74bf9e6000/0xb1a5ef690c4fd68a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73a3 expref: 15 pid: 5787 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015325.493821:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015325.493887:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+15:2354:x1872772280369280:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 146us (2416us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015325.493895:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 209 00000100:00100000:1.0:1786015325.493911:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 210 00000100:00100000:1.0:1786015325.493917:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+14:2354:x1872772280369152:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015325.493926:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015325.493931:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b74bf9e6c00/0xb1a5ef690c4fd691 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73aa expref: 14 pid: 5787 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015325.493940:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b74bf9e6c00/0xb1a5ef690c4fd691 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73aa expref: 14 pid: 5787 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015325.493950:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015325.493979:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+14:2354:x1872772280369152:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 61us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015325.493987:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 210 00010000:00010000:0.0:1786015325.495911:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7488061e00/0xb1a5ef690c4fd6d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73b8 expref: 13 pid: 5789 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.495932:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7488061e00/0xb1a5ef690c4fd6d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73b8 expref: 13 pid: 5789 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.495955:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7488061e00/0xb1a5ef690c4fd6d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73b8 expref: 13 pid: 5789 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.495978:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015325.496151:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:2354:x1872772280369024:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 3185us (4738us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015325.496164:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 208 00010000:00010000:3.0:1786015325.496961:0:16978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b74bf9e6c00/0xb1a5ef690c4fd691 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73aa expref: 11 pid: 5787 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015325.496981:0:16978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304348416:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015325.497029:0:16978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b74bf9e6000/0xb1a5ef690c4fd68a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e73a3 expref: 10 pid: 5787 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015325.497040:0:16978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16978:1872772304348544:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015325.497141:0:16978:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500514 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015325.498779:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786015325.498807:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+3:16978:x1872772304349184:12345-0@lo:104: Request processed in 22253us (22858us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015325.498823:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1786015325.499582:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786015325.499595:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b7488060c00/0xb1a5ef690c4fd644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c4fd64b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.499609:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488060c00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:3.0:1786015325.499614:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b7488060c00/0xb1a5ef690c4fd644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c4fd64b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.499626:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b7488060c00/0xb1a5ef690c4fd644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c4fd64b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786015325.499658:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b7488060c00/0xb1a5ef690c4fd644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c4fd64b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786015325.499666:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786015325.499744:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b7488060c00/0xb1a5ef690c4fd644 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd64b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.499752:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786015325.499796:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b7488060c00/0xb1a5ef690c4fd644 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd64b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.499803:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b7488060c00/0xb1a5ef690c4fd644 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c4fd64b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015325.499827:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015325.499830:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015325.499831:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015325.499854:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304350336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015325.499946:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015325.500034:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304350336 00000100:00100000:2.0:1786015325.500045:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304350336 00010000:00010000:2.0:1786015325.500091:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c4fd64b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd644 expref: 13 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015325.500138:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1786015325.500148:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:3313:x1872772304350336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786015325.500178:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015325.500187:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c4fd64b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd644 expref: 13 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015325.500201:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c4fd64b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c4fd644 expref: 13 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015325.500218:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c4fd64b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c4fd644 expref: 13 pid: 5789 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015325.500250:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500514 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015325.500261:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500514 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015325.500282:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500514 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015325.500290:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500514 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015325.500297:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500514 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015325.500303:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500514 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015325.500309:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381934800 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015325.500313:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500514 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015325.500333:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500514 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015325.500360:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500514 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015325.500373:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015325.500520:0:16978:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500514 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.500531:0:16978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500514 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015325.500538:0:16978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500514 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015325.501690:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304350336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786015325.501691:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+12:3313:x1872772304350336:12345-0@lo:103:ldlm_bl.0 Request processed in 1528us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015325.501705:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00010000:00010000:3.0:1786015326.060945:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015326.655200:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015326.655334:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280369408 00000100:00100000:3.0:1786015326.655350:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280369408 00000100:00100000:3.0:1786015326.655437:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 370 00000100:00100000:3.0:1786015326.655451:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+10:5571:x1872772280369408:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015326.655479:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015326.655511:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b73819bb000/0xb1a5ef690c50051b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e814f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015326.655573:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b73819bb000/0xb1a5ef690c50051b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e814f expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015326.655588:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b73819bb000/0xb1a5ef690c50051b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e814f expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015326.655600:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb000, rc 0) 00000100:00100000:3.0:1786015326.655705:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280369408:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 257us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015326.655713:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 370 00000100:00100000:1.0:1786015326.668539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015326.668830:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280369536 00000100:00100000:0.0:1786015326.668845:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280369536 00000100:00100000:0.0:1786015326.668929:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 371 00000100:00100000:0.0:1786015326.668943:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280369536:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015326.669392:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280369536:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 448us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015326.669414:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 371 00000100:00100000:0.0:1786015326.677006:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015326.678189:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280369664 00000100:00100000:1.0:1786015326.678207:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280369664 00000100:00100000:1.0:1786015326.678303:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 372 00000100:00100000:1.0:1786015326.678316:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280369664:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786015326.678853:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280369664:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 537us (1859us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015326.678863:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 372 00000100:00100000:1.0:1786015326.683950:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015326.684299:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280369792 00000100:00100000:3.0:1786015326.684315:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280369792 00000100:00100000:3.0:1786015326.684396:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 373 00000100:00100000:3.0:1786015326.684409:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:22415:x1872772280369792:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786015326.687205:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:22415:x1872772280369792:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 2775us (3248us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015326.687224:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 373 00000100:00100000:3.0:1786015326.697415:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015326.701722:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280369920 00000100:00100000:0.0:1786015326.701749:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280369920 00000100:00100000:0.0:1786015326.701899:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 374 00000100:00100000:0.0:1786015326.701911:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:22415:x1872772280369920:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786015326.702656:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:22415:x1872772280369920:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 740us (5254us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015326.702670:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 374 00000100:00100000:0.0:1786015326.717016:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015326.717465:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280370048 00000100:00100000:3.0:1786015326.717482:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280370048 00000100:00100000:3.0:1786015326.717568:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 375 00000100:00100000:3.0:1786015326.717580:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280370048:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015326.717606:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015326.717634:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b73819baa00/0xb1a5ef690c500522 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8156 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015326.717716:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b73819baa00/0xb1a5ef690c500522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8156 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015326.717733:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b73819baa00/0xb1a5ef690c500522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8156 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015326.717746:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819baa00, rc 0) 00000100:00100000:3.0:1786015326.717894:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280370048:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 315us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015326.717903:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 375 00000100:00100000:2.0:1786015326.722044:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015326.722234:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280370176 00000100:00100000:1.0:1786015326.722252:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280370176 00000100:00100000:1.0:1786015326.722367:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 376 00000100:00100000:1.0:1786015326.722382:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280370176:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786015326.725392:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280370176:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 2994us (3347us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015326.725413:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 376 00000100:00100000:1.0:1786015326.730702:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015326.731249:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280370304 00000100:00100000:0.0:1786015326.731266:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280370304 00000100:00100000:0.0:1786015326.731372:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 377 00000100:00100000:0.0:1786015326.731386:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280370304:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015326.731810:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280370304:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 377us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015326.731819:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 377 00000100:00100000:0.0:1786015326.740252:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015326.741325:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280370432 00000100:00100000:1.0:1786015326.741346:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280370432 00000100:00100000:2.0:1786015326.748541:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 378 00000100:00100000:2.0:1786015326.748564:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:22416:x1872772280370432:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786015326.749048:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:22416:x1872772280370432:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 488us (8814us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015326.749060:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 378 00000100:00100000:1.0:1786015326.754355:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015326.758021:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280370560 00000100:00100000:0.0:1786015326.758044:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280370560 00000100:00100000:0.0:1786015326.758167:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 379 00000100:00100000:0.0:1786015326.758194:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:22416:x1872772280370560:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786015326.759153:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:22416:x1872772280370560:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 969us (4807us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015326.759616:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 379 00000100:00100000:3.0:1786015326.775352:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015326.776287:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280370688 00000100:00100000:2.0:1786015326.776311:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280370688 00000100:00100000:2.0:1786015326.776401:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 380 00000100:00100000:2.0:1786015326.776414:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280370688:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786015326.776617:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015326.776645:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500529 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e815d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015326.776689:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e815d expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015326.776730:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e815d expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015326.776743:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907e00, rc 0) 00000100:00100000:2.0:1786015326.777055:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:5571:x1872772280370688:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 642us (1722us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015326.777063:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 380 00000100:00100000:2.0:1786015326.781035:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015326.781177:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280370816 00000100:00100000:3.0:1786015326.781203:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280370816 00000100:00100000:3.0:1786015326.781290:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 381 00000100:00100000:3.0:1786015326.781305:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:5571:x1872772280370816:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015326.782130:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:5571:x1872772280370816:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 822us (1260us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786015326.782143:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 381 00000100:00100000:3.0:1786015326.892592:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304350464:0@lo:400:kworker.0 00000100:00100000:3.0:1786015326.892730:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015326.892962:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304350464 00000100:00100000:2.0:1786015326.892974:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304350464 00000100:00100000:0.0:1786015326.893032:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304350592:0@lo:400:kworker.0 00000100:00100000:2.0:1786015326.893043:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1786015326.893052:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+12:3314:x1872772304350464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015326.893074:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015326.893133:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304350592 00000100:00100000:0.0:1786015326.893137:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304350592 00000100:00100000:0.0:1786015326.893179:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1786015326.893186:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304350592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015326.893230:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304350592:12345-0@lo:400:kworker.0 Request processed in 44us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015326.893239:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1786015326.894083:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304350592:0@lo:400:kworker.0 00000100:00100000:2.0:1786015326.897227:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+12:3314:x1872772304350464:12345-0@lo:400:kworker.0 Request processed in 4166us (4487us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015326.897253:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1786015326.897621:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304350720:0@lo:400:kworker.0 00000100:00100000:0.0:1786015326.897705:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015326.897745:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786015326.897751:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304350848:0@lo:400:kworker.0 00000100:00100000:0.0:1786015326.897796:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015326.897827:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304350720 00000100:00100000:0.0:1786015326.897836:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304350720 00000100:00100000:0.0:1786015326.897906:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1786015326.897917:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304350720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015326.897975:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304350720:12345-0@lo:400:kworker.0 Request processed in 60us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015326.897981:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1786015326.898002:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304350848 00000100:00100000:0.0:1786015326.898006:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304350848 00000100:00100000:0.0:1786015326.898051:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1786015326.898056:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304350848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015326.898087:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304350848:12345-0@lo:400:kworker.0 Request processed in 31us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015326.898105:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:0.0:1786015326.898123:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015326.898143:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304351104:0@lo:400:kworker.0 00000100:00100000:0.0:1786015326.898168:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015326.899152:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786015326.899168:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304350976:0@lo:400:kworker.0 00000100:00100000:0.0:1786015326.903799:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015326.903920:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304351104 00000100:00100000:0.0:1786015326.903933:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304351104 00000100:00100000:0.0:1786015326.904026:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1786015326.904040:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304351104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015326.904128:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304351104:12345-0@lo:400:kworker.0 Request processed in 92us (5957us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015326.904135:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:0.0:1786015326.904166:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015326.904598:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304350848:0@lo:400:kworker.0 00000100:00100000:0.0:1786015326.904624:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304350720:0@lo:400:kworker.0 00000100:00100000:0.0:1786015326.904671:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967335 gen 2 00000004:00080000:0.0:1786015326.904679:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967335 committed transno 4294967335 00000100:00100000:0.0:1786015326.904705:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304351104:0@lo:400:kworker.0 00000100:00100000:2.0:1786015326.905233:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304350976 00000100:00100000:2.0:1786015326.905242:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304350976 00000100:00100000:2.0:1786015326.905318:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1786015326.905327:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304350976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015326.905419:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304350976:12345-0@lo:400:kworker.0 Request processed in 93us (1631us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015326.905426:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00080000:1.0:1786015326.907611:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015326.908308:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304350976:0@lo:400:kworker.0 00000100:00100000:3.0:1786015326.917065:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304350464:0@lo:400:kworker.0 00010000:00010000:3.0:1786015327.084589:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015327.405071:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786015327.405115:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304351232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015327.405222:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015327.406808:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304351232 00000100:00100000:2.0:1786015327.406827:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304351232 00000100:00100000:2.0:1786015327.406898:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1786015327.406910:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304351232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015327.406981:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015327.407080:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304351232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 173us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015327.407101:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1786015327.410199:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304351232:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1786015327.491110:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1786015327.491124:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b74bf8dd800 from 42 10000000:01000000:2.0:1786015327.491132:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786015327.491227:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500530 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015327.491244:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500530 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015327.491259:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500530 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015327.491296:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304351360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786015327.491397:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015327.491492:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74982a83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015327.491614:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304351360 00000100:00100000:0.0:1786015327.491625:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304351360 00000100:00100000:0.0:1786015327.491707:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1786015327.491718:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+12:5792:x1872772304351360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786015327.491738:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015327.491756:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500537 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c500530 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015327.491823:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c500530 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015327.491837:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500530 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015327.491850:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7381934800, rc 0) 00000100:00100000:0.0:1786015327.491899:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304351360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015327.491907:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1786015327.493518:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304351360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786015327.493552:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500530 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500537 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015327.493567:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500530 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c500537 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015327.493682:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304351488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015327.493753:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015327.493866:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74982a83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015327.494796:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304351488 00000100:00100000:0.0:1786015327.494811:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304351488 00000100:00100000:0.0:1786015327.494881:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1786015327.494891:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304351488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015327.495334:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304351488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 442us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015327.495344:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1786015327.495899:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304351488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015327.495965:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304351616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786015327.496029:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015327.496068:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74982a83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786015327.496100:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304351616 00000100:00100000:2.0:1786015327.496106:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304351616 00000100:00100000:2.0:1786015327.496155:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1786015327.496162:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304351616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786015327.496377:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304351616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015327.496385:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1786015327.496453:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304351616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786015327.498673:0:16982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8caf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:16982:1872772304351744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786015327.498847:0:16982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015327.498908:0:16982:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7483ea6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786015327.499123:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304351744 00000100:00100000:2.0:1786015327.499135:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304351744 00000100:00100000:2.0:1786015327.499207:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1786015327.499218:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:16982:x1872772304351744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015327.499580:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:16982:x1872772304351744:12345-0@lo:502:llog_process_th.0 Request processed in 362us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015327.499589:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1786015327.499905:0:16982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8caf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:16982:1872772304351744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015327.499984:0:16982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef02a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:16982:1872772304351872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015327.500037:0:16982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015327.500073:0:16982:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7485926780 going to sleep for 11 seconds 00000100:00100000:2.0:1786015327.500551:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304351872 00000100:00100000:2.0:1786015327.500558:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304351872 00000100:00100000:2.0:1786015327.500652:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1786015327.500663:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:16982:x1872772304351872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015327.500972:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:16982:x1872772304351872:12345-0@lo:502:llog_process_th.0 Request processed in 309us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015327.500990:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1786015327.501112:0:16982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef02a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:16982:1872772304351872:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1786015327.501151:0:16982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000020:01000000:3.0:1786015327.503282:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-44 (rc=0) 10000000:01000000:3.0:1786015327.503341:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786015327.505840:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500530 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500537 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015327.505859:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500537 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786015327.505873:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1786015327.505876:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1786015327.505879:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1786015327.506018:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c50053e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015327.506028:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c50053e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015327.506042:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c50053e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015327.506078:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304352000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786015327.506193:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015327.516869:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748570aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015327.521093:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304352000 00000100:00100000:0.0:1786015327.521114:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304352000 00000100:00100000:0.0:1786015327.521207:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1786015327.521219:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304352000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786015327.521244:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015327.521270:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7381935200/0xb1a5ef690c500545 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c50053e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015327.521309:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7381935200/0xb1a5ef690c500545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c50053e expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015327.521323:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7381935200/0xb1a5ef690c500545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c50053e expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015327.521336:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7381935200, rc 0) 00000100:00100000:0.0:1786015327.521486:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304352000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 269us (15292us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015327.521495:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1786015327.522101:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304352000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786015327.522134:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c50053e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500545 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015327.522148:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c50053e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c500545 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015327.522264:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304352128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015327.522339:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015327.522388:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7484fff300 going to sleep for 11 seconds 00000100:00100000:0.0:1786015327.522410:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304352128 00000100:00100000:0.0:1786015327.522416:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304352128 00000100:00100000:0.0:1786015327.522450:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1786015327.522458:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304352128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015327.522813:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304352128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 354us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015327.522822:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1786015327.522864:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304352128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015327.522898:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304352256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015327.522954:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015327.522968:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7484fff300 going to sleep for 11 seconds 00000100:00100000:0.0:1786015327.522980:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304352256 00000100:00100000:0.0:1786015327.522984:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304352256 00000100:00100000:0.0:1786015327.523006:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1786015327.523012:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304352256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015327.523374:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304352256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 360us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015327.523382:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1786015327.523432:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304352256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786015327.538210:0:16983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:3.0:1786015327.539210:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1786015327.539248:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1786015327.539335:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c50053e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500545 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015327.539352:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c50053e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500545 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786015327.539385:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1786015327.539389:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b74aaa08000 from 42 10000000:01000000:3.0:1786015327.539392:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786015327.539517:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c50054c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015327.539528:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c50054c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015327.539543:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c50054c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015327.539583:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304352384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786015327.539695:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015327.539801:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7381ffba80 going to sleep for 11 seconds 00000100:00100000:3.0:1786015327.539832:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304352384 00000100:00100000:3.0:1786015327.539841:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304352384 00000100:00100000:3.0:1786015327.539900:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1786015327.539911:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304352384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015327.539932:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015327.539952:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c500553 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c50054c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015327.539986:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c500553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c50054c expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015327.540000:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c500553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c50054c expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015327.540026:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb800, rc 0) 00000100:00100000:3.0:1786015327.540076:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304352384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015327.540094:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1786015327.540160:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304352384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015327.540178:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c50054c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500553 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015327.540188:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c50054c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c500553 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015327.540254:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304352512:0@lo:501:ll_cfg_requeue.0 00000001:00080000:2.0:1786015327.543215:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967776 is committed 00000020:00080000:2.0:1786015327.543259:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 10 batchid updated 00000020:00080000:2.0:1786015327.543312:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 10 00000020:00080000:2.0:1786015327.543327:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 10 00000100:00100000:3.0:1786015327.546704:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015327.546812:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7381ffba80 going to sleep for 11 seconds 00000100:00100000:1.0:1786015327.546907:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304352512 00000100:00100000:1.0:1786015327.546923:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304352512 00000100:00100000:1.0:1786015327.547001:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1786015327.547012:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304352512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786015327.547493:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304352512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 481us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015327.547503:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1786015327.548446:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304352512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015327.548535:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304352640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786015327.548617:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015327.548663:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74982a83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015327.548835:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304352640 00000100:00100000:0.0:1786015327.548845:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304352640 00000100:00100000:0.0:1786015327.548899:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1786015327.548909:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304352640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015327.549190:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304352640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 282us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015327.549198:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1786015327.549308:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304352640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015327.549981:0:16985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:16985:1872772304352768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015327.550036:0:16985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015327.550073:0:16985:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7484fff9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015327.550181:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304352768 00000100:00100000:1.0:1786015327.550191:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304352768 00000100:00100000:1.0:1786015327.550244:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1786015327.550263:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:16985:x1872772304352768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786015327.550611:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:16985:x1872772304352768:12345-0@lo:502:llog_process_th.0 Request processed in 357us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015327.550620:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1786015327.550860:0:16985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:16985:1872772304352768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015327.550932:0:16985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:16985:1872772304352896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015327.550973:0:16985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015327.550998:0:16985:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7484fff9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015327.551110:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304352896 00000100:00100000:1.0:1786015327.551116:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304352896 00000100:00100000:1.0:1786015327.551241:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1786015327.551251:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:16985:x1872772304352896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786015327.551481:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:16985:x1872772304352896:12345-0@lo:502:llog_process_th.0 Request processed in 231us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015327.551488:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1786015327.551682:0:16985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:16985:1872772304352896:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1786015327.551712:0:16985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000020:01000000:2.0:1786015327.554674:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-44 (rc=0) 10000000:01000000:2.0:1786015327.554729:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786015327.554744:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c50054c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500553 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015327.554781:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c50054c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500553 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786015327.554795:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1786015327.554798:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1786015327.554801:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1786015327.554858:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c50055a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015327.554866:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c50055a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015327.554906:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c50055a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015327.554940:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304353024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786015327.555026:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015327.555092:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7496293e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786015327.555751:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304353024 00000100:00100000:3.0:1786015327.555803:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304353024 00000100:00100000:3.0:1786015327.555868:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1786015327.555879:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304353024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015327.555899:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015327.555921:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b74c2179200/0xb1a5ef690c500561 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c50055a expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015327.555950:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b74c2179200/0xb1a5ef690c500561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c50055a expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015327.555962:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b74c2179200/0xb1a5ef690c500561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c50055a expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015327.555984:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2179200, rc 0) 00000100:00100000:3.0:1786015327.556048:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304353024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015327.556055:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1786015327.556276:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304353024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786015327.556298:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c50055a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500561 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015327.556309:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c50055a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c500561 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015327.556388:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304353152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015327.556419:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015327.556442:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7496293e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786015327.556557:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304353152 00000100:00100000:3.0:1786015327.556562:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304353152 00000100:00100000:3.0:1786015327.556591:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1786015327.556598:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304353152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015327.556946:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304353152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 347us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015327.556953:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1786015327.557078:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304353152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015327.557136:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304353280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015327.557186:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015327.557211:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7484fff9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015327.557944:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304353280 00000100:00100000:3.0:1786015327.557955:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304353280 00000100:00100000:3.0:1786015327.558002:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1786015327.558011:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304353280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786015327.559004:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304353280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 987us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015327.559102:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1786015327.562003:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304353280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786015327.563304:0:16986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:1.0:1786015327.563591:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1786015327.563639:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1786015327.563656:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c50055a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500561 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015327.563670:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c50055a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500561 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786015327.563681:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786015327.563685:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b7483242800 from 42 10000000:01000000:1.0:1786015327.563688:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786015327.563738:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c500568 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015327.563748:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c500568 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015327.563787:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c500568 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015327.563820:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8caca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304353408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786015327.563907:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015327.563958:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7495d4fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1786015327.564035:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304353408 00000100:00100000:3.0:1786015327.564046:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304353408 00000100:00100000:3.0:1786015327.564121:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1786015327.564133:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304353408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015327.564153:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015327.564171:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c50056f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c500568 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015327.564216:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c50056f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c500568 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015327.564229:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c50056f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500568 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015327.564244:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2179600, rc 0) 00000100:00100000:3.0:1786015327.564413:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304353408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 280us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015327.564419:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1786015327.564524:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8caca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304353408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786015327.564542:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c500568 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50056f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015327.564553:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c500568 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c50056f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015327.564617:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8caca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304353536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786015327.564657:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015327.564680:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7495d4fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1786015327.564750:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304353536 00000100:00100000:0.0:1786015327.564756:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304353536 00000100:00100000:0.0:1786015327.564813:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1786015327.564822:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74864ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304353536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015327.565186:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74864ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304353536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 365us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015327.565201:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1786015327.565712:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8caca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304353536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015327.565798:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304353664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786015327.565862:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015327.565904:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74962143c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015327.566031:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304353664 00000100:00100000:0.0:1786015327.566037:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304353664 00000100:00100000:0.0:1786015327.566161:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1786015327.566171:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74864ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304353664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015327.566404:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74864ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304353664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 234us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015327.566411:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1786015327.566596:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304353664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786015327.567227:0:16987:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:16987:1872772304353792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015327.567297:0:16987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015327.567678:0:16987:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748570a180 going to sleep for 11 seconds 00000100:00100000:1.0:1786015327.570378:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304353792 00000100:00100000:1.0:1786015327.570398:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304353792 00000100:00100000:1.0:1786015327.570877:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1786015327.570891:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:16987:x1872772304353792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786015327.571432:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:16987:x1872772304353792:12345-0@lo:502:llog_process_th.0 Request processed in 540us (4132us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015327.571442:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1786015327.572077:0:16987:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:16987:1872772304353792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015327.572197:0:16987:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:16987:1872772304353920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015327.572320:0:16987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015327.572388:0:16987:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748570a180 going to sleep for 11 seconds 00000100:00100000:0.0:1786015327.572455:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304353920 00000100:00100000:0.0:1786015327.572465:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304353920 00000100:00100000:0.0:1786015327.572521:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1786015327.572532:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:16987:x1872772304353920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015327.572846:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:16987:x1872772304353920:12345-0@lo:502:llog_process_th.0 Request processed in 316us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015327.572855:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1786015327.572957:0:16987:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:16987:1872772304353920:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1786015327.572984:0:16987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000020:01000000:0.0:1786015327.573205:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-44 (rc=0) 10000000:01000000:0.0:1786015327.573233:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786015327.573251:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c500568 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50056f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015327.573276:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c500568 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50056f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786015327.573288:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1786015327.573291:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 37 10000000:01000000:0.0:1786015327.573294:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1786015327.573331:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7480030400/0xb1a5ef690c500576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015327.573349:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b7480030400/0xb1a5ef690c500576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015327.573361:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b7480030400/0xb1a5ef690c500576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015327.573379:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304354048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786015327.573415:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015327.573443:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7484fff6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786015327.573560:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304354048 00000100:00100000:2.0:1786015327.573567:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304354048 00000100:00100000:2.0:1786015327.573600:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1786015327.573607:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304354048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786015327.573622:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015327.573639:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7383907600/0xb1a5ef690c50057d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c500576 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015327.573681:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7383907600/0xb1a5ef690c50057d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c500576 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015327.573692:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7383907600/0xb1a5ef690c50057d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500576 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015327.573703:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907600, rc 0) 00000100:00100000:2.0:1786015327.573750:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304354048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015327.573756:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1786015327.573971:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304354048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786015327.573986:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b7480030400/0xb1a5ef690c500576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50057d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015327.573996:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b7480030400/0xb1a5ef690c500576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c50057d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015327.574055:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304354176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015327.574095:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015327.574156:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7484fff6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015327.574278:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304354176 00000100:00100000:1.0:1786015327.574284:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304354176 00000100:00100000:1.0:1786015327.574373:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1786015327.574383:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304354176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786015327.574706:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304354176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015327.574714:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1786015327.574791:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304354176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015327.574824:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304354304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015327.574864:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015327.575095:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7484fff6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015327.575174:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304354304 00000100:00100000:3.0:1786015327.575181:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304354304 00000100:00100000:3.0:1786015327.575221:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1786015327.575228:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304354304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786015327.575462:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304354304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 234us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015327.575470:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1786015327.575625:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304354304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786015327.576306:0:16988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:16988:1872772304354432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015327.576368:0:16988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015327.576548:0:16988:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748570a480 going to sleep for 11 seconds 00000100:00100000:1.0:1786015327.576648:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304354432 00000100:00100000:1.0:1786015327.576656:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304354432 00000100:00100000:1.0:1786015327.576894:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1786015327.576904:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:16988:x1872772304354432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786015327.577557:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:16988:x1872772304354432:12345-0@lo:502:llog_process_th.0 Request processed in 649us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015327.577567:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1786015327.577673:0:16988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:16988:1872772304354432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786015327.577719:0:16988:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786015327.577736:0:16988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786015327.577740:0:16988:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-MDT0000-m new lustre.test_11c 00000020:00000080:3.0:1786015327.577747:0:16988:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1786015327.578178:0:16988:0:(lod_pool.c:475:lod_pool_new()) test_11c is pool #1 00080000:10000000:3.0:1786015327.588127:0:16988:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00080000:10000000:2.0:1786015327.649526:0:16988:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x38:0x0] (8/8/4) registered 00080000:10000000:2.0:1786015327.710459:0:16988:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x39:0x0] (8/8/4) registered 00000100:00100000:2.0:1786015327.748943:0:16988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:16988:1872772304354560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015327.749052:0:16988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015327.749113:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304354560 00000100:00100000:2.0:1786015327.749119:0:16988:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b13f0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015327.749130:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304354560 00000100:00100000:0.0:1786015327.749344:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1786015327.749354:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:16988:x1872772304354560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015327.749585:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:16988:x1872772304354560:12345-0@lo:502:llog_process_th.0 Request processed in 232us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015327.749628:0:16988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:16988:1872772304354560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015327.749651:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000020:01000000:2.0:1786015327.749680:0:16988:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786015327.749688:0:16988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786015327.749690:0:16988:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-MDT0000-m new lustre.test_11c 00000040:00080000:2.0:1786015327.749694:0:16988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000020:01000000:0.0:1786015327.749783:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 37-39 (rc=0) 10000000:01000000:0.0:1786015327.749810:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1786015327.749822:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7480030400/0xb1a5ef690c500576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50057d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015327.749834:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b7480030400/0xb1a5ef690c500576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50057d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786015327.749844:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1786015327.749848:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8b74b00a4d40 from 1 10000000:01000000:0.0:1786015327.749851:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1786015327.749884:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c500584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015327.749893:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c500584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015327.749904:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c500584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015327.749922:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304354688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786015327.749958:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015327.750026:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486543900 going to sleep for 11 seconds 00000100:00100000:1.0:1786015327.750065:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304354688 00000100:00100000:1.0:1786015327.750070:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304354688 00000100:00100000:1.0:1786015327.750151:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1786015327.750161:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304354688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786015327.750192:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015327.750210:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b73813bec00/0xb1a5ef690c50058b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c500584 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015327.750240:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b73813bec00/0xb1a5ef690c50058b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c500584 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015327.750252:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b73813bec00/0xb1a5ef690c50058b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500584 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015327.750274:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bec00, rc 0) 00000100:00100000:1.0:1786015327.750326:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:5792:x1872772304354688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015327.750333:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1786015327.750395:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304354688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786015327.750410:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c500584 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50058b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015327.750420:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c500584 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c50058b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015327.750477:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304354816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015327.750507:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015327.750717:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486543900 going to sleep for 11 seconds 00000100:00100000:3.0:1786015327.750937:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304354816 00000100:00100000:3.0:1786015327.750945:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304354816 00000100:00100000:3.0:1786015327.750973:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1786015327.750981:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:5792:x1872772304354816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015327.751324:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:5792:x1872772304354816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 344us (815us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786015327.751332:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:0.0:1786015327.751593:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304354816:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1786015327.751638:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1786015327.751647:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c500584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50058b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015327.751658:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c500584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50058b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015328.109617:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015329.131956:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1786015329.746636:0:17037:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd5d1d8be0 20000000:00000080:0.0:1786015329.746665:0:17037:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8b7382c90c00 uarg=0000000000000000 00000040:00100000:0.0:1786015329.747735:0:17037:0:(llog.c:1072:llog_reverse_process()) index 44 : idx 1 20000000:01000000:0.0:1786015329.747749:0:17037:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 43 cmd:0xce020 lustre.test_11c 00000040:00080000:0.0:1786015329.748338:0:17037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off16008 20000000:01000000:0.0:1786015329.748365:0:17037:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre test_11c lustre-OST0001_UUID (null) 00000040:00080000:0.0:1786015329.748392:0:17037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 136 off16144 00000040:00080000:0.0:1786015329.748426:0:17037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].48, 224 off16608 00000040:00080000:0.0:1786015329.748596:0:17037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15280 20000000:01000000:0.0:1786015329.748604:0:17037:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre test_11c lustre-OST0001_UUID (null) 00000040:00080000:0.0:1786015329.748632:0:17037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 144 off15424 00000040:00080000:0.0:1786015329.748665:0:17037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15648 10000000:01000000:0.0:1786015329.748675:0:17037:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1786015329.748700:0:17037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b7480031200/0xb1a5ef690c500592 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.748723:0:17037:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b73819bb000/0xb1a5ef690c50051b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e814f expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.748729:0:17037:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b73819baa00/0xb1a5ef690c500522 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8156 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.748734:0:17037:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e815d expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.748740:0:17037:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500530 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.748744:0:17037:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7381935200/0xb1a5ef690c500545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c50053e expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.748748:0:17037:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c500553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c50054c expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.748753:0:17037:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b74c2179200/0xb1a5ef690c500561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c50055a expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.748757:0:17037:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c50056f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500568 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.748856:0:17037:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7383907600/0xb1a5ef690c50057d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500576 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.748876:0:17037:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b73813bec00/0xb1a5ef690c50058b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500584 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.748945:0:17037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b7480031200/0xb1a5ef690c500592 lrc: 13/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.749004:0:17037:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b73813bec00/0xb1a5ef690c50058b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c500584 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.749020:0:17037:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b73813bec00/0xb1a5ef690c50058b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c500584 expref: 18 pid: 5789 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015329.749035:0:17037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304354944:0@lo:104: 00000100:00100000:0.0:1786015329.749145:0:17037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786015329.749282:0:17037:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7383907600/0xb1a5ef690c50057d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c500576 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.749291:0:17037:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7383907600/0xb1a5ef690c50057d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c500576 expref: 18 pid: 5790 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015329.749301:0:17037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304355072:0@lo:104: 00000100:00100000:0.0:1786015329.749327:0:17037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786015329.749521:0:17037:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c50056f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c500568 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.749531:0:17037:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c50056f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c500568 expref: 18 pid: 5790 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015329.749539:0:17037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304355200:0@lo:104: 00000100:00100000:0.0:1786015329.749574:0:17037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015329.749589:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304355072 00000100:00100000:1.0:1786015329.749589:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304354944 00000100:00100000:3.0:1786015329.749599:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304355072 00000100:00100000:1.0:1786015329.749599:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304354944 00010000:00010000:0.0:1786015329.749701:0:17037:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b74c2179200/0xb1a5ef690c500561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c50055a expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.749709:0:17037:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b74c2179200/0xb1a5ef690c500561 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c50055a expref: 18 pid: 5787 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015329.749722:0:17037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304355328:0@lo:104: 00000100:00100000:0.0:1786015329.749750:0:17037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015329.749782:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304355200 00000100:00100000:1.0:1786015329.749786:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304355200 00000100:00100000:1.0:1786015329.749810:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1786015329.749819:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1786015329.749820:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+5:17037:x1872772304354944:12345-0@lo:104: 00000100:00100000:3.0:1786015329.749827:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+5:17037:x1872772304355072:12345-0@lo:104: 00010000:00010000:1.0:1786015329.749838:0:8307:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c500584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c50058b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.749841:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b7480030400/0xb1a5ef690c500576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c50057d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.749917:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786015329.749925:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+5:17037:x1872772304355072:12345-0@lo:104: Request processed in 98us (595us total) trans 0 rc 0/0 00010000:00010000:1.0:1786015329.749929:0:8307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1786015329.749933:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1786015329.749933:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+5:17037:x1872772304354944:12345-0@lo:104: Request processed in 116us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015329.749939:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1786015329.749956:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1786015329.749962:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+3:17037:x1872772304355200:12345-0@lo:104: 00010000:00010000:3.0:1786015329.749973:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786015329.749977:0:8307:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c500568 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c50056f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.749981:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b7480030400/0xb1a5ef690c500576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c50057d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.749988:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7480030400 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:3.0:1786015329.749993:0:8308:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b7480030400/0xb1a5ef690c500576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c50057d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.750004:0:8308:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b7480030400/0xb1a5ef690c500576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c50057d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015329.750009:0:8307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:3.0:1786015329.750013:0:8308:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b7480030400/0xb1a5ef690c500576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c50057d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015329.750013:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+3:17037:x1872772304355200:12345-0@lo:104: Request processed in 52us (438us total) trans 0 rc 0/0 10000000:01000000:3.0:1786015329.750020:0:8308:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1786015329.750020:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1786015329.750036:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786015329.750040:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c500584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c50058b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015329.750046:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7480031800 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:1.0:1786015329.750049:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c500584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c50058b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015329.750056:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c500584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c50058b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786015329.750072:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c500584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c50058b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.750074:0:8308:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b7480030400/0xb1a5ef690c500576 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c50057d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786015329.750078:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786015329.750081:0:8308:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786015329.750093:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c500584 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c50058b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015329.750098:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786015329.750109:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b7480030400/0xb1a5ef690c500576 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c50057d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.750116:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b7480030400/0xb1a5ef690c500576 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c50057d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015329.750117:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c500584 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c50058b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015329.750123:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c500584 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c50058b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.750141:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015329.750141:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786015329.750143:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015329.750144:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c500568 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c50056f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.750145:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015329.750160:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304355456:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786015329.750161:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813be200 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:1.0:1786015329.750164:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c500568 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c50056f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015329.750172:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c500568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c50056f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786015329.750178:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c500568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c50056f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786015329.750184:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1786015329.750194:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786015329.750208:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c500568 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c50056f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015329.750214:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786015329.750221:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c500568 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c50056f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015329.750227:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c500568 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c50056f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015329.750238:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015329.750239:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015329.750241:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304355456 00010000:00010000:1.0:1786015329.750241:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015329.750248:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015329.750258:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304355456 00000100:00100000:1.0:1786015329.750266:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304355584:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786015329.750281:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7383907600/0xb1a5ef690c50057d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c500576 expref: 19 pid: 5790 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015329.750298:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015329.750307:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304355584 00000100:00100000:3.0:1786015329.750310:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304355584 00000100:00100000:1.0:1786015329.750320:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1786015329.750323:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b73813bec00/0xb1a5ef690c50058b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c500584 expref: 20 pid: 5789 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015329.750325:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304355712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015329.750343:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1786015329.750346:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015329.750349:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+20:3313:x1872772304355456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786015329.750362:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015329.750369:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7383907600/0xb1a5ef690c50057d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c500576 expref: 20 pid: 5790 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015329.750371:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304355712 00000100:00100000:1.0:1786015329.750374:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304355712 00010000:00010000:3.0:1786015329.750380:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7383907600/0xb1a5ef690c50057d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c500576 expref: 21 pid: 5790 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015329.750387:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c50056f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c500568 expref: 21 pid: 5790 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.750400:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015329.750401:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1786015329.750406:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74865a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+21:3314:x1872772304355584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786015329.750413:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015329.750417:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b73813bec00/0xb1a5ef690c50058b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c500584 expref: 21 pid: 5789 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015329.750427:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+21:3313:x1872772304355456:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (233us total) trans 0 rc 0/0 00010000:00010000:1.0:1786015329.750427:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b73813bec00/0xb1a5ef690c50058b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c500584 expref: 21 pid: 5789 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015329.750434:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00010000:00010000:1.0:1786015329.750437:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015329.750454:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1786015329.750459:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+20:3314:x1872772304355712:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786015329.750461:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74865a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+20:3314:x1872772304355584:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (163us total) trans 0 rc 0/0 00010000:00010000:3.0:1786015329.750467:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1786015329.750467:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00010000:00010000:3.0:1786015329.750471:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c50056f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c500568 expref: 20 pid: 5790 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.750479:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c50056f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c500568 expref: 19 pid: 5790 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.750487:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015329.750507:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304355712:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015329.750513:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1786015329.750534:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304355712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015329.750540:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304355456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786015329.750542:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304355584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786015329.751116:0:17037:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c500553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c50054c expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.751129:0:17037:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c500553 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c50054c expref: 18 pid: 5790 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015329.751138:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304355328 00000100:00100000:0.0:1786015329.751138:0:17037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304355840:0@lo:104: 00000100:00100000:3.0:1786015329.751143:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304355328 00000100:00100000:3.0:1786015329.751262:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1786015329.751271:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+3:17037:x1872772304355328:12345-0@lo:104: 00010000:00010000:3.0:1786015329.751283:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c50055a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c500561 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015329.751290:0:17037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786015329.751332:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786015329.751337:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+3:17037:x1872772304355328:12345-0@lo:104: Request processed in 68us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015329.751343:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1786015329.751381:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786015329.751388:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c50055a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c500561 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015329.751395:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907200 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1786015329.751399:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c50055a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c500561 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015329.751417:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c50055a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c500561 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786015329.751423:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c50055a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c500561 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786015329.751428:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786015329.751455:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c50055a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500561 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015329.751462:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786015329.751478:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c50055a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500561 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015329.751485:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c50055a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500561 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015329.751497:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015329.751499:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015329.751500:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015329.751604:0:17037:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7381935200/0xb1a5ef690c500545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c50053e expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.751613:0:17037:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7381935200/0xb1a5ef690c500545 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c50053e expref: 18 pid: 5790 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015329.751621:0:17037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304356096:0@lo:104: 00000100:00100000:3.0:1786015329.751631:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304355840 00000100:00100000:3.0:1786015329.751635:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304355840 00000100:00100000:0.0:1786015329.751646:0:17037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015329.751650:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1786015329.751661:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+3:17037:x1872772304355840:12345-0@lo:104: 00010000:00010000:0.0:1786015329.751664:0:17037:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c500530 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.751669:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c50054c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c500553 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.751672:0:17037:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500537 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c500530 expref: 18 pid: 5790 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015329.751692:0:17037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304356224:0@lo:104: 00010000:00010000:3.0:1786015329.751703:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786015329.751707:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+3:17037:x1872772304355840:12345-0@lo:104: Request processed in 47us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015329.751713:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1786015329.751715:0:17037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015329.751732:0:5779:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1786015329.751736:0:17037:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e815d expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015329.751741:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304356096 00000100:00100000:3.0:1786015329.751743:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304356096 00010000:00010000:0.0:1786015329.751747:0:17037:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500529 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e815d expref: 12 pid: 5789 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015329.751754:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304356224 00000100:00100000:3.0:1786015329.751756:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304356224 00000100:00100000:0.0:1786015329.751758:0:17037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304356352:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015329.751787:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1786015329.751792:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+4:17037:x1872772304356096:12345-0@lo:104: 00010000:00010000:3.0:1786015329.751799:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c50053e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c500545 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.751829:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1786015329.751834:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+4:17037:x1872772304356096:12345-0@lo:104: Request processed in 42us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015329.751840:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1786015329.751848:0:17037:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b73819baa00/0xb1a5ef690c500522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8156 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015329.751851:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1786015329.751856:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b870f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+3:17037:x1872772304356224:12345-0@lo:104: 00010000:00010000:0.0:1786015329.751858:0:17037:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b73819baa00/0xb1a5ef690c500522 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8156 expref: 12 pid: 5790 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.751863:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c500537 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015329.751866:0:17037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304356480:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015329.751897:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1786015329.751909:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b870f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+3:17037:x1872772304356224:12345-0@lo:104: Request processed in 52us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015329.751915:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1786015329.751989:0:17037:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b73819bb000/0xb1a5ef690c50051b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e814f expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.751997:0:17037:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b73819bb000/0xb1a5ef690c50051b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e814f expref: 12 pid: 5790 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015329.752007:0:17037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304356608:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015329.752030:0:17037:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486543e40 going to sleep for 11 seconds 00010000:00010000:0.0:1786015329.752052:0:17037:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b73813bec00/0xb1a5ef690c50058b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c500584 expref: 18 pid: 5789 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015329.752086:0:17037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304354944:0@lo:104: 00010000:00010000:0.0:1786015329.752101:0:17037:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7383907600/0xb1a5ef690c50057d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c500576 expref: 17 pid: 5790 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015329.752111:0:17037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304355072:0@lo:104: 00010000:00010000:0.0:1786015329.752121:0:17037:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c50056f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c500568 expref: 16 pid: 5790 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015329.752131:0:17037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304355200:0@lo:104: 00000100:00100000:0.0:1786015329.752139:0:17037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304355328:0@lo:104: 00000100:00100000:0.0:1786015329.752148:0:17037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304355840:0@lo:104: 00000100:00100000:3.0:1786015329.752382:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304355968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015329.752411:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786015329.752447:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786015329.752452:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c50054c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c500553 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.752459:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb200 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:3.0:1786015329.752463:0:8308:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c50054c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c500553 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.752471:0:8308:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c50054c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c500553 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786015329.752477:0:8308:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c50054c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c500553 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786015329.752483:0:8308:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786015329.752507:0:8308:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c50054c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500553 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.752513:0:8308:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786015329.752525:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c50054c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500553 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.752531:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c50054c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500553 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.752554:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786015329.752557:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c50053e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c500545 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.752562:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819ba200 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:3.0:1786015329.752565:0:8308:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c50053e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c500545 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.752571:0:8308:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c50053e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c500545 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786015329.752578:0:8308:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c50053e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c500545 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786015329.752589:0:8308:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786015329.752604:0:8308:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c50053e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500545 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.752610:0:8308:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786015329.752624:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c50053e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500545 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.752631:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c50053e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500545 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.752640:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786015329.752642:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c500537 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.752659:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907400 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:3.0:1786015329.752662:0:8308:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c500537 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.752668:0:8308:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c500537 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786015329.752673:0:8308:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c500537 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786015329.752678:0:8308:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786015329.752692:0:8308:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500530 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500537 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.752697:0:8308:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786015329.752703:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500530 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500537 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.752708:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500530 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500537 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.752724:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015329.752726:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015329.752728:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015329.752737:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786015329.752745:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304356736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015329.752795:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015329.752828:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304355968 00000100:00100000:3.0:1786015329.752834:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304355968 00010000:00010000:3.0:1786015329.752867:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b74c2179200/0xb1a5ef690c500561 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c50055a expref: 16 pid: 5787 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015329.752892:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304356736 00000100:00100000:3.0:1786015329.752896:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304356736 00010000:00010000:3.0:1786015329.752908:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c500553 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c50054c expref: 17 pid: 5790 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015329.752926:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1786015329.752933:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:3312:x1872772304355968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786015329.752945:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015329.752951:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8b74c2179200/0xb1a5ef690c500561 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c50055a expref: 17 pid: 5787 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.752962:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b74c2179200/0xb1a5ef690c500561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c50055a expref: 17 pid: 5787 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.752976:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b74c2179200/0xb1a5ef690c500561 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c50055a expref: 17 pid: 5787 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.752992:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015329.753024:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:3312:x1872772304355968:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015329.753031:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1786015329.753047:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1786015329.753052:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:3312:x1872772304356736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786015329.753059:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015329.753075:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c500553 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c50054c expref: 15 pid: 5790 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.753094:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c500553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c50054c expref: 15 pid: 5790 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.753104:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c500553 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c50054c expref: 15 pid: 5790 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.753113:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015329.753139:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:3312:x1872772304356736:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015329.753146:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1786015329.753187:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304356736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015329.753197:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304355968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786015329.753701:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304356992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786015329.753747:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015329.753822:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786015329.753829:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304356864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786015329.753854:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015329.753887:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304356992 00000100:00100000:1.0:1786015329.753894:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304356992 00010000:00010000:1.0:1786015329.753921:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500537 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c500530 expref: 14 pid: 5790 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015329.753944:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304356864 00000100:00100000:1.0:1786015329.753947:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304356864 00010000:00010000:1.0:1786015329.753959:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7381935200/0xb1a5ef690c500545 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c50053e expref: 15 pid: 5790 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015329.753973:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1786015329.753980:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:3315:x1872772304356992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786015329.753991:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015329.753996:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500537 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c500530 expref: 15 pid: 5790 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015329.754007:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500537 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c500530 expref: 15 pid: 5790 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015329.754023:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015329.754416:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:3315:x1872772304356992:12345-0@lo:103:ldlm_bl.0 Request processed in 434us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015329.754424:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1786015329.754441:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1786015329.754448:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:3315:x1872772304356864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786015329.754457:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015329.754469:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7381935200/0xb1a5ef690c500545 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c50053e expref: 14 pid: 5790 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015329.754479:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7381935200/0xb1a5ef690c500545 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c50053e expref: 14 pid: 5790 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015329.754490:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015329.754516:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:3315:x1872772304356864:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015329.754521:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1786015329.754602:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304356864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786015329.754611:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304356992:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786015329.754647:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015329.754665:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015329.755701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:0.0:1786015329.755781:0:17037:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7381935200/0xb1a5ef690c500545 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c50053e expref: 13 pid: 5790 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015329.755802:0:17037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304356096:0@lo:104: 00010000:00010000:0.0:1786015329.755816:0:17037:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7381934800/0xb1a5ef690c500537 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c500530 expref: 12 pid: 5790 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015329.755826:0:17037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304356224:0@lo:104: 00000100:00100000:0.0:1786015329.755836:0:17037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304356352:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015329.755847:0:17037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304356480:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015329.756232:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015329.758871:0:17037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17037:1872772304356608:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015329.758948:0:17037:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b7480031200/0xb1a5ef690c500592 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015329.759298:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015329.759581:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280370944 00000100:00100000:3.0:1786015329.759593:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280370944 00010000:00010000:3.0:1786015329.759656:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b73819baa00/0xb1a5ef690c500522 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8156 expref: 13 pid: 5790 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015329.759701:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280371072 00000100:00100000:1.0:1786015329.759707:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280371072 00010000:00010000:1.0:1786015329.759745:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500529 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e815d expref: 14 pid: 5789 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015329.759846:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280371200 00000100:00100000:2.0:1786015329.759850:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280371200 00000100:00100000:3.0:1786015329.759860:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 219 00010000:00010000:2.0:1786015329.759868:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b73819bb000/0xb1a5ef690c50051b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e814f expref: 15 pid: 5790 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015329.759871:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+15:2352:x1872772280370944:12345-192.168.202.56@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1786015329.759883:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 220 00000100:00100000:2.0:1786015329.759908:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74865a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+15:2353:x1872772280371072:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015329.759922:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015329.759929:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500529 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e815d expref: 15 pid: 5789 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015329.759942:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e815d expref: 15 pid: 5789 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.759946:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015329.759951:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b73819baa00/0xb1a5ef690c500522 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8156 expref: 15 pid: 5790 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015329.759990:0:5780:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1786015329.760002:0:5780:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1786015329.760160:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 221 00000100:00100000:0.0:1786015329.760168:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+15:2353:x1872772280371200:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015329.760177:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015329.760182:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b73819bb000/0xb1a5ef690c50051b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e814f expref: 15 pid: 5790 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015329.760272:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500529 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e815d expref: 15 pid: 5789 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.760335:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b73819baa00/0xb1a5ef690c500522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8156 expref: 14 pid: 5790 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.760348:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b73819baa00/0xb1a5ef690c500522 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8156 expref: 14 pid: 5790 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.760369:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015329.760394:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b73819bb000/0xb1a5ef690c50051b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e814f expref: 13 pid: 5790 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.760404:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b73819bb000/0xb1a5ef690c50051b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e814f expref: 13 pid: 5790 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.760418:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b7480031200/0xb1a5ef690c500592 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.760427:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7480031200/0xb1a5ef690c500592 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.760442:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b7480031200/0xb1a5ef690c500592 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015329.760448:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:2352:x1872772280370944:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 578us (4758us total) trans 0 rc 0/0 00010000:00010000:0.0:1786015329.760451:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b7480031200/0xb1a5ef690c500592 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015329.760456:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 219 00010000:00010000:0.0:1786015329.760458:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b7480031200/0xb1a5ef690c500592 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.760465:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b7480031200/0xb1a5ef690c500592 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.760471:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7480031200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015329.760482:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b7480031200/0xb1a5ef690c500592 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.760492:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b7480031200/0xb1a5ef690c500592 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.760512:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b7480031200/0xb1a5ef690c500592 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015329.760524:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015329.760537:0:17037:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b7480031200/0xb1a5ef690c500592 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015329.760546:0:17037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b7480031200/0xb1a5ef690c500592 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015329.760547:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:2353:x1872772280371200:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 381us (1251us total) trans 0 rc 0/0 00010000:00010000:3.0:1786015329.760553:0:17037:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7480031200/0xb1a5ef690c500592 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015329.760555:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 221 00010000:00010000:2.0:1786015329.760969:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015329.761174:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74865a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+10:2353:x1872772280371072:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1264us (4941us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015329.761182:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 220 00010000:00010000:2.0:1786015330.164771:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015330.372242:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015330.372318:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015330.372353:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015330.372411:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015330.372429:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280371456 00000100:00100000:2.0:1786015330.372447:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280371456 00000100:00100000:0.0:1786015330.372447:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015330.372471:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015330.372503:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015330.372580:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280371712 00000100:00100000:3.0:1786015330.372585:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280371712 00000100:00100000:3.0:1786015330.372628:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280371968 00000100:00100000:3.0:1786015330.372631:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280371968 00000100:00100000:3.0:1786015330.372647:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280371584 00000100:00100000:3.0:1786015330.372650:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280371584 00000100:00100000:3.0:1786015330.372661:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280372096 00000100:00100000:3.0:1786015330.372664:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280372096 00000100:00100000:3.0:1786015330.372681:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 294 00000100:00100000:3.0:1786015330.372693:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2354:x1872772280371712:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015330.372829:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2354:x1872772280371712:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 138us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015330.372839:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 294 00000100:00100000:3.0:1786015330.372859:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 295 00000100:00100000:3.0:1786015330.372866:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280371968:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015330.373092:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280371968:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 225us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015330.373099:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 295 00000100:00100000:3.0:1786015330.373112:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 296 00000100:00100000:3.0:1786015330.373118:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2354:x1872772280371584:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015330.373142:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2354:x1872772280371584:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015330.373148:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 296 00000100:00100000:3.0:1786015330.373158:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 297 00000100:00100000:3.0:1786015330.373165:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280372096:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015330.373186:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280372096:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015330.373193:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 297 00000100:00100000:3.0:1786015330.373734:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280371328 00000100:00100000:3.0:1786015330.373742:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280371328 00000100:00100000:3.0:1786015330.373812:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 411 00000100:00100000:3.0:1786015330.373821:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+10:2354:x1872772280371328:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015330.373860:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+10:2354:x1872772280371328:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 41us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015330.374056:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 411 00000100:00080000:1.0:1786015330.374185:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015330.374191:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015330.374195:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015330.382621:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280371840 00000100:00100000:0.0:1786015330.382650:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280371840 00000100:00100000:0.0:1786015330.382782:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 335 00000100:00100000:0.0:1786015330.382797:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+73:2354:x1872772280371456:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015330.382945:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+73:2354:x1872772280371456:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 150us (10722us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015330.382954:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 335 00000100:00100000:0.0:1786015330.382979:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 336 00000100:00100000:0.0:1786015330.383010:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+31:2354:x1872772280371840:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015330.383043:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+31:2354:x1872772280371840:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 36us (10570us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015330.383050:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 336 00000100:00080000:1.0:1786015330.385892:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015330.476184:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786015330.476221:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304357120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015330.476357:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015330.476745:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304357120 00000100:00100000:0.0:1786015330.476788:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304357120 00000100:00100000:0.0:1786015330.476881:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1786015330.476895:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304357120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015330.476953:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015330.477025:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304357120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015330.477034:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1786015330.477561:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015330.477621:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304357120:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1786015330.799628:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1786015330.799639:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b74bf8dd800 from 45 10000000:01000000:2.0:1786015330.799645:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786015330.799717:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7383907e00/0xb1a5ef690c500599 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015330.799731:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b7383907e00/0xb1a5ef690c500599 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015330.799744:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b7383907e00/0xb1a5ef690c500599 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015330.799819:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304357248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786015330.799911:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015330.799975:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b13f0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786015330.800213:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304357248 00000100:00100000:0.0:1786015330.800225:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304357248 00000100:00100000:0.0:1786015330.800302:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1786015330.800313:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+12:5792:x1872772304357248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786015330.800332:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015330.800365:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c5005a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c500599 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015330.800401:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c5005a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c500599 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015330.800413:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c5005a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500599 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015330.800425:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7480031a00, rc 0) 00000100:00100000:0.0:1786015330.800499:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304357248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015330.800507:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1786015330.801525:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304357248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786015330.801553:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b7383907e00/0xb1a5ef690c500599 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005a0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015330.801564:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b7383907e00/0xb1a5ef690c500599 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c5005a0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015330.801667:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304357376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015330.801720:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015330.801804:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b13f0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786015330.801884:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304357376 00000100:00100000:0.0:1786015330.801891:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304357376 00000100:00100000:0.0:1786015330.801940:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1786015330.801950:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304357376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015330.802333:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304357376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 383us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015330.802342:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1786015330.802891:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304357376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015330.802944:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304357504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786015330.802997:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015330.803034:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b13f0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786015330.806992:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304357504 00000100:00100000:0.0:1786015330.807018:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304357504 00000100:00100000:0.0:1786015330.807131:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1786015330.807145:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304357504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015330.807517:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304357504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 374us (4518us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015330.807526:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1786015330.808385:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304357504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786015330.808998:0:17039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17039:1872772304357632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015330.809111:0:17039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015330.809160:0:17039:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b13f0000 going to sleep for 11 seconds 00000100:00100000:3.0:1786015330.809221:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304357632 00000100:00100000:3.0:1786015330.809229:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304357632 00000100:00100000:3.0:1786015330.809290:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1786015330.809300:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:17039:x1872772304357632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015330.809814:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:17039:x1872772304357632:12345-0@lo:502:llog_process_th.0 Request processed in 513us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015330.809823:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1786015330.810372:0:17039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17039:1872772304357632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015330.810455:0:17039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17039:1872772304357760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015330.810516:0:17039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015330.810560:0:17039:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b13f0000 going to sleep for 11 seconds 00000100:00100000:3.0:1786015330.810793:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304357760 00000100:00100000:3.0:1786015330.810801:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304357760 00000100:00100000:3.0:1786015330.810855:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1786015330.810864:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:17039:x1872772304357760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015330.811094:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:17039:x1872772304357760:12345-0@lo:502:llog_process_th.0 Request processed in 230us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015330.811102:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1786015330.811288:0:17039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17039:1872772304357760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015330.811334:0:17039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17039:1872772304357888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015330.811508:0:17039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015330.811540:0:17039:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b13f0000 going to sleep for 11 seconds 00000100:00100000:3.0:1786015330.812489:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304357888 00000100:00100000:3.0:1786015330.812502:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304357888 00000100:00100000:3.0:1786015330.812570:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1786015330.812581:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:17039:x1872772304357888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015330.812902:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:17039:x1872772304357888:12345-0@lo:502:llog_process_th.0 Request processed in 322us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015330.812911:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1786015330.815463:0:17039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17039:1872772304357888:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1786015330.815541:0:17039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 49 count 48 00000020:01000000:3.0:1786015330.816717:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 45-48 (rc=0) 10000000:01000000:3.0:1786015330.816757:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786015330.816816:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7383907e00/0xb1a5ef690c500599 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005a0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.816831:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b7383907e00/0xb1a5ef690c500599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005a0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786015330.816842:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1786015330.816846:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1786015330.816873:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1786015330.816932:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b74c2179200/0xb1a5ef690c5005a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.816942:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b74c2179200/0xb1a5ef690c5005a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.816955:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b74c2179200/0xb1a5ef690c5005a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015330.816990:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304358016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786015330.817103:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015330.817246:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1786015330.826297:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304358016 00000100:00100000:1.0:1786015330.826325:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304358016 00000100:00100000:1.0:1786015330.826589:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1786015330.826604:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304358016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786015330.826632:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015330.826661:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b73813bfc00/0xb1a5ef690c5005ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c5005a7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015330.826701:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b73813bfc00/0xb1a5ef690c5005ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c5005a7 expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015330.826716:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b73813bfc00/0xb1a5ef690c5005ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c5005a7 expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015330.826727:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bfc00, rc 0) 00000100:00100000:1.0:1786015330.827914:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304358016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1304us (10801us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015330.827927:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1786015330.828667:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304358016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015330.828703:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b74c2179200/0xb1a5ef690c5005a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005ae expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.828719:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b74c2179200/0xb1a5ef690c5005a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c5005ae expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015330.829614:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304358144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015330.829702:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015330.829800:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1786015330.829905:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304358144 00000100:00100000:2.0:1786015330.829915:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304358144 00000100:00100000:2.0:1786015330.829979:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1786015330.829990:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304358144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015330.830652:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304358144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 662us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015330.830661:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1786015330.839176:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304358144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786015330.839299:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304358272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786015330.839441:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015330.839516:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce0600 going to sleep for 11 seconds 00000100:00100000:0.0:1786015330.841081:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304358272 00000100:00100000:0.0:1786015330.841101:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304358272 00000100:00100000:0.0:1786015330.841197:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1786015330.841211:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304358272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015330.841601:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304358272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 392us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015330.841612:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1786015330.841723:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304358272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786015330.852254:0:17040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:3.0:1786015330.852934:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1786015330.852977:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1786015330.852996:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b74c2179200/0xb1a5ef690c5005a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005ae expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.853011:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b74c2179200/0xb1a5ef690c5005a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005ae expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786015330.853060:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1786015330.853064:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b74aaa08000 from 45 10000000:01000000:3.0:1786015330.853067:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786015330.853125:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b74c2178c00/0xb1a5ef690c5005b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.853134:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b74c2178c00/0xb1a5ef690c5005b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.853149:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b74c2178c00/0xb1a5ef690c5005b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015330.853183:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304358400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786015330.853294:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015330.853588:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015330.853804:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304358400 00000100:00100000:0.0:1786015330.853816:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304358400 00000100:00100000:0.0:1786015330.853888:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1786015330.853898:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304358400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786015330.853919:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015330.853939:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7480031200/0xb1a5ef690c5005bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c5005b5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015330.853973:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7480031200/0xb1a5ef690c5005bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c5005b5 expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015330.853987:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7480031200/0xb1a5ef690c5005bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c5005b5 expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015330.853997:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7480031200, rc 0) 00000100:00100000:0.0:1786015330.854080:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304358400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015330.854088:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1786015330.854345:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304358400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015330.854379:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b74c2178c00/0xb1a5ef690c5005b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005bc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.854390:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b74c2178c00/0xb1a5ef690c5005b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c5005bc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015330.854484:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304358528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015330.854520:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015330.854570:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015330.854735:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304358528 00000100:00100000:0.0:1786015330.854740:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304358528 00000100:00100000:0.0:1786015330.854807:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1786015330.854816:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304358528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015330.856517:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304358528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1691us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015330.856531:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:1.0:1786015330.856722:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304358528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786015330.856835:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304358656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786015330.856907:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015330.856954:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce0180 going to sleep for 11 seconds 00000100:00100000:0.0:1786015330.857458:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304358656 00000100:00100000:0.0:1786015330.857468:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304358656 00000100:00100000:0.0:1786015330.857527:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1786015330.857537:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304358656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015330.859264:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304358656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1718us (2346us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015330.859305:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:1.0:1786015330.873518:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304358656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015330.878530:0:17041:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17041:1872772304358784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015330.878674:0:17041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015330.878734:0:17041:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7484fff780 going to sleep for 11 seconds 00000100:00100000:3.0:1786015330.878861:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304358784 00000100:00100000:3.0:1786015330.878872:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304358784 00000100:00100000:3.0:1786015330.878938:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1786015330.878949:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:17041:x1872772304358784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015330.879328:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:17041:x1872772304358784:12345-0@lo:502:llog_process_th.0 Request processed in 379us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015330.879338:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:0.0:1786015330.879657:0:17041:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17041:1872772304358784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015330.879720:0:17041:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17041:1872772304358912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015330.879783:0:17041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015330.879811:0:17041:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74ac59c240 going to sleep for 11 seconds 00000100:00100000:2.0:1786015330.879934:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304358912 00000100:00100000:2.0:1786015330.879941:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304358912 00000100:00100000:2.0:1786015330.879983:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:2.0:1786015330.879991:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:17041:x1872772304358912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015330.880193:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:17041:x1872772304358912:12345-0@lo:502:llog_process_th.0 Request processed in 202us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015330.880201:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1786015330.881221:0:17041:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17041:1872772304358912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015330.881311:0:17041:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17041:1872772304359040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015330.881552:0:17041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015330.881599:0:17041:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74ac59c240 going to sleep for 11 seconds 00000100:00100000:3.0:1786015330.881795:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304359040 00000100:00100000:3.0:1786015330.881804:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304359040 00000100:00100000:3.0:1786015330.881859:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1786015330.881869:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:17041:x1872772304359040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015330.883441:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:17041:x1872772304359040:12345-0@lo:502:llog_process_th.0 Request processed in 1562us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015330.883457:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:1.0:1786015330.885839:0:17041:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17041:1872772304359040:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1786015330.886230:0:17041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 49 count 48 00000020:01000000:3.0:1786015330.886690:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 45-48 (rc=0) 10000000:01000000:3.0:1786015330.886736:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786015330.886753:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b74c2178c00/0xb1a5ef690c5005b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005bc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.886805:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b74c2178c00/0xb1a5ef690c5005b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005bc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786015330.886817:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1786015330.886821:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1786015330.886824:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1786015330.886881:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c5005c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.886890:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c5005c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.886928:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c5005c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015330.886964:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304359168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786015330.887229:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015330.887317:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1786015330.887604:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304359168 00000100:00100000:1.0:1786015330.887615:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304359168 00000100:00100000:1.0:1786015330.887690:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1786015330.887701:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304359168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786015330.887721:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015330.887741:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5005ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c5005c3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015330.887949:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5005ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c5005c3 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015330.887965:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5005ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c5005c3 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015330.887977:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf600, rc 0) 00000100:00100000:1.0:1786015330.888172:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304359168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 472us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015330.888181:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1786015330.888430:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304359168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015330.888454:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c5005c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005ca expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.888466:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c5005c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c5005ca expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015330.888561:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304359296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015330.888608:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015330.888705:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015330.892702:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304359296 00000100:00100000:0.0:1786015330.892725:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304359296 00000100:00100000:0.0:1786015330.892866:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1786015330.892880:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304359296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015330.897839:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304359296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4945us (9213us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015330.897860:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1786015330.898649:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304359296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786015330.898745:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304359424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786015330.898893:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015330.898953:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce0480 going to sleep for 11 seconds 00000100:00100000:0.0:1786015330.899955:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304359424 00000100:00100000:0.0:1786015330.899969:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304359424 00000100:00100000:0.0:1786015330.900154:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1786015330.900170:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304359424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015330.900520:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304359424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 353us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015330.901748:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304359424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786015330.906799:0:17042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:2.0:1786015330.907092:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1786015330.907162:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1786015330.907178:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c5005c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005ca expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015330.907193:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c5005c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005ca expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786015330.907206:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1786015330.907209:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b7483242800 from 45 10000000:01000000:2.0:1786015330.907212:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786015330.907270:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c5005d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015330.907286:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c5005d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015330.907301:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c5005d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015330.907331:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304359552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786015330.907430:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015330.907488:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b13f0840 going to sleep for 11 seconds 00000100:00100000:3.0:1786015330.907805:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304359552 00000100:00100000:3.0:1786015330.907816:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304359552 00000100:00100000:0.0:1786015330.908487:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1786015330.908735:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1786015330.908751:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304359552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015330.908969:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015330.908997:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c5005d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c5005d1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.909034:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c5005d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c5005d1 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.912747:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c5005d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c5005d1 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.912776:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2179600, rc 0) 00000100:00100000:3.0:1786015330.912913:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304359552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4164us (5480us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015330.912924:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1786015330.913223:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304359552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786015330.913256:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c5005d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005d8 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015330.913268:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c5005d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c5005d8 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015330.913394:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304359680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015330.913456:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015330.913501:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b13f0840 going to sleep for 11 seconds 00000100:00100000:1.0:1786015330.913683:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304359680 00000100:00100000:1.0:1786015330.913691:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304359680 00000100:00100000:1.0:1786015330.913746:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1786015330.913757:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304359680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786015330.914190:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304359680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 433us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015330.914198:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1786015330.915262:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304359680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015330.915343:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304359808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786015330.915430:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015330.915480:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b13f0840 going to sleep for 11 seconds 00000100:00100000:1.0:1786015330.915678:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304359808 00000100:00100000:1.0:1786015330.915687:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304359808 00000100:00100000:1.0:1786015330.915745:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1786015330.915754:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304359808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786015330.916018:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304359808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 264us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015330.916025:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:2.0:1786015330.916511:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304359808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786015330.917643:0:17043:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17043:1872772304359936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015330.917738:0:17043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015330.917906:0:17043:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74aa53bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015330.918153:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304359936 00000100:00100000:0.0:1786015330.918174:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304359936 00000100:00100000:0.0:1786015330.918232:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1786015330.918244:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:17043:x1872772304359936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015330.922683:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:17043:x1872772304359936:12345-0@lo:502:llog_process_th.0 Request processed in 4425us (4928us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015330.922706:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1786015330.928578:0:17043:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17043:1872772304359936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015330.928754:0:17043:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17043:1872772304360064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015330.929325:0:17043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015330.929407:0:17043:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54e300 going to sleep for 11 seconds 00000100:00100000:2.0:1786015330.930249:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304360064 00000100:00100000:2.0:1786015330.930265:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304360064 00000100:00100000:2.0:1786015330.930364:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1786015330.930377:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:17043:x1872772304360064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015330.930698:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:17043:x1872772304360064:12345-0@lo:502:llog_process_th.0 Request processed in 324us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015330.930707:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1786015330.931096:0:17043:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17043:1872772304360064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015330.931170:0:17043:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17043:1872772304360192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015330.931220:0:17043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015330.931279:0:17043:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54e300 going to sleep for 11 seconds 00000100:00100000:2.0:1786015330.931494:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304360192 00000100:00100000:2.0:1786015330.931501:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304360192 00000100:00100000:2.0:1786015330.931549:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1786015330.931558:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:17043:x1872772304360192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015330.931740:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:17043:x1872772304360192:12345-0@lo:502:llog_process_th.0 Request processed in 184us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015330.931757:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1786015330.931883:0:17043:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17043:1872772304360192:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1786015330.931913:0:17043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 49 count 48 00000020:01000000:3.0:1786015330.933947:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 45-48 (rc=0) 10000000:01000000:3.0:1786015330.933996:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786015330.934013:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c5005d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005d8 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.934029:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c5005d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005d8 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786015330.934145:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1786015330.934149:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 40 10000000:01000000:3.0:1786015330.934172:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1786015330.934225:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b74c2178a00/0xb1a5ef690c5005df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.934235:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b74c2178a00/0xb1a5ef690c5005df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.934247:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b74c2178a00/0xb1a5ef690c5005df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015330.934291:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304360320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786015330.934522:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015330.934717:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304360320 00000100:00100000:1.0:1786015330.934726:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304360320 00000100:00100000:1.0:1786015330.934824:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1786015330.934835:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304360320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786015330.934855:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015330.934872:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b73813be200/0xb1a5ef690c5005e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c5005df expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015330.934903:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b73813be200/0xb1a5ef690c5005e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c5005df expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015330.934931:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b73813be200/0xb1a5ef690c5005e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c5005df expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015330.934942:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813be200, rc 0) 00000100:00100000:1.0:1786015330.934992:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304360320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015330.935000:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1786015330.935982:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54e300 going to sleep for 11 seconds 00000100:00100000:2.0:1786015330.936025:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304360320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786015330.936247:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b74c2178a00/0xb1a5ef690c5005df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005e6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015330.936262:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b74c2178a00/0xb1a5ef690c5005df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c5005e6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015330.936448:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304360448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015330.936512:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015330.936550:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06300 going to sleep for 11 seconds 00000100:00100000:3.0:1786015330.936726:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304360448 00000100:00100000:3.0:1786015330.936732:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304360448 00000100:00100000:3.0:1786015330.936888:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:3.0:1786015330.936900:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304360448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015330.938953:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304360448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2045us (2429us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015330.938971:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:3.0:1786015330.939235:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304360448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015330.939320:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304360576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786015330.940233:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015330.940346:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304360576 00000100:00100000:2.0:1786015330.940509:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54e180 going to sleep for 11 seconds 00000100:00100000:3.0:1786015330.940548:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304360576 00000100:00100000:3.0:1786015330.940650:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:3.0:1786015330.940662:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304360576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786015330.940978:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304360576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 317us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015330.940986:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1786015330.941100:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304360576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786015330.945177:0:17044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17044:1872772304360704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015330.945316:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015330.951867:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304360704 00000100:00100000:1.0:1786015330.951892:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304360704 00000100:00100000:2.0:1786015330.952257:0:17044:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015330.953539:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1786015330.953558:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:17044:x1872772304360704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786015330.954025:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:17044:x1872772304360704:12345-0@lo:502:llog_process_th.0 Request processed in 472us (8708us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015330.954035:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:2.0:1786015330.954174:0:17044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17044:1872772304360704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786015330.954226:0:17044:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786015330.954241:0:17044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786015330.954244:0:17044:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-MDT0000-m add lustre.test_11c.lustre-OST0001_UUID 00000020:00000080:2.0:1786015330.954259:0:17044:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1786015330.954291:0:17044:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to test_11c as member 1 00000100:00100000:0.0:1786015330.956344:0:17044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17044:1872772304360832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015330.956574:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1786015330.956660:0:17045:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b7483242800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1786015330.956666:0:17045:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b7483242800 4 00000100:00100000:0.0:1786015330.957594:0:17044:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0312180 going to sleep for 11 seconds 00000100:00100000:3.0:1786015330.957962:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304360832 00000100:00100000:3.0:1786015330.957974:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304360832 00000100:00100000:3.0:1786015330.958037:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1786015330.958047:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:17044:x1872772304360832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015330.958586:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:17044:x1872772304360832:12345-0@lo:502:llog_process_th.0 Request processed in 537us (2009us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015330.958596:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:0.0:1786015330.958952:0:17044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17044:1872772304360832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786015330.959005:0:17044:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786015330.959015:0:17044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786015330.959018:0:17044:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-MDT0000-m add lustre.test_11c.lustre-OST0001_UUID 00000040:00080000:0.0:1786015330.959025:0:17044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:1.0:1786015330.959239:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 40-42 (rc=0) 10000000:01000000:1.0:1786015330.959264:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1786015330.959336:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b74c2178a00/0xb1a5ef690c5005df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005e6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015330.959350:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b74c2178a00/0xb1a5ef690c5005df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005e6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786015330.959421:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1786015330.959425:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8b74b00a4d40 from 1 10000000:01000000:1.0:1786015330.959428:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1786015330.959469:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73813be000/0xb1a5ef690c5005ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015330.959492:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b73813be000/0xb1a5ef690c5005ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015330.959502:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b73813be000/0xb1a5ef690c5005ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015330.959527:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8caf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304360960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786015330.959585:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015330.959636:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce0600 going to sleep for 11 seconds 00000100:00100000:3.0:1786015330.959697:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304360960 00000100:00100000:3.0:1786015330.959704:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304360960 00000100:00100000:3.0:1786015330.959747:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1786015330.959756:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304360960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015330.959879:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015330.959896:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b74c2178000/0xb1a5ef690c5005f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c5005ed expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.959926:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b74c2178000/0xb1a5ef690c5005f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c5005ed expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.959937:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b74c2178000/0xb1a5ef690c5005f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c5005ed expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.959948:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2178000, rc 0) 00000100:00100000:3.0:1786015330.960001:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:5792:x1872772304360960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 246us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015330.960007:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1786015330.960047:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8caf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304360960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015330.960074:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b73813be000/0xb1a5ef690c5005ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005f4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015330.960084:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b73813be000/0xb1a5ef690c5005ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c5005f4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015330.960159:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304361088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015330.960188:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015330.960211:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304361088 00000100:00100000:3.0:1786015330.960214:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304361088 00000100:00100000:3.0:1786015330.960232:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1786015330.960238:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:5792:x1872772304361088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015330.960908:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54e180 going to sleep for 11 seconds 00000100:00100000:3.0:1786015330.961103:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:5792:x1872772304361088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 861us (911us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786015330.961113:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1786015330.961184:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304361088:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1786015330.961228:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1786015330.961238:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73813be000/0xb1a5ef690c5005ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005f4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015330.961248:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b73813be000/0xb1a5ef690c5005ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5005f4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.181167:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015331.584105:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015331.585018:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280372224 00000100:00100000:1.0:1786015331.585037:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280372224 00000100:00100000:1.0:1786015331.585142:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 443 00000100:00100000:1.0:1786015331.585155:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+10:5571:x1872772280372224:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786015331.585183:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015331.585214:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b73813bf200/0xb1a5ef690c5005fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8164 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015331.585269:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b73813bf200/0xb1a5ef690c5005fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8164 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015331.585285:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b73813bf200/0xb1a5ef690c5005fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8164 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015331.585297:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf200, rc 0) 00000100:00100000:1.0:1786015331.585401:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280372224:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 248us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015331.585409:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 443 00000100:00100000:1.0:1786015331.588208:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015331.588362:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280372352 00000100:00100000:3.0:1786015331.588377:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280372352 00000100:00100000:3.0:1786015331.588455:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 444 00000100:00100000:3.0:1786015331.588467:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280372352:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015331.591294:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280372352:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 2810us (3084us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015331.591318:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 444 00000100:00100000:3.0:1786015331.602076:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015331.602247:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280372480 00000100:00100000:2.0:1786015331.602264:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280372480 00000100:00100000:2.0:1786015331.602341:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 445 00000100:00100000:2.0:1786015331.602353:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280372480:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786015331.602687:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280372480:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 336us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015331.602697:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 445 00000100:00100000:0.0:1786015331.618277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015331.618430:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280372608 00000100:00100000:3.0:1786015331.618446:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280372608 00000100:00100000:3.0:1786015331.618526:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 446 00000100:00100000:3.0:1786015331.618540:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:22450:x1872772280372608:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786015331.618977:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:22450:x1872772280372608:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 437us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015331.618998:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 446 00000100:00100000:3.0:1786015331.631999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015331.632280:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280372736 00000100:00100000:1.0:1786015331.632294:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280372736 00000100:00100000:1.0:1786015331.632369:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 447 00000100:00100000:1.0:1786015331.632383:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:22450:x1872772280372736:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786015331.633214:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:22450:x1872772280372736:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 828us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015331.633237:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 447 00000100:00100000:1.0:1786015331.652524:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015331.653068:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280372864 00000100:00100000:2.0:1786015331.653091:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280372864 00000100:00100000:2.0:1786015331.653195:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 448 00000100:00100000:2.0:1786015331.653211:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:22450:x1872772280372864:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786015331.653609:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:22450:x1872772280372864:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 401us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015331.653620:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 448 00000100:00100000:0.0:1786015331.669024:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015331.669218:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280372992 00000100:00100000:3.0:1786015331.669245:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280372992 00000100:00100000:3.0:1786015331.669326:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 449 00000100:00100000:3.0:1786015331.669341:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280372992:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015331.669372:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015331.669402:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b73819ba200/0xb1a5ef690c500602 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e816b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.669446:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b73819ba200/0xb1a5ef690c500602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e816b expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.669463:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b73819ba200/0xb1a5ef690c500602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e816b expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.669476:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819ba200, rc 0) 00000100:00100000:3.0:1786015331.669689:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280372992:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 349us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015331.669697:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 449 00000100:00100000:3.0:1786015331.675096:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015331.676649:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280373120 00000100:00100000:2.0:1786015331.676668:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280373120 00000100:00100000:2.0:1786015331.676757:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 450 00000100:00100000:2.0:1786015331.676921:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280373120:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015331.677378:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280373120:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 461us (2299us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015331.680848:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 450 00000100:00100000:0.0:1786015331.684153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015331.684396:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280373248 00000100:00100000:1.0:1786015331.684411:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280373248 00000100:00100000:1.0:1786015331.684558:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 451 00000100:00100000:1.0:1786015331.684572:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280373248:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786015331.685104:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280373248:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 532us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015331.685114:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 451 00000100:00100000:0.0:1786015331.689604:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015331.692192:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280373376 00000100:00100000:2.0:1786015331.692248:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280373376 00000100:00100000:2.0:1786015331.692338:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 452 00000100:00100000:2.0:1786015331.692350:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:22451:x1872772280373376:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786015331.692711:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:22451:x1872772280373376:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 363us (3123us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015331.692718:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 452 00000100:00100000:0.0:1786015331.694873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015331.694979:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280373504 00000100:00100000:1.0:1786015331.694994:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280373504 00000100:00100000:1.0:1786015331.695076:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 453 00000100:00100000:1.0:1786015331.695090:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:22451:x1872772280373504:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786015331.695436:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:22451:x1872772280373504:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 348us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015331.695448:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 453 00000100:00100000:0.0:1786015331.698154:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015331.698691:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280373632 00000100:00100000:2.0:1786015331.698707:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280373632 00000100:00100000:2.0:1786015331.698851:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 454 00000100:00100000:2.0:1786015331.698865:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:22451:x1872772280373632:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786015331.699218:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:22451:x1872772280373632:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 356us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015331.699335:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 454 00000100:00100000:0.0:1786015331.706275:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015331.706477:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280373760 00000100:00100000:3.0:1786015331.706492:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280373760 00000100:00100000:3.0:1786015331.706712:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 455 00000100:00100000:3.0:1786015331.706727:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280373760:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015331.706752:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015331.706847:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b73819bb200/0xb1a5ef690c500609 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8172 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.706889:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b73819bb200/0xb1a5ef690c500609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8172 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.706903:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b73819bb200/0xb1a5ef690c500609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8172 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.706915:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb200, rc 0) 00000100:00100000:3.0:1786015331.706993:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:5571:x1872772280373760:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 270us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015331.707001:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 455 00000100:00100000:0.0:1786015331.710371:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015331.710499:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280373888 00000100:00100000:2.0:1786015331.710514:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280373888 00000100:00100000:2.0:1786015331.710583:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 456 00000100:00100000:2.0:1786015331.710597:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:5571:x1872772280373888:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015331.711476:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:5571:x1872772280373888:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 874us (1114us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786015331.711486:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 456 00000100:00100000:0.0:1786015331.948609:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015331.948669:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015331.948806:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280374272 00000100:00100000:1.0:1786015331.948824:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280374272 00000100:00100000:1.0:1786015331.948987:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280374016 00000100:00100000:1.0:1786015331.949009:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280374016 00000100:00100000:1.0:1786015331.949041:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 731 00000100:00100000:1.0:1786015331.949068:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+74:22462:x1872772280374272:12345-192.168.202.56@tcp:36:mkdir.0 00010000:00010000:1.0:1786015331.949162:0:12526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015331.949212:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c50020b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e804c expref: 74 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015331.949318:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6700) 00010000:00010000:1.0:1786015331.949325:0:12526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015331.949740:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500610 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015331.949795:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50024a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8061 expref: 30 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015331.949806:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500610 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015331.949857:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50024a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8061 expref: 30 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015331.950171:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 732 00000100:00100000:0.0:1786015331.950189:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+73:2351:x1872772280374016:12345-192.168.202.56@tcp:41:mkdir.0 00000004:00000024:0.0:1786015331.950248:0:5795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 14680064 pending 0 free 2259812352 avail 2257715200 00000100:00100000:0.0:1786015331.950355:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+73:2351:x1872772280374016:12345-192.168.202.56@tcp:41:mkdir.0 Request processed in 173us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015331.950363:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 732 00010000:00010000:1.0:1786015331.951223:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50024a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8061 expref: 30 pid: 5795 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015331.951256:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8caf100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304361216:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015331.952097:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7491f64900 going to sleep for 11 seconds 00000100:00100000:0.0:1786015331.954366:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015331.958426:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280374400 00000100:00100000:3.0:1786015331.958452:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280374400 00010000:00010000:3.0:1786015331.958540:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50024a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8061 expref: 31 pid: 5795 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015331.958605:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 222 00000100:00100000:3.0:1786015331.958618:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+31:2353:x1872772280374400:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015331.958643:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015331.958652:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50024a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8061 expref: 31 pid: 5795 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.958672:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50024a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8061 expref: 31 pid: 5795 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.958707:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6700) 00010000:00010000:3.0:1786015331.958729:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500610 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.958743:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500610 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.958752:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500610 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.958812:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015331.958914:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+31:2353:x1872772280374400:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 298us (4563us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015331.958923:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 222 00010000:00010000:1.0:1786015331.959577:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50024a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8061 expref: 30 pid: 5795 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015331.959623:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8caf100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304361216:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015331.959660:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500610 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015331.959671:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500610 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015331.959677:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500610 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015331.962149:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500617 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015331.962182:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500617 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015331.962201:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500617 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015331.967720:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2d:0x0]: returning size 512 00010000:00010000:0.0:1786015331.967803:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500610 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015331.967827:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500610 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015331.967838:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500610 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015331.967846:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bec00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015331.967853:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500610 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015331.969229:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500610 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015331.969275:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6700) 00010000:00010000:0.0:1786015331.969279:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015331.969288:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500610 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015331.969296:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500610 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015331.969341:0:12526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005eda66cd reply state 00000000156d2df5 transno 4294967777 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500617 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015331.969355:0:12526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015331.969979:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+74:22462:x1872772280374272:12345-192.168.202.56@tcp:36:mkdir.0 Request processed in 20908us (21380us total) trans 4294967777 rc 0/0 00000100:00100000:0.0:1786015331.969993:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 731 00010000:00010000:3.0:1786015331.974573:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500617 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.974599:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500617 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.974608:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500617 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.974616:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015331.974622:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500617 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.974632:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500617 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.974660:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3c4dff78 (ffff8b7483ee6400) 00010000:00010000:3.0:1786015331.974663:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015331.974682:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500617 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.974690:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c500617 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015331.990432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015331.991064:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280374528 00000100:00100000:3.0:1786015331.991083:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280374528 00000100:00100000:3.0:1786015331.991181:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 733 00000100:00100000:3.0:1786015331.991195:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+73:22463:x1872772280374528:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015331.991335:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015331.991377:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50061e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8179 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.991485:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500625 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.991506:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500625 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.991523:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500625 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015331.991645:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1786015331.991652:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015331.995510:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500625 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.995593:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50061e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8179 expref: 75 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.995627:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500625 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8179 expref: 74 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015331.995665:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:3.0:1786015331.995668:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015331.995673:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819baa00, rc 0) 00000100:00100000:3.0:1786015331.995821:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+74:22463:x1872772280374528:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 4627us (5403us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015331.995832:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 733 00000100:00100000:0.0:1786015332.005703:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015332.009033:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280374656 00000100:00100000:1.0:1786015332.009067:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280374656 00000100:00100000:1.0:1786015332.009577:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 734 00000100:00100000:1.0:1786015332.009594:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+74:22463:x1872772280374656:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015332.009631:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015332.009666:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c50062c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8180 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.009811:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500633 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.009832:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500633 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.009846:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500633 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010014:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50063a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010022:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50063a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010030:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50063a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010201:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500641 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010211:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010218:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015332.010295:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2d:0x0]: returning size 512 00000004:00200000:1.0:1786015332.010302:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015332.010337:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010353:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500633 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010361:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500633 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010368:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500633 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010387:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bfa00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015332.010392:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500633 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010401:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500633 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010415:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:1.0:1786015332.010418:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015332.010424:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500633 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010431:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c500633 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010445:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50063a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010452:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50063a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010457:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50063a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010462:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015332.010465:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50063a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010471:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50063a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010490:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3c4dff78 (ffff8b7483ee6500) 00010000:00010000:1.0:1786015332.010493:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015332.010496:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50063a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010501:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50063a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010546:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c50062c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8180 expref: 76 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010564:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500641 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8180 expref: 75 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.010572:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:1.0:1786015332.010575:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015332.010577:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bec00, rc 0) 00000100:00100000:1.0:1786015332.011187:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+75:22463:x1872772280374656:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1593us (5502us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015332.011198:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 734 00000100:00080000:0.0:1786015332.011438:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015332.020606:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304361344:0@lo:400:kworker.0 00000100:00100000:2.0:1786015332.020754:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015332.021169:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015332.021208:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280374912 00000100:00100000:1.0:1786015332.021220:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280374912 00000100:00100000:1.0:1786015332.021308:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 735 00000100:00100000:1.0:1786015332.021320:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+75:22463:x1872772280374912:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015332.021351:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015332.021388:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c500648 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8187 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015332.021593:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2d:0x0]: returning size 512 00010000:00010000:1.0:1786015332.021808:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c500648 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8187 expref: 77 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.021830:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:1.0:1786015332.021834:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786015332.021841:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c500648 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8187 expref: 77 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.021861:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1e00, rc 0) 00000100:00100000:1.0:1786015332.021940:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+76:22463:x1872772280374912:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 622us (775us total) trans 4294967778 rc 301/301 00000100:00100000:1.0:1786015332.021948:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 735 00000100:00100000:2.0:1786015332.027217:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304361856:0@lo:400:kworker.0 00000100:00100000:1.0:1786015332.028186:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304361472:0@lo:400:kworker.0 00000100:00100000:1.0:1786015332.028326:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015332.028391:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304361984:0@lo:400:kworker.0 00000100:00100000:1.0:1786015332.028427:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015332.028468:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015332.028477:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304361600:0@lo:400:kworker.0 00000100:00100000:1.0:1786015332.028505:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015332.028548:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304361728:0@lo:400:kworker.0 00000100:00100000:1.0:1786015332.028578:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015332.029119:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015332.029156:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304361472 00000100:00100000:1.0:1786015332.029190:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304361472 00000100:00100000:1.0:1786015332.029405:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304361600 00000100:00100000:1.0:1786015332.029409:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304361600 00000100:00100000:1.0:1786015332.029448:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280375168 00000100:00100000:1.0:1786015332.029451:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280375168 00000100:00100000:1.0:1786015332.029477:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1786015332.029489:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304361472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015332.029582:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304361472:12345-0@lo:400:kworker.0 Request processed in 95us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015332.029591:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1786015332.029611:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1786015332.029618:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304361600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015332.029651:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304361600:12345-0@lo:400:kworker.0 Request processed in 34us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015332.029657:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1786015332.029670:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 736 00000100:00100000:1.0:1786015332.029675:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+76:22463:x1872772280375168:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:1.0:1786015332.029746:0:7673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015332.029825:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c500641 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8180 expref: 76 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.029853:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff8b7483ee6b00) 00000100:00100000:3.0:1786015332.030269:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304361984 00000100:00100000:3.0:1786015332.030276:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304361984 00000100:00100000:3.0:1786015332.030429:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304361728 00000100:00100000:3.0:1786015332.030433:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304361728 00000100:00100000:3.0:1786015332.030461:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1786015332.030468:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304361984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015332.030554:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304361984:12345-0@lo:400:kworker.0 Request processed in 86us (2125us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015332.030560:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1786015332.030575:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1786015332.030581:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304361728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015332.030624:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304361728:12345-0@lo:400:kworker.0 Request processed in 44us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015332.030630:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1786015332.030718:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304361728:0@lo:400:kworker.0 00010000:00010000:1.0:1786015332.031319:0:7673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015332.031378:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c500656 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.031402:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c500656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.031437:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c500656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015332.031997:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015332.032110:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304361344 00000100:00100000:2.0:1786015332.032120:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304361344 00000100:00100000:2.0:1786015332.032173:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1786015332.032182:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304361344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015332.032998:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304361856 00000100:00100000:3.0:1786015332.033012:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304361856 00000100:00100000:3.0:1786015332.033076:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1786015332.033086:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304361856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015332.033177:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304361856:12345-0@lo:400:kworker.0 Request processed in 92us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015332.033186:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000004:00010000:1.0:1786015332.033481:0:7673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008024ad77 reply state 000000006dc970a0 transno 4294967779 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c500656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015332.033496:0:7673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1786015332.033532:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2d:0x0]: returning size 512 00000100:00100000:1.0:1786015332.033630:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+77:22463:x1872772280375168:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 3951us (4513us total) trans 4294967779 rc 0/0 00000100:00100000:1.0:1786015332.033638:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 736 00000100:00080000:1.0:1786015332.033668:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015332.033675:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015332.033954:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304361344:12345-0@lo:400:kworker.0 Request processed in 1771us (13198us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015332.033963:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1786015332.034070:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304361344:0@lo:400:kworker.0 00000100:00100000:2.0:1786015332.034087:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304361856:0@lo:400:kworker.0 00000100:00080000:1.0:1786015332.035024:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015332.035491:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304361600:0@lo:400:kworker.0 00000100:00100000:1.0:1786015332.035513:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304361472:0@lo:400:kworker.0 00000100:00100000:1.0:1786015332.035530:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304361984:0@lo:400:kworker.0 00010000:00010000:0.0:1786015332.036834:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c500656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015332.036857:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c500656 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015332.036877:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c500656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015332.036885:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015332.036891:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c500656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015332.036901:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c500656 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015332.036924:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff8b7483ee6200) 00010000:00010000:0.0:1786015332.036927:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015332.036933:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c500656 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015332.036940:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c500656 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015332.037636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015332.038086:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280375424 00000100:00100000:1.0:1786015332.038103:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280375424 00000100:00100000:1.0:1786015332.038261:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 151 00000100:00100000:1.0:1786015332.038275:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+76:22463:x1872772280375424:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:1.0:1786015332.038664:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+77:22463:x1872772280375424:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 392us (1035us total) trans 4294967780 rc 0/0 00000100:00100000:1.0:1786015332.038674:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 151 00010000:00010000:1.0:1786015332.204248:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015332.378348:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015332.378667:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280375680 00000100:00100000:3.0:1786015332.378684:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280375680 00000100:00100000:1.0:1786015332.378839:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 737 00000100:00100000:1.0:1786015332.378856:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+77:22500:x1872772280375680:12345-192.168.202.56@tcp:36:mkdir.0 00010000:00010000:1.0:1786015332.378952:0:7673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015332.378992:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500625 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8179 expref: 77 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.379023:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:1.0:1786015332.379047:0:7673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015332.379428:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+76:22500:x1872772280375680:12345-192.168.202.56@tcp:36:mkdir.0 Request processed in 575us (1096us total) trans 0 rc -17/-17 00000100:00100000:1.0:1786015332.379437:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 737 00000100:00100000:0.0:1786015332.383092:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015332.383267:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280375808 00000100:00100000:1.0:1786015332.383283:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280375808 00000100:00100000:1.0:1786015332.383381:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 738 00000100:00100000:1.0:1786015332.383396:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+76:22500:x1872772280375808:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:1.0:1786015332.383428:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015332.383468:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50065d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e818e expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.383577:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c500664 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.383595:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c500664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.383612:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c500664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015332.384942:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1786015332.384953:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015332.384997:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c500664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.385057:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50065d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e818e expref: 78 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.385088:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c500664 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e818e expref: 77 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.385100:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:1.0:1786015332.385103:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015332.385107:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a0400, rc 0) 00000100:00100000:1.0:1786015332.385565:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+77:22500:x1872772280375808:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 2170us (2489us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015332.385577:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 738 00000100:00100000:0.0:1786015332.388758:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015332.389085:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280375936 00000100:00100000:2.0:1786015332.389102:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280375936 00000100:00100000:2.0:1786015332.389212:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 739 00000100:00100000:2.0:1786015332.389235:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+77:22500:x1872772280375936:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:2.0:1786015332.389276:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015332.389313:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50066b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8195 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.389427:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c500672 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.389449:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c500672 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.389465:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c500672 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.389486:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500679 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.389522:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.389531:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.389750:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500680 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.389875:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.389885:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015332.389942:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2d:0x0]: returning size 512 00000004:00200000:2.0:1786015332.389947:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015332.389978:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.389995:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c500672 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.390002:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c500672 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.390009:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c500672 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.390016:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015332.390021:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c500672 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.390049:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c500672 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.390064:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:2.0:1786015332.390068:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015332.390073:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c500672 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.390080:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c500672 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.390094:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.390100:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500679 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.390107:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500679 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.390113:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015332.390116:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500679 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.390123:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500679 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.390131:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3c4dff78 (ffff8b74938ba000) 00010000:00010000:2.0:1786015332.390133:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015332.390136:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500679 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.390153:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c500679 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.390195:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50066b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8195 expref: 79 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.390210:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500680 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8195 expref: 78 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.390219:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff8b74938ba500) 00010000:00010000:2.0:1786015332.390221:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015332.390224:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907000, rc 0) 00000100:00100000:2.0:1786015332.390307:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+78:22500:x1872772280375936:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 1083us (1569us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015332.390315:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 739 00000100:00100000:2.0:1786015332.451695:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015332.452063:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280376064 00000100:00100000:1.0:1786015332.452078:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280376064 00000100:00100000:1.0:1786015332.452192:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 740 00000100:00100000:1.0:1786015332.452206:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+30:22506:x1872772280376064:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015332.452311:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015332.452350:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c500687 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e819c expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.452452:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c50068e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.452495:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c50068e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.452510:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c50068e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015332.452606:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1786015332.452611:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015332.452648:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c50068e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786015332.452946:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786015332.453016:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c500687 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e819c expref: 32 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.453057:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c50068e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e819c expref: 31 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.453069:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:1.0:1786015332.453072:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015332.453077:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1000, rc 0) 00000100:00100000:1.0:1786015332.453345:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+31:22506:x1872772280376064:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1140us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015332.453355:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 740 00000100:00100000:0.0:1786015332.462134:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015332.462328:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280376320 00000100:00100000:1.0:1786015332.462344:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280376320 00000100:00100000:1.0:1786015332.462431:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 741 00000100:00100000:1.0:1786015332.462445:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+78:22506:x1872772280376320:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015332.462476:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015332.462499:0:12526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786015332.462536:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500680 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8195 expref: 78 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.462561:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff8b74938ba500) 00010000:00010000:1.0:1786015332.462577:0:12526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015332.462599:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c500695 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e81a3 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.462857:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50069c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.462874:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50069c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.462886:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50069c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.462901:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c5006a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.462908:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c5006a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.462915:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c5006a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.464687:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5006aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.464714:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5006aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.464744:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5006aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015332.465070:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2f:0x0]: returning size 0 00010000:00010000:1.0:1786015332.465117:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50069c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.465202:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50069c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.465212:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50069c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.465285:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bec00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015332.465292:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50069c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.465302:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50069c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.465317:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff8b7483ee6500) 00010000:00010000:1.0:1786015332.465320:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015332.465327:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50069c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.465334:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50069c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786015332.465354:0:12526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000605fe275 reply state 0000000028d2fdb8 transno 4294967781 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c5006a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015332.465379:0:12526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786015332.465436:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c500695 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81a3 expref: 80 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.465463:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5006aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81a3 expref: 79 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.465473:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8b7483ee6f00) 00010000:00010000:1.0:1786015332.465475:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015332.465477:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf800, rc 0) 00000100:00100000:1.0:1786015332.465590:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+80:22506:x1872772280376320:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 3147us (3478us total) trans 4294967781 rc 0/0 00000100:00100000:1.0:1786015332.465601:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 741 00010000:00010000:3.0:1786015332.468824:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c5006a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.468850:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c5006a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.468858:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c5006a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.468866:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bea00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015332.468872:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c5006a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.468881:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c5006a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.468905:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0xecadbcfe (ffff8b7483ee6d00) 00010000:00010000:3.0:1786015332.468909:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015332.468915:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c5006a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.468921:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bea00/0xb1a5ef690c5006a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015332.470228:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015332.470500:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280376576 00000100:00100000:3.0:1786015332.470513:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280376576 00000100:00100000:3.0:1786015332.470608:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 742 00000100:00100000:3.0:1786015332.470621:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+79:22506:x1872772280376576:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015332.470659:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015332.470692:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5006b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e81aa expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.470858:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5006bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.470876:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5006aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81a3 expref: 80 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.470885:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5006bf lrc: 4/0,1 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.470932:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5006aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81a3 expref: 80 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.470949:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5006aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81a3 expref: 80 pid: 12526 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015332.470967:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304362112:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015332.471109:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74aee18000 going to sleep for 11 seconds 00000100:00100000:0.0:1786015332.477253:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015332.477432:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304362112:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015332.477488:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5006bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015332.477599:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280376704 00000100:00100000:1.0:1786015332.477611:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280376704 00010000:00010000:1.0:1786015332.477670:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5006aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81a3 expref: 81 pid: 12526 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015332.477731:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 223 00000100:00100000:1.0:1786015332.477743:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+81:2353:x1872772280376704:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015332.477801:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015332.477812:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5006aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81a3 expref: 81 pid: 12526 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.477827:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5006aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81a3 expref: 81 pid: 12526 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.477887:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5006aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81a3 expref: 81 pid: 12526 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.477908:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8b7483ee6f00) 00010000:00010000:1.0:1786015332.477914:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5006bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.477927:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5006bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.477936:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5006bf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015332.477963:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015332.478035:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+80:2353:x1872772280376704:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 294us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015332.478054:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 223 00010000:00010000:2.0:1786015332.479144:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5006bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.479161:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5006bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015332.479191:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2f:0x0]: returning size 0 00010000:00010000:2.0:1786015332.479624:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5006bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.479634:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5006bf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.479662:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5006bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.479668:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819baa00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015332.479674:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5006bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.479696:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5006bf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.479715:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8b7483ee6f00) 00010000:00010000:2.0:1786015332.479719:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015332.479725:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5006bf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.479733:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c5006bf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.479875:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5006b8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81aa expref: 80 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.479887:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:2.0:1786015332.479890:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786015332.479895:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5006b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81aa expref: 80 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.479909:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb800, rc 0) 00000100:00100000:2.0:1786015332.480006:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+79:22506:x1872772280376576:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 9386us (9794us total) trans 4294967782 rc 301/301 00000100:00100000:2.0:1786015332.480026:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 742 00000100:00100000:0.0:1786015332.486167:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015332.486324:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280376960 00000100:00100000:3.0:1786015332.486347:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280376960 00000100:00100000:3.0:1786015332.486440:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 152 00000100:00100000:3.0:1786015332.486454:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+79:22506:x1872772280376960:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786015332.487214:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+80:22506:x1872772280376960:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 759us (1061us total) trans 4294967783 rc 0/0 00000100:00100000:3.0:1786015332.487226:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 152 00000100:00100000:3.0:1786015332.490619:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015332.491304:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280377088 00000100:00100000:1.0:1786015332.491323:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280377088 00000100:00100000:2.0:1786015332.491555:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 743 00000100:00100000:2.0:1786015332.491570:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+80:22506:x1872772280377088:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015332.491613:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015332.491653:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c5006cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e81b1 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.491800:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c5006cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81b1 expref: 81 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.491821:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906600/0xb1a5ef690c5006cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81b1 expref: 81 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.491847:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8b74938ba000) 00010000:00010000:2.0:1786015332.491851:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015332.491855:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906600, rc 0) 00000100:00100000:2.0:1786015332.491938:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+81:22506:x1872772280377088:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 372us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015332.491946:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 743 00000100:00100000:0.0:1786015332.494925:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015332.495396:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280377344 00000100:00100000:3.0:1786015332.495411:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280377344 00000100:00100000:3.0:1786015332.495506:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 744 00000100:00100000:3.0:1786015332.495520:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+81:22506:x1872772280377344:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1786015332.495631:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5006d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.495654:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5006d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.495671:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5006d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.496217:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5006d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.496355:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5006d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.496364:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5006d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.496371:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015332.496397:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5006d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.496406:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5006d4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.496426:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8b74938ba000) 00010000:00010000:3.0:1786015332.496429:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1786015332.496434:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5006d4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015332.496440:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c5006d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015332.496557:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+82:22506:x1872772280377344:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 1038us (1647us total) trans 4294967784 rc 0/0 00000100:00100000:3.0:1786015332.496567:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 744 00000100:00100000:0.0:1786015332.499318:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015332.499627:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280377600 00000100:00100000:2.0:1786015332.499643:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280377600 00000100:00100000:2.0:1786015332.499781:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 745 00000100:00100000:2.0:1786015332.499795:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+82:22506:x1872772280377600:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786015332.500401:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c5006db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.500446:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c5006db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015332.500461:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c5006db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786015332.500560:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967785 00000004:00010000:2.0:1786015332.500613:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cf146868 reply state 00000000c20193e6 transno 4294967786 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c5006db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015332.500624:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786015332.500882:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+85:22506:x1872772280377600:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 1086us (1577us total) trans 4294967786 rc 0/0 00000100:00100000:2.0:1786015332.500892:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 745 00000020:00080000:2.0:1786015332.500899:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786015332.504314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015332.504464:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280377856 00000100:00100000:2.0:1786015332.504479:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280377856 00000100:00100000:2.0:1786015332.504576:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 153 00000100:00100000:2.0:1786015332.504589:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+85:22506:x1872772280377856:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015332.504997:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+86:22506:x1872772280377856:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 409us (699us total) trans 4294967787 rc 0/0 00000100:00100000:2.0:1786015332.505007:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 153 00010000:00010000:0.0:1786015332.505122:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c5006db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015332.505145:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c5006db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015332.505155:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c5006db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015332.505162:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015332.505169:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c5006db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015332.505179:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c5006db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015332.505205:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8b74938ba000) 00010000:00010000:0.0:1786015332.505209:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786015332.505216:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c5006db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015332.505232:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907400/0xb1a5ef690c5006db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015332.524944:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304362240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015332.525077:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015332.526201:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304362240 00000100:00100000:2.0:1786015332.526229:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304362240 00000100:00100000:2.0:1786015332.526311:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1786015332.526325:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304362240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015332.526380:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015332.526503:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304362240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 182us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015332.526512:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1786015332.526799:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304362240:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1786015333.152721:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967777 is committed 00000001:00080000:3.0:1786015333.152757:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967781 is committed 00000001:00080000:3.0:1786015333.152824:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967787 is committed 00010000:00010000:1.0:1786015333.231496:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015334.261074:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015334.700173:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015334.700187:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015334.700584:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 17 count 1 00000040:00080000:3.0:1786015334.700593:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786015335.275935:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015335.489922:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015335.489986:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015335.490037:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015335.490077:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015335.490107:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015335.490131:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015335.490232:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015335.490278:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280378368 00000100:00100000:1.0:1786015335.490314:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280378368 00000100:00100000:1.0:1786015335.490398:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280378624 00000100:00100000:1.0:1786015335.490401:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280378624 00000100:00100000:1.0:1786015335.490427:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280378240 00000100:00100000:1.0:1786015335.490430:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280378240 00000100:00100000:1.0:1786015335.490446:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280378752 00000100:00100000:1.0:1786015335.490448:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280378752 00000100:00100000:1.0:1786015335.490469:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 300 00000100:00100000:1.0:1786015335.490481:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280378368:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015335.490595:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280378368:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 116us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015335.490604:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 300 00000100:00100000:1.0:1786015335.490626:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 301 00000100:00100000:1.0:1786015335.490634:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280378624:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015335.490663:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280378624:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015335.490670:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 301 00000100:00100000:1.0:1786015335.490684:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 302 00000100:00100000:1.0:1786015335.490690:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280378240:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015335.490717:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280378240:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015335.490724:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 302 00000100:00100000:1.0:1786015335.490737:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 303 00000100:00100000:1.0:1786015335.490744:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280378752:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015335.490837:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280378752:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 92us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015335.490853:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 303 00000100:00100000:1.0:1786015335.490883:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280377984 00000100:00100000:1.0:1786015335.490887:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280377984 00000100:00100000:1.0:1786015335.490919:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 458 00000100:00100000:1.0:1786015335.490925:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280377984:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015335.490955:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280377984:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015335.490960:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 458 00000100:00100000:1.0:1786015335.491003:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280378112 00000100:00100000:1.0:1786015335.491007:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280378112 00000100:00100000:1.0:1786015335.491050:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280378496 00000100:00100000:1.0:1786015335.491053:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280378496 00000100:00100000:1.0:1786015335.491077:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 340 00000100:00100000:1.0:1786015335.491083:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+74:2353:x1872772280378112:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015335.491121:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+74:2353:x1872772280378112:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015335.491128:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 340 00000100:00100000:1.0:1786015335.491141:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 341 00000100:00100000:1.0:1786015335.491147:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+31:2353:x1872772280378496:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015335.491173:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+31:2353:x1872772280378496:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015335.491179:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 341 00000100:00080000:1.0:1786015335.491203:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015335.491209:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015335.491211:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015335.596135:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304362368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015335.596267:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015335.596545:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304362368 00000100:00100000:1.0:1786015335.596556:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304362368 00000100:00100000:1.0:1786015335.596641:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1786015335.596653:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304362368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015335.596718:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015335.596819:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304362368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015335.596828:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1786015335.596992:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015335.598648:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304362368:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786015336.300363:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015337.135293:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304362624:0@lo:400:kworker.0 00000100:00100000:1.0:1786015337.135402:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015337.135480:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304363136:0@lo:400:kworker.0 00000100:00100000:1.0:1786015337.135515:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015337.135554:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015337.135561:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304362752:0@lo:400:kworker.0 00000100:00100000:1.0:1786015337.135585:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015337.135628:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304363136 00000100:00100000:1.0:1786015337.135637:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304363136 00000100:00100000:1.0:1786015337.135722:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1786015337.135733:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304363136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015337.136092:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304362496:0@lo:400:kworker.0 00000100:00100000:0.0:1786015337.136919:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304362624 00000100:00100000:0.0:1786015337.136930:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304362624 00000100:00100000:0.0:1786015337.136984:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304362752 00000100:00100000:0.0:1786015337.136988:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304362752 00000100:00100000:0.0:1786015337.137031:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1786015337.137041:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304362624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015337.144451:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015337.144555:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304363008:0@lo:400:kworker.0 00000100:00100000:2.0:1786015337.144645:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015337.149302:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786015337.149350:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304362880:0@lo:400:kworker.0 00000100:00100000:2.0:1786015337.149486:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015337.149608:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304363008 00000100:00100000:2.0:1786015337.149621:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304363008 00000100:00100000:2.0:1786015337.149692:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1786015337.149705:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304362752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015337.149814:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304362752:12345-0@lo:400:kworker.0 Request processed in 110us (14226us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015337.149824:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1786015337.152360:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1786015337.152392:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304363008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015337.152558:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304363008:12345-0@lo:400:kworker.0 Request processed in 181us (7910us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015337.152567:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00080000:2.0:1786015337.152605:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786015337.152613:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015337.152633:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304362496 00000100:00100000:2.0:1786015337.152643:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304362496 00000100:00100000:1.0:1786015337.153336:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304363136:12345-0@lo:400:kworker.0 Request processed in 17599us (17814us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015337.153350:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1786015337.153377:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304362880 00000100:00100000:1.0:1786015337.153382:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304362880 00000100:00100000:1.0:1786015337.153432:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1786015337.153439:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304362880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015337.153493:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304362880:12345-0@lo:400:kworker.0 Request processed in 55us (4008us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015337.153509:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00080000:1.0:1786015337.153541:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015337.153595:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304362752:0@lo:400:kworker.0 00000100:00100000:1.0:1786015337.153615:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304363136:0@lo:400:kworker.0 00000100:00100000:0.0:1786015337.154002:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304362624:12345-0@lo:400:kworker.0 Request processed in 16951us (18588us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015337.154013:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1786015337.155826:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1786015337.156008:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304362496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015337.156141:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304362496:12345-0@lo:400:kworker.0 Request processed in 162us (11703us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015337.156151:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1786015337.156283:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304362880:0@lo:400:kworker.0 00000100:00100000:2.0:1786015337.156301:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304362496:0@lo:400:kworker.0 00000100:00100000:2.0:1786015337.156318:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304363008:0@lo:400:kworker.0 00000100:00100000:1.0:1786015337.158415:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304362624:0@lo:400:kworker.0 00010000:00010000:1.0:1786015337.325445:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015337.651898:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304363264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015337.652014:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015337.652116:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304363264 00000100:00100000:0.0:1786015337.652126:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304363264 00000100:00100000:0.0:1786015337.652192:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1786015337.652202:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304363264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015337.652256:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015337.652311:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304363264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015337.652319:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1786015337.652379:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304363264:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786015338.350274:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015339.371944:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015340.399155:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015340.608215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015340.608287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015340.608324:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015340.608353:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015340.608375:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015340.608407:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015340.608459:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280379264 00000100:00100000:1.0:1786015340.608473:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280379264 00000100:00100000:1.0:1786015340.608544:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280379520 00000100:00100000:1.0:1786015340.608548:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280379520 00000100:00100000:1.0:1786015340.608574:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280379136 00000100:00100000:1.0:1786015340.608577:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280379136 00000100:00100000:1.0:1786015340.608599:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 306 00000100:00100000:1.0:1786015340.608611:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+10:2351:x1872772280379264:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015340.608715:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+10:2351:x1872772280379264:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 105us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015340.608724:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 306 00000100:00100000:1.0:1786015340.608748:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 307 00000100:00100000:1.0:1786015340.608755:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2351:x1872772280379520:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015340.608997:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280379008 00000100:00100000:2.0:1786015340.609003:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280379008 00000100:00100000:2.0:1786015340.609045:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280379392 00000100:00100000:2.0:1786015340.609049:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280379392 00000100:00100000:2.0:1786015340.609076:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 345 00000100:00100000:2.0:1786015340.609084:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+74:2351:x1872772280379008:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015340.609124:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+74:2351:x1872772280379008:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 42us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015340.609131:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 345 00000100:00100000:2.0:1786015340.609163:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 346 00000100:00100000:2.0:1786015340.609170:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+31:2352:x1872772280379392:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015340.609198:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+31:2352:x1872772280379392:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015340.609205:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 346 00000100:00100000:2.0:1786015340.609227:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 308 00000100:00100000:2.0:1786015340.609234:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+10:2352:x1872772280379136:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015340.609259:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+10:2352:x1872772280379136:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015340.609266:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 308 00000100:00080000:2.0:1786015340.609339:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786015340.609345:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015340.609347:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015340.609561:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2351:x1872772280379520:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 806us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015340.609568:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 307 00000100:00100000:0.0:1786015340.610265:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280378880 00000100:00100000:0.0:1786015340.610276:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280378880 00000100:00100000:0.0:1786015340.610318:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 460 00000100:00100000:0.0:1786015340.610327:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280378880:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015340.610382:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280378880:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 57us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015340.610390:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 460 00000100:00100000:1.0:1786015340.612247:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015340.612607:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280379648 00000100:00100000:2.0:1786015340.612623:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280379648 00000100:00100000:2.0:1786015340.612734:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 309 00000100:00100000:2.0:1786015340.612747:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280379648:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015340.612972:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280379648:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 216us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015340.612982:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 309 00000100:00080000:1.0:1786015340.614222:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015340.723370:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786015340.723446:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304363392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015340.723567:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015340.723690:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304363392 00000100:00100000:3.0:1786015340.723701:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304363392 00000100:00100000:3.0:1786015340.723800:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1786015340.723810:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304363392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015340.723866:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015340.723924:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304363392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015340.723933:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1786015340.724045:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304363392:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786015340.724465:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786015341.422003:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786015341.990615:0:17338:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffe2e6ef2c0 20000000:00000080:3.0:1786015341.990641:0:17338:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8b74b8bec000 uarg=0000000000000000 00000040:00100000:3.0:1786015341.992487:0:17338:0:(llog.c:1072:llog_reverse_process()) index 48 : idx 48 00000040:00100000:3.0:1786015341.992529:0:17338:0:(llog.c:1072:llog_reverse_process()) index 46 : idx 1 20000000:01000000:3.0:1786015341.992535:0:17338:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 46 cmd:0xce021 lustre.test_11c lustre-OST0001_UUID 20000000:01000000:3.0:1786015341.992558:0:17338:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.test_11c.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1786015341.994549:0:17339:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 45 marker 30 1->4: lustre-clilov add lustre.test_11c.lustre-OST0001_UUID 20000000:01000000:1.0:1786015341.995123:0:17339:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 48 marker 30 2->4: lustre-clilov add lustre.test_11c.lustre-OST0001_UUID 00000040:00080000:1.0:1786015341.995170:0:17339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 49 count 48 00000040:00080000:3.0:1786015341.996164:0:17338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16832 20000000:01000000:3.0:1786015341.996190:0:17338:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre test_11c lustre-OST0001_UUID (null) 00000040:00080000:3.0:1786015341.996258:0:17338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 136 off16968 00000040:00080000:3.0:1786015341.996302:0:17338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off17192 20000000:01000000:3.0:1786015341.996323:0:17338:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.test_11c.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1786015341.998571:0:17340:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 40 marker 31 1->4: lustre-MDT0000-mdtlov add lustre.test_11c.lustre-OST0001_UUID 20000000:01000000:1.0:1786015341.998743:0:17340:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 42 marker 31 2->4: lustre-MDT0000-mdtlov add lustre.test_11c.lustre-OST0001_UUID 00000040:00080000:1.0:1786015341.998817:0:17340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1786015341.999699:0:17338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15872 20000000:01000000:3.0:1786015341.999727:0:17338:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre test_11c lustre-OST0001_UUID (null) 00000040:00080000:3.0:1786015341.999829:0:17338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 144 off16016 00000040:00080000:3.0:1786015341.999871:0:17338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off16240 10000000:01000000:3.0:1786015341.999889:0:17338:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1786015341.999917:0:17338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015341.999959:0:17338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c5005a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500599 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015341.999969:0:17338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b73813bfc00/0xb1a5ef690c5005ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c5005a7 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015341.999977:0:17338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7480031200/0xb1a5ef690c5005bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c5005b5 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015341.999984:0:17338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5005ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c5005c3 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015341.999991:0:17338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c5005d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c5005d1 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015341.999998:0:17338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b73813be200/0xb1a5ef690c5005e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c5005df expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.000005:0:17338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b74c2178000/0xb1a5ef690c5005f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c5005ed expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.000016:0:17338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b73813bf200/0xb1a5ef690c5005fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8164 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.000024:0:17338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b73819ba200/0xb1a5ef690c500602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e816b expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.000032:0:17338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b73819bb200/0xb1a5ef690c500609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8172 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.000375:0:17338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e2 lrc: 13/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.000431:0:17338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b73819bb200/0xb1a5ef690c500609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8172 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.000449:0:17338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b73819bb200/0xb1a5ef690c500609 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8172 expref: 12 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015342.000469:0:17338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304363520:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015342.000699:0:17338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b73819ba200/0xb1a5ef690c500602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e816b expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.000709:0:17338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b73819ba200/0xb1a5ef690c500602 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e816b expref: 12 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015342.000719:0:17338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304363648:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015342.000753:0:17338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b73813bf200/0xb1a5ef690c5005fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8164 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.000914:0:17338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b73813bf200/0xb1a5ef690c5005fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8164 expref: 12 pid: 5787 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015342.000925:0:17338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304363776:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015342.000992:0:17338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b74c2178000/0xb1a5ef690c5005f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c5005ed expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.001002:0:17338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b74c2178000/0xb1a5ef690c5005f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c5005ed expref: 18 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015342.001020:0:17338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304363904:0@lo:104: 00000100:00100000:3.0:1786015342.001156:0:17338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786015342.001541:0:17338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b73813be200/0xb1a5ef690c5005e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c5005df expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.001551:0:17338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b73813be200/0xb1a5ef690c5005e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c5005df expref: 18 pid: 5787 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015342.001577:0:17338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f18000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304364032:0@lo:104: 00000100:00100000:3.0:1786015342.001605:0:17338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015342.006087:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015342.006357:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280379776 00000100:00100000:2.0:1786015342.006371:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280379776 00010000:00010000:2.0:1786015342.006429:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b73819bb200/0xb1a5ef690c500609 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8172 expref: 13 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015342.006480:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 224 00000100:00100000:2.0:1786015342.006515:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280379776:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015342.006538:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015342.006546:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b73819bb200/0xb1a5ef690c500609 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8172 expref: 13 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.006561:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b73819bb200/0xb1a5ef690c500609 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8172 expref: 13 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.006595:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015342.007740:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280379776:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1219us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015342.007755:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 224 00000100:00100000:1.0:1786015342.008717:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015342.008809:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015342.008859:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280380032 00000100:00100000:1.0:1786015342.008871:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280380032 00010000:00010000:1.0:1786015342.008920:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b73813bf200/0xb1a5ef690c5005fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8164 expref: 13 pid: 5787 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015342.009449:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280379904 00000100:00100000:1.0:1786015342.009456:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280379904 00010000:00010000:1.0:1786015342.009482:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b73819ba200/0xb1a5ef690c500602 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e816b expref: 14 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015342.009504:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 225 00000100:00100000:1.0:1786015342.009514:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+14:2353:x1872772280380032:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015342.009552:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015342.009559:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b73813bf200/0xb1a5ef690c5005fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8164 expref: 14 pid: 5787 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015342.009572:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b73813bf200/0xb1a5ef690c5005fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8164 expref: 14 pid: 5787 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015342.009600:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015342.009675:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+14:2353:x1872772280380032:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 162us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015342.009683:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 225 00000100:00100000:1.0:1786015342.009706:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 226 00000100:00100000:1.0:1786015342.009712:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280379904:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015342.009719:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015342.009723:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b73819ba200/0xb1a5ef690c500602 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e816b expref: 13 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015342.009734:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b73819ba200/0xb1a5ef690c500602 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e816b expref: 13 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015342.009745:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015342.009795:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280379904:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 83us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015342.009801:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 226 00000100:00100000:0.0:1786015342.013622:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304363904 00000100:00100000:0.0:1786015342.013638:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304363904 00010000:00010000:3.0:1786015342.013721:0:17338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c5005d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c5005d1 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.013755:0:17338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c5005d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c5005d1 expref: 18 pid: 5790 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015342.013802:0:17338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f1b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304364160:0@lo:104: 00000100:00100000:3.0:1786015342.013881:0:17338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786015342.013924:0:17338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5005ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c5005c3 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.013934:0:17338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5005ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c5005c3 expref: 18 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015342.013942:0:17338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738374bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304364288:0@lo:104: 00000100:00100000:3.0:1786015342.013975:0:17338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786015342.013994:0:17338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7480031200/0xb1a5ef690c5005bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c5005b5 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.014029:0:17338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b7480031200/0xb1a5ef690c5005bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c5005b5 expref: 18 pid: 5787 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015342.014050:0:17338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304364416:0@lo:104: 00000100:00100000:3.0:1786015342.014078:0:17338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786015342.014099:0:17338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b73813bfc00/0xb1a5ef690c5005ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c5005a7 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.014107:0:17338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b73813bfc00/0xb1a5ef690c5005ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c5005a7 expref: 18 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015342.014588:0:17338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304364544:0@lo:104: 00000100:00100000:3.0:1786015342.014618:0:17338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786015342.014652:0:17338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c5005a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c500599 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.014662:0:17338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c5005a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c500599 expref: 18 pid: 5790 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015342.014671:0:17338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304364672:0@lo:104: 00000100:00100000:3.0:1786015342.014696:0:17338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015342.014707:0:17338:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174840 going to sleep for 10 seconds 00010000:00010000:3.0:1786015342.014740:0:17338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b73819bb200/0xb1a5ef690c500609 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8172 expref: 12 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015342.014756:0:17338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304363520:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015342.014809:0:17338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b73819ba200/0xb1a5ef690c500602 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e816b expref: 11 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015342.014833:0:17338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304363648:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015342.014846:0:17338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b73813bf200/0xb1a5ef690c5005fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8164 expref: 10 pid: 5787 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015342.014854:0:17338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304363776:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015342.015825:0:5779:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1786015342.015856:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304364032 00000100:00100000:0.0:1786015342.015864:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304364032 00000100:00100000:0.0:1786015342.015925:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304364160 00000100:00100000:0.0:1786015342.015928:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304364160 00000100:00100000:0.0:1786015342.015939:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304364288 00000100:00100000:0.0:1786015342.015942:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304364288 00000100:00100000:0.0:1786015342.015967:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304364416 00000100:00100000:0.0:1786015342.015970:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304364416 00000100:00100000:0.0:1786015342.015981:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304364544 00000100:00100000:0.0:1786015342.015983:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304364544 00000100:00100000:0.0:1786015342.015993:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304364672 00000100:00100000:0.0:1786015342.015995:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304364672 00000100:00100000:0.0:1786015342.016012:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1786015342.016024:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+9:17338:x1872772304364032:12345-0@lo:104: 00010000:00010000:0.0:1786015342.016056:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b74c2178a00/0xb1a5ef690c5005df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c5005e6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015342.016416:0:17338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f18000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304364032:0@lo:104: 00010000:00010000:0.0:1786015342.016458:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786015342.016465:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+9:17338:x1872772304364032:12345-0@lo:104: Request processed in 445us (14859us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015342.016473:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1786015342.016497:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1786015342.016504:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+8:17338:x1872772304364160:12345-0@lo:104: 00010000:00010000:0.0:1786015342.016514:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c5005d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c5005d8 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015342.016589:0:17338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f1b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304364160:0@lo:104: 00010000:00010000:2.0:1786015342.018246:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786015342.018267:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b74c2178a00/0xb1a5ef690c5005df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c5005e6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.018281:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178a00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1786015342.018286:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b74c2178a00/0xb1a5ef690c5005df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c5005e6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.018298:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b74c2178a00/0xb1a5ef690c5005df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c5005e6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786015342.018306:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b74c2178a00/0xb1a5ef690c5005df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c5005e6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786015342.018313:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786015342.018373:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b74c2178a00/0xb1a5ef690c5005df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005e6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.018403:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786015342.018440:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b74c2178a00/0xb1a5ef690c5005df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005e6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.018447:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b74c2178a00/0xb1a5ef690c5005df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005e6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.018463:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786015342.018466:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c5005d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c5005d8 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.018472:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907200 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1786015342.018475:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c5005d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c5005d8 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.018482:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c5005d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c5005d8 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786015342.018488:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c5005d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c5005d8 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786015342.018493:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786015342.018510:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c5005d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005d8 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.018516:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786015342.018531:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c5005d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005d8 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.018537:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b7383907200/0xb1a5ef690c5005d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005d8 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.018554:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015342.018557:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015342.018608:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304364800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015342.018715:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786015342.019204:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015342.019280:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1786015342.019294:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+8:17338:x1872772304364160:12345-0@lo:104: Request processed in 2786us (5410us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015342.019307:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1786015342.019317:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015342.019352:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1786015342.019367:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+7:17338:x1872772304364288:12345-0@lo:104: 00010000:00010000:0.0:1786015342.019393:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c5005c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c5005ca expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015342.019479:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786015342.019485:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+7:17338:x1872772304364288:12345-0@lo:104: Request processed in 126us (5510us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015342.019492:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1786015342.019508:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1786015342.019514:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+6:17338:x1872772304364416:12345-0@lo:104: 00010000:00010000:0.0:1786015342.019522:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b74c2178c00/0xb1a5ef690c5005b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c5005bc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015342.019555:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1786015342.019824:0:17338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738374bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304364288:0@lo:104: 00000100:00100000:3.0:1786015342.019837:0:17338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304364416:0@lo:104: 00000100:00100000:0.0:1786015342.020829:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+6:17338:x1872772304364416:12345-0@lo:104: Request processed in 47us (5482us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015342.020844:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1786015342.020884:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1786015342.020899:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+5:17338:x1872772304364544:12345-0@lo:104: 00010000:00010000:0.0:1786015342.020917:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b74c2179200/0xb1a5ef690c5005a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c5005ae expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015342.021024:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1786015342.021040:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+5:17338:x1872772304364544:12345-0@lo:104: Request processed in 140us (6411us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015342.021047:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1786015342.021060:0:17338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304364544:0@lo:104: 00000100:00100000:0.0:1786015342.021060:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1786015342.021067:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+4:17338:x1872772304364672:12345-0@lo:104: 00010000:00010000:0.0:1786015342.021092:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b7383907e00/0xb1a5ef690c500599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c5005a0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015342.021460:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304364800 00000100:00100000:1.0:1786015342.021469:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304364800 00010000:00010000:1.0:1786015342.021505:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b73813be200/0xb1a5ef690c5005e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c5005df expref: 19 pid: 5787 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015342.021594:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1786015342.021603:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74865a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304364800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786015342.021628:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015342.021636:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b73813be200/0xb1a5ef690c5005e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c5005df expref: 19 pid: 5787 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015342.021646:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b73813be200/0xb1a5ef690c5005e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c5005df expref: 19 pid: 5787 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015342.021666:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b73813be200/0xb1a5ef690c5005e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c5005df expref: 19 pid: 5787 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015342.021686:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015342.021746:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74865a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:3313:x1872772304364800:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (3031us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015342.021752:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00010000:00010000:2.0:1786015342.021895:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786015342.021904:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c5005c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c5005ca expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.021913:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178600 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1786015342.021918:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c5005c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c5005ca expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.021927:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c5005c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c5005ca expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786015342.021934:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c5005c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c5005ca expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786015342.021940:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786015342.021993:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c5005c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005ca expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.021999:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786015342.022014:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c5005c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005ca expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.022021:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b74c2178600/0xb1a5ef690c5005c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005ca expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.022046:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786015342.022057:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b74c2178c00/0xb1a5ef690c5005b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c5005bc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.022063:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178c00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1786015342.022067:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b74c2178c00/0xb1a5ef690c5005b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c5005bc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.022074:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b74c2178c00/0xb1a5ef690c5005b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c5005bc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786015342.022081:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b74c2178c00/0xb1a5ef690c5005b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c5005bc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786015342.022086:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786015342.022101:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b74c2178c00/0xb1a5ef690c5005b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005bc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.022107:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786015342.022130:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b74c2178c00/0xb1a5ef690c5005b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005bc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.022138:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b74c2178c00/0xb1a5ef690c5005b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005bc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.022149:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786015342.022152:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b74c2179200/0xb1a5ef690c5005a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c5005ae expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.022159:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2179200 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1786015342.022162:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b74c2179200/0xb1a5ef690c5005a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c5005ae expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.022180:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b74c2179200/0xb1a5ef690c5005a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c5005ae expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786015342.022187:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b74c2179200/0xb1a5ef690c5005a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c5005ae expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786015342.022193:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786015342.022206:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b74c2179200/0xb1a5ef690c5005a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005ae expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.022211:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786015342.022216:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b74c2179200/0xb1a5ef690c5005a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005ae expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.022223:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b74c2179200/0xb1a5ef690c5005a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005ae expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.022233:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015342.022235:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015342.022237:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015342.022255:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304365184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786015342.022295:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786015342.022431:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786015342.022439:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+4:17338:x1872772304364672:12345-0@lo:104: Request processed in 1372us (7741us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015342.022447:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1786015342.022488:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304364928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786015342.022517:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304365056:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786015342.022536:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786015342.022542:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b7383907e00/0xb1a5ef690c500599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c5005a0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015342.022550:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:0.0:1786015342.022554:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b7383907e00/0xb1a5ef690c500599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c5005a0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015342.022562:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b7383907e00/0xb1a5ef690c500599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c5005a0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786015342.022569:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b7383907e00/0xb1a5ef690c500599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c5005a0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786015342.022574:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1786015342.022593:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b7383907e00/0xb1a5ef690c500599 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005a0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015342.022600:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786015342.022616:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b7383907e00/0xb1a5ef690c500599 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005a0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015342.022624:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b7383907e00/0xb1a5ef690c500599 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005a0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015342.022634:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015342.022636:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015342.022638:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015342.022644:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015342.022656:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015342.023859:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1786015342.023870:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+3:17338:x1872772304363904:12345-0@lo:104: 00010000:00010000:0.0:1786015342.023886:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b73813be000/0xb1a5ef690c5005ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c5005f4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015342.023978:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786015342.023985:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+3:17338:x1872772304363904:12345-0@lo:104: Request processed in 117us (22830us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015342.023992:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1786015342.032451:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786015342.032482:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304365312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786015342.032587:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015342.032634:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304365184 00000100:00100000:3.0:1786015342.032649:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304365184 00010000:00010000:3.0:1786015342.032709:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7480031200/0xb1a5ef690c5005bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c5005b5 expref: 18 pid: 5787 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015342.033052:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1786015342.033068:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:3312:x1872772304365184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786015342.033088:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015342.033096:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7480031200/0xb1a5ef690c5005bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c5005b5 expref: 18 pid: 5787 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015342.033111:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7480031200/0xb1a5ef690c5005bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c5005b5 expref: 18 pid: 5787 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015342.035734:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7480031200/0xb1a5ef690c5005bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c5005b5 expref: 18 pid: 5787 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015342.035803:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015342.035917:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:3312:x1872772304365184:12345-0@lo:103:ldlm_bl.0 Request processed in 2852us (13619us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015342.035930:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1786015342.038253:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304364800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015342.038566:0:17338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304363904:0@lo:104: 00000100:00100000:3.0:1786015342.038580:0:17338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17338:1872772304364672:0@lo:104: 00010000:00010000:3.0:1786015342.038656:0:17338:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.038892:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786015342.038900:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b73813be000/0xb1a5ef690c5005ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c5005f4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.038956:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813be000 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:3.0:1786015342.038961:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b73813be000/0xb1a5ef690c5005ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c5005f4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.038973:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b73813be000/0xb1a5ef690c5005ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c5005f4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786015342.038980:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b73813be000/0xb1a5ef690c5005ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c5005f4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786015342.038987:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786015342.039050:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b73813be000/0xb1a5ef690c5005ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005f4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.039057:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786015342.039090:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b73813be000/0xb1a5ef690c5005ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005f4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.039097:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b73813be000/0xb1a5ef690c5005ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c5005f4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.039120:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015342.039123:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015342.039384:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015342.047030:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015342.047276:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304365312 00000100:00100000:0.0:1786015342.047290:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304365312 00000100:00100000:1.0:1786015342.047318:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304364928 00000100:00100000:1.0:1786015342.047323:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304364928 00010000:00010000:1.0:1786015342.047348:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c5005d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c5005d1 expref: 18 pid: 5790 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015342.047348:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b73813bfc00/0xb1a5ef690c5005ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c5005a7 expref: 18 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015342.047387:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304365440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786015342.047472:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015342.047526:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786015342.047533:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304365568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786015342.047555:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015342.047582:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015342.047606:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304365440 00000100:00100000:2.0:1786015342.047609:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304365440 00010000:00010000:2.0:1786015342.047625:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c5005a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c500599 expref: 19 pid: 5790 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015342.047708:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304365568 00000100:00100000:3.0:1786015342.047713:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304365568 00010000:00010000:3.0:1786015342.047735:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b74c2178000/0xb1a5ef690c5005f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c5005ed expref: 20 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015342.049929:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304365056 00000100:00100000:1.0:1786015342.049930:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1786015342.049942:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304365056 00010000:00010000:0.0:1786015342.050001:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5005ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c5005c3 expref: 21 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015342.050049:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+21:3314:x1872772304364928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786015342.050070:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015342.050078:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c5005d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c5005d1 expref: 21 pid: 5790 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015342.050117:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c5005d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c5005d1 expref: 21 pid: 5790 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015342.050313:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b74c2179600/0xb1a5ef690c5005d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c5005d1 expref: 21 pid: 5790 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015342.050341:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015342.050816:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+20:3314:x1872772304364928:12345-0@lo:103:ldlm_bl.0 Request processed in 770us (3798us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015342.050827:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1786015342.050991:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1786015342.051002:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304365312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786015342.051014:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015342.051021:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b73813bfc00/0xb1a5ef690c5005ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c5005a7 expref: 19 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015342.051032:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b73813bfc00/0xb1a5ef690c5005ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c5005a7 expref: 19 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015342.051064:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1786015342.051074:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304365056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786015342.051083:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015342.051088:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5005ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c5005c3 expref: 19 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015342.051210:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5005ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c5005c3 expref: 19 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015342.051259:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1786015342.051271:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304365440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786015342.051282:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015342.051288:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c5005a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c500599 expref: 19 pid: 5790 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015342.051305:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5005ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c5005c3 expref: 19 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015342.051320:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015342.051364:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:3315:x1872772304365056:12345-0@lo:103:ldlm_bl.0 Request processed in 293us (3781us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015342.051371:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1786015342.051538:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1786015342.051564:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:3314:x1872772304365568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786015342.051574:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015342.051579:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b74c2178000/0xb1a5ef690c5005f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c5005ed expref: 17 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.051591:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b74c2178000/0xb1a5ef690c5005f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c5005ed expref: 17 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.051602:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b74c2178000/0xb1a5ef690c5005f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c5005ed expref: 17 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.051685:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015342.051727:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:3314:x1872772304365568:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (4170us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015342.051733:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1786015342.053453:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304365568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015342.053474:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304364928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015342.053546:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304365184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786015342.054520:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b73813bfc00/0xb1a5ef690c5005ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c5005a7 expref: 15 pid: 5789 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015342.054544:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015342.054855:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:3312:x1872772304365312:12345-0@lo:103:ldlm_bl.0 Request processed in 3843us (22255us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015342.054896:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1786015342.055213:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304365312:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786015342.055224:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c5005a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c500599 expref: 13 pid: 5790 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.055246:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c5005a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c500599 expref: 13 pid: 5790 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.055265:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.055277:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.055302:0:17038:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.055310:0:17038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.055327:0:17038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.055334:0:17038:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.055341:0:17038:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb800 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015342.055345:0:17038:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.055354:0:17038:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.055376:0:17038:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015342.055390:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015342.055423:0:17338:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.055433:0:17338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015342.055440:0:17338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015342.055443:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+12:3314:x1872772304365440:12345-0@lo:103:ldlm_bl.0 Request processed in 4176us (7970us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015342.055451:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1786015342.055486:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304365056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786015342.056365:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304365440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786015342.252295:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786015342.254824:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304365824:0@lo:400:kworker.0 00000100:00100000:0.0:1786015342.254963:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015342.255138:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304365696:0@lo:400:kworker.0 00000100:00100000:0.0:1786015342.255167:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015342.255365:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304365952:0@lo:400:kworker.0 00000100:00100000:1.0:1786015342.255405:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015342.255438:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015342.255444:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304366080:0@lo:400:kworker.0 00000100:00100000:1.0:1786015342.255484:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304366208:0@lo:400:kworker.0 00000100:00100000:1.0:1786015342.255512:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015342.255571:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304365952 00000100:00100000:1.0:1786015342.255582:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304365952 00000100:00100000:1.0:1786015342.255664:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304366208 00000100:00100000:1.0:1786015342.255668:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304366208 00000100:00100000:1.0:1786015342.255702:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1786015342.255712:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304365952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015342.255804:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304365952:12345-0@lo:400:kworker.0 Request processed in 93us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015342.255814:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1786015342.255837:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1786015342.255844:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304366208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015342.255879:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304366208:12345-0@lo:400:kworker.0 Request processed in 36us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015342.255885:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:1.0:1786015342.255903:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015342.255908:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015342.255964:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304366208:0@lo:400:kworker.0 00000100:00100000:2.0:1786015342.263361:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304365824 00000100:00100000:2.0:1786015342.263388:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304365824 00000100:00080000:0.0:1786015342.263503:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015342.263909:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015342.267710:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304365952:0@lo:400:kworker.0 00000100:00100000:3.0:1786015342.273897:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304365696 00000100:00100000:3.0:1786015342.273925:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304365696 00000100:00100000:3.0:1786015342.274083:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304366080 00000100:00100000:3.0:1786015342.274088:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304366080 00000100:00100000:3.0:1786015342.274147:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1786015342.274162:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304365824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015342.274568:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304365824:12345-0@lo:400:kworker.0 Request processed in 409us (19604us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015342.274579:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1786015342.274619:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1786015342.274627:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304365696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015342.274665:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304365696:12345-0@lo:400:kworker.0 Request processed in 40us (19497us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015342.274671:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1786015342.274684:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1786015342.274689:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304366080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015342.274730:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304366080:12345-0@lo:400:kworker.0 Request processed in 41us (10827us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015342.274736:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1786015342.275059:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304366080:0@lo:400:kworker.0 00000100:00100000:3.0:1786015342.275119:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304365824:0@lo:400:kworker.0 00000100:00100000:3.0:1786015342.275133:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304365696:0@lo:400:kworker.0 00000100:00080000:0.0:1786015342.279707:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786015342.447103:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015342.768415:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304366336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015342.768516:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015342.769927:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304366336 00000100:00100000:2.0:1786015342.769962:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304366336 00000100:00100000:2.0:1786015342.770035:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1786015342.770046:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304366336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015342.770097:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015342.770223:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304366336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015342.770232:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1786015342.770708:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304366336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015343.303459:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015343.309905:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280380160 00000100:00100000:3.0:1786015343.309958:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280380160 00000100:00100000:3.0:1786015343.310060:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 461 00000100:00100000:3.0:1786015343.310072:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+10:5571:x1872772280380160:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015343.310094:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015343.310119:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e81b8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015343.310159:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81b8 expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015343.310170:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81b8 expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015343.310179:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb800, rc 0) 00000100:00100000:3.0:1786015343.310256:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280380160:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 187us (6814us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015343.310264:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 461 00000100:00100000:2.0:1786015343.335108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015343.335319:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280380288 00000100:00100000:3.0:1786015343.335340:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280380288 00000100:00100000:3.0:1786015343.335443:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 462 00000100:00100000:3.0:1786015343.335455:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280380288:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015343.336004:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280380288:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 549us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015343.336013:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 462 00000100:00100000:3.0:1786015343.349086:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015343.349259:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280380416 00000100:00100000:0.0:1786015343.349283:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280380416 00000100:00100000:0.0:1786015343.349404:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 463 00000100:00100000:0.0:1786015343.349417:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280380416:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015343.349822:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280380416:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 405us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015343.349837:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 463 00000100:00100000:1.0:1786015343.362662:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015343.362726:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280380544 00000100:00100000:1.0:1786015343.362740:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280380544 00000100:00100000:1.0:1786015343.363049:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 464 00000100:00100000:1.0:1786015343.363064:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74864ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:22970:x1872772280380544:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786015343.363420:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74864ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:22970:x1872772280380544:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 359us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015343.363430:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 464 00000100:00100000:2.0:1786015343.371839:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015343.371894:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280380672 00000100:00100000:2.0:1786015343.371921:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280380672 00000100:00100000:2.0:1786015343.372004:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 465 00000100:00100000:2.0:1786015343.372019:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74864ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:22970:x1872772280380672:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786015343.372415:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74864ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:22970:x1872772280380672:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 398us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015343.372426:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 465 00000100:00100000:2.0:1786015343.376430:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015343.376504:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280380800 00000100:00100000:2.0:1786015343.376520:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280380800 00000100:00100000:2.0:1786015343.376590:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 466 00000100:00100000:2.0:1786015343.376677:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280380800:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786015343.376815:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015343.376845:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7383906400/0xb1a5ef690c5006f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e81bf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.376889:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7383906400/0xb1a5ef690c5006f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81bf expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.376903:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7383906400/0xb1a5ef690c5006f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81bf expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.377409:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906400, rc 0) 00000100:00100000:2.0:1786015343.377512:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280380800:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 910us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015343.385037:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015343.385858:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280380928 00000100:00100000:1.0:1786015343.385877:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280380928 00000100:00100000:1.0:1786015343.386053:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 467 00000100:00100000:1.0:1786015343.386070:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:5571:x1872772280380928:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786015343.386507:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:5571:x1872772280380928:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 441us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015343.386518:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 467 00000100:00100000:2.0:1786015343.386694:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 466 00000100:00100000:3.0:1786015343.392221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015343.392469:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280381056 00000100:00100000:1.0:1786015343.392492:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280381056 00000100:00100000:1.0:1786015343.392587:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 468 00000100:00100000:1.0:1786015343.392599:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280381056:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786015343.393255:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280381056:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 654us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015343.393265:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 468 00000100:00100000:3.0:1786015343.397821:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015343.398505:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280381184 00000100:00100000:2.0:1786015343.398527:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280381184 00000100:00100000:2.0:1786015343.398620:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 469 00000100:00100000:2.0:1786015343.398633:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:22971:x1872772280381184:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786015343.399130:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:22971:x1872772280381184:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 497us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015343.399138:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 469 00000100:00100000:3.0:1786015343.405153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015343.405408:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280381312 00000100:00100000:0.0:1786015343.405420:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280381312 00000100:00100000:0.0:1786015343.405493:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 470 00000100:00100000:0.0:1786015343.405506:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:22971:x1872772280381312:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786015343.405858:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:22971:x1872772280381312:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 353us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015343.405867:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 470 00000100:00100000:3.0:1786015343.410149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015343.410611:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280381440 00000100:00100000:1.0:1786015343.410652:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280381440 00000100:00100000:1.0:1786015343.410838:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 471 00000100:00100000:1.0:1786015343.410851:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280381440:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786015343.410876:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015343.410904:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5006f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e81c6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015343.411251:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5006f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81c6 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015343.411267:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5006f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81c6 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015343.411278:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf600, rc 0) 00000100:00100000:0.0:1786015343.411446:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:5571:x1872772280381440:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 590us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015343.411474:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 471 00000100:00100000:3.0:1786015343.418288:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015343.418406:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280381568 00000100:00100000:2.0:1786015343.418416:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280381568 00000100:00100000:2.0:1786015343.418475:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 472 00000100:00100000:2.0:1786015343.418485:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:5571:x1872772280381568:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015343.418831:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:5571:x1872772280381568:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 346us (552us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786015343.418840:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 472 00010000:00010000:0.0:1786015343.468196:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1786015343.597574:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1786015343.597583:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b74bf8dd800 from 49 10000000:01000000:0.0:1786015343.597589:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1786015343.597641:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7480031200/0xb1a5ef690c5006fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015343.597655:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b7480031200/0xb1a5ef690c5006fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015343.597666:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b7480031200/0xb1a5ef690c5006fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015343.597707:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304366464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786015343.597816:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015343.597883:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0312f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786015343.598035:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304366464 00000100:00100000:2.0:1786015343.598045:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304366464 00000100:00100000:2.0:1786015343.598125:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1786015343.598137:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+12:5792:x1872772304366464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786015343.598153:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015343.598171:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7383907200/0xb1a5ef690c500705 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c5006fe expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.598215:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7383907200/0xb1a5ef690c500705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c5006fe expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.598226:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7383907200/0xb1a5ef690c500705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c5006fe expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.598238:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907200, rc 0) 00000100:00100000:2.0:1786015343.598295:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304366464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015343.598303:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:0.0:1786015343.598561:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304366464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786015343.598577:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b7480031200/0xb1a5ef690c5006fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500705 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015343.598587:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b7480031200/0xb1a5ef690c5006fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c500705 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015343.598662:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304366592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015343.598702:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015343.598727:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0312f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015343.598818:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304366592 00000100:00100000:1.0:1786015343.599300:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304366592 00000100:00100000:1.0:1786015343.599459:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1786015343.599471:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304366592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786015343.600077:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304366592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 605us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015343.600088:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1786015343.600257:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304366592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015343.600350:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304366720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015343.600430:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015343.606176:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0312f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786015343.606202:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304366720 00000100:00100000:2.0:1786015343.606226:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304366720 00000100:00100000:2.0:1786015343.606321:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1786015343.606334:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304366720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786015343.606757:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304366720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 424us (6324us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015343.606790:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:0.0:1786015343.608236:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304366720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015343.608655:0:17343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17343:1872772304366848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015343.608742:0:17343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015343.608809:0:17343:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0312f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786015343.609453:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304366848 00000100:00100000:2.0:1786015343.609463:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304366848 00000100:00100000:2.0:1786015343.609506:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1786015343.609516:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:17343:x1872772304366848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015343.610245:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:17343:x1872772304366848:12345-0@lo:502:llog_process_th.0 Request processed in 725us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015343.610256:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1786015343.610503:0:17343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17343:1872772304366848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015343.610571:0:17343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17343:1872772304366976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015343.610733:0:17343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015343.610792:0:17343:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748628a540 going to sleep for 11 seconds 00000100:00100000:2.0:1786015343.610986:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304366976 00000100:00100000:2.0:1786015343.610993:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304366976 00000100:00100000:2.0:1786015343.611177:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1786015343.611189:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:17343:x1872772304366976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015343.611401:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:17343:x1872772304366976:12345-0@lo:502:llog_process_th.0 Request processed in 216us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015343.611408:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:0.0:1786015343.613292:0:17343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17343:1872772304366976:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1786015343.613365:0:17343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1786015343.613798:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 49-51 (rc=0) 10000000:01000000:1.0:1786015343.614182:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786015343.614200:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7480031200/0xb1a5ef690c5006fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500705 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015343.614216:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b7480031200/0xb1a5ef690c5006fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500705 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786015343.614253:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1786015343.614256:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1786015343.614258:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1786015343.614311:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c50070c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015343.614320:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c50070c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015343.614331:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c50070c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015343.614364:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304367104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786015343.614459:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015343.614526:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06540 going to sleep for 11 seconds 00000100:00100000:2.0:1786015343.618561:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304367104 00000100:00100000:2.0:1786015343.618586:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304367104 00000100:00100000:2.0:1786015343.619014:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1786015343.619374:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304367104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786015343.619401:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015343.619430:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500713 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c50070c expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.619474:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c50070c expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.619488:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c50070c expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.619501:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907e00, rc 0) 00000100:00100000:2.0:1786015343.620292:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304367104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 921us (5828us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015343.620302:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1786015343.620450:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304367104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786015343.620478:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c50070c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500713 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015343.620490:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c50070c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c500713 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015343.621181:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304367232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786015343.621271:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015343.621382:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06540 going to sleep for 11 seconds 00000100:00100000:3.0:1786015343.621440:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304367232 00000100:00100000:3.0:1786015343.621449:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304367232 00000100:00100000:3.0:1786015343.621542:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1786015343.621554:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304367232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015343.623383:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304367232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1819us (2101us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015343.623403:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:1.0:1786015343.623516:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304367232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786015343.623590:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304367360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786015343.624220:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015343.624278:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06540 going to sleep for 11 seconds 00000100:00100000:0.0:1786015343.624387:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304367360 00000100:00100000:0.0:1786015343.624398:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304367360 00000100:00100000:0.0:1786015343.624462:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:0.0:1786015343.624473:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304367360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015343.625552:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304367360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1073us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015343.625565:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:1.0:1786015343.626008:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304367360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786015343.634571:0:17344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:1.0:1786015343.635587:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1786015343.636005:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1786015343.636095:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c50070c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500713 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015343.636176:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c50070c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500713 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786015343.636192:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786015343.636196:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b74aaa08000 from 49 10000000:01000000:1.0:1786015343.636199:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786015343.636265:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73813bec00/0xb1a5ef690c50071a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015343.636274:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b73813bec00/0xb1a5ef690c50071a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015343.636288:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b73813bec00/0xb1a5ef690c50071a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015343.636324:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304367488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786015343.636434:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015343.636545:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06540 going to sleep for 11 seconds 00000100:00100000:3.0:1786015343.636749:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304367488 00000100:00100000:3.0:1786015343.637102:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304367488 00000100:00100000:2.0:1786015343.637380:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1786015343.637394:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304367488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786015343.637416:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015343.637438:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7383907600/0xb1a5ef690c500721 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c50071a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.637495:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7383907600/0xb1a5ef690c500721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c50071a expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.637509:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7383907600/0xb1a5ef690c500721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c50071a expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.637520:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907600, rc 0) 00000100:00100000:2.0:1786015343.637616:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304367488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015343.637624:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:0.0:1786015343.637727:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304367488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786015343.637752:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b73813bec00/0xb1a5ef690c50071a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500721 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015343.637808:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b73813bec00/0xb1a5ef690c50071a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c500721 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015343.637918:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304367616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015343.637964:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015343.639725:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce0900 going to sleep for 11 seconds 00000100:00100000:1.0:1786015343.640249:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304367616 00000100:00100000:1.0:1786015343.640264:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304367616 00000100:00100000:1.0:1786015343.640341:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1786015343.640370:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304367616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786015343.642444:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304367616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2064us (4466us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015343.642461:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:0.0:1786015343.642850:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304367616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015343.643088:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304367744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015343.643300:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015343.643343:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce0900 going to sleep for 11 seconds 00000100:00100000:2.0:1786015343.644328:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304367744 00000100:00100000:2.0:1786015343.644343:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304367744 00000100:00100000:2.0:1786015343.644412:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1786015343.644422:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304367744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786015343.646489:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304367744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2055us (3178us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015343.646507:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1786015343.647208:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304367744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786015343.654201:0:17345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17345:1872772304367872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015343.655248:0:17345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015343.655376:0:17345:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486543180 going to sleep for 11 seconds 00000100:00100000:1.0:1786015343.655441:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304367872 00000100:00100000:1.0:1786015343.655453:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304367872 00000100:00100000:2.0:1786015343.655643:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1786015343.655656:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:17345:x1872772304367872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015343.656095:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:17345:x1872772304367872:12345-0@lo:502:llog_process_th.0 Request processed in 440us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015343.656103:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1786015343.656360:0:17345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17345:1872772304367872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015343.656449:0:17345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17345:1872772304368000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015343.656491:0:17345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015343.658944:0:17345:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486543180 going to sleep for 11 seconds 00000100:00100000:1.0:1786015343.659729:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304368000 00000100:00100000:1.0:1786015343.659748:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304368000 00000100:00100000:1.0:1786015343.660228:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1786015343.660243:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:17345:x1872772304368000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786015343.661009:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:17345:x1872772304368000:12345-0@lo:502:llog_process_th.0 Request processed in 765us (4511us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015343.661021:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:0.0:1786015343.663109:0:17345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17345:1872772304368000:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1786015343.666908:0:17345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1786015343.668720:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 49-51 (rc=0) 10000000:01000000:1.0:1786015343.668808:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786015343.669326:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73813bec00/0xb1a5ef690c50071a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500721 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015343.669348:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b73813bec00/0xb1a5ef690c50071a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500721 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786015343.669363:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1786015343.669366:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1786015343.669369:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1786015343.669440:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73813bfa00/0xb1a5ef690c500728 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015343.669449:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b73813bfa00/0xb1a5ef690c500728 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015343.669486:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b73813bfa00/0xb1a5ef690c500728 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015343.669527:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304368128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786015343.669636:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015343.669710:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786015343.669794:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304368128 00000100:00100000:2.0:1786015343.669806:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304368128 00000100:00100000:2.0:1786015343.669889:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:2.0:1786015343.669900:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304368128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786015343.669921:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015343.669965:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7383907000/0xb1a5ef690c50072f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c500728 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.669999:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7383907000/0xb1a5ef690c50072f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c500728 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.670013:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7383907000/0xb1a5ef690c50072f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500728 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.670224:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907000, rc 0) 00000100:00100000:2.0:1786015343.670293:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304368128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 394us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015343.670301:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1786015343.671302:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304368128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786015343.671337:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b73813bfa00/0xb1a5ef690c500728 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50072f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015343.671350:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b73813bfa00/0xb1a5ef690c500728 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c50072f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015343.671467:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304368256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786015343.671522:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015343.671585:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015343.672391:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304368256 00000100:00100000:0.0:1786015343.672404:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304368256 00000100:00100000:0.0:1786015343.672468:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:0.0:1786015343.672479:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304368256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015343.673420:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304368256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 935us (1889us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015343.673432:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:0.0:1786015343.673506:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304368256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015343.673572:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304368384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015343.673650:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015343.673693:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786015343.675500:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304368384 00000100:00100000:2.0:1786015343.675521:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304368384 00000100:00100000:2.0:1786015343.675608:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1786015343.675620:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304368384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786015343.676439:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304368384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786015343.676663:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304368384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 400us (2367us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015343.676675:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000040:00080000:3.0:1786015343.680307:0:17346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:1.0:1786015343.680810:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1786015343.680855:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1786015343.680873:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73813bfa00/0xb1a5ef690c500728 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50072f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015343.680886:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b73813bfa00/0xb1a5ef690c500728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50072f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786015343.680899:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786015343.680939:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b7483242800 from 49 10000000:01000000:1.0:1786015343.680943:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786015343.681006:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73813bf800/0xb1a5ef690c500736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015343.681015:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b73813bf800/0xb1a5ef690c500736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015343.681429:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b73813bf800/0xb1a5ef690c500736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015343.681467:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304368512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786015343.681562:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015343.681864:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304368512 00000100:00100000:0.0:1786015343.681876:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304368512 00000100:00100000:0.0:1786015343.681966:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:0.0:1786015343.681980:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304368512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786015343.682006:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015343.682289:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c50073d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c500736 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015343.682327:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c50073d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c500736 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015343.682339:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c50073d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500736 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015343.682351:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7480031a00, rc 0) 00000100:00100000:0.0:1786015343.682408:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304368512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 431us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015343.682416:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:1.0:1786015343.683456:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06240 going to sleep for 11 seconds 00000100:00100000:1.0:1786015343.683501:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304368512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786015343.683530:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b73813bf800/0xb1a5ef690c500736 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50073d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015343.683544:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b73813bf800/0xb1a5ef690c500736 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c50073d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015343.684751:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304368640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786015343.685267:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015343.685372:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06240 going to sleep for 11 seconds 00000100:00100000:2.0:1786015343.685437:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304368640 00000100:00100000:2.0:1786015343.685449:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304368640 00000100:00100000:2.0:1786015343.685550:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1786015343.685566:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304368640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015343.686042:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304368640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 480us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015343.686061:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1786015343.686541:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304368640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786015343.686619:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304368768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786015343.686682:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015343.687280:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06240 going to sleep for 11 seconds 00000100:00100000:0.0:1786015343.687340:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304368768 00000100:00100000:0.0:1786015343.687348:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304368768 00000100:00100000:0.0:1786015343.687392:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1786015343.687400:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304368768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015343.687635:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304368768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015343.687643:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1786015343.687990:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304368768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786015343.688513:0:17347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17347:1872772304368896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786015343.688563:0:17347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015343.688609:0:17347:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015343.688748:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304368896 00000100:00100000:0.0:1786015343.688783:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304368896 00000100:00100000:0.0:1786015343.688820:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1786015343.688995:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:17347:x1872772304368896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786015343.689445:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:17347:x1872772304368896:12345-0@lo:502:llog_process_th.0 Request processed in 616us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015343.689454:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1786015343.689826:0:17347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17347:1872772304368896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015343.690089:0:17347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8979f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17347:1872772304369024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015343.690217:0:17347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015343.690258:0:17347:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786015343.690310:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304369024 00000100:00100000:3.0:1786015343.690317:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304369024 00000100:00100000:3.0:1786015343.690370:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:3.0:1786015343.690380:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:17347:x1872772304369024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015343.690616:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:17347:x1872772304369024:12345-0@lo:502:llog_process_th.0 Request processed in 236us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015343.690635:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1786015343.691261:0:17347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8979f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17347:1872772304369024:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1786015343.691296:0:17347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1786015343.691810:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 49-51 (rc=0) 10000000:01000000:3.0:1786015343.691902:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786015343.691916:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73813bf800/0xb1a5ef690c500736 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50073d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015343.691938:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b73813bf800/0xb1a5ef690c500736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50073d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786015343.691950:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1786015343.691953:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1786015343.691957:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1786015343.691998:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015343.692007:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015343.692075:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015343.692099:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304369152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786015343.692240:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015343.692282:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486543c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786015343.692341:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304369152 00000100:00100000:0.0:1786015343.692347:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304369152 00000100:00100000:0.0:1786015343.692392:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1786015343.692399:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304369152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786015343.692415:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015343.692431:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7480031800/0xb1a5ef690c50074b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c500744 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015343.692459:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7480031800/0xb1a5ef690c50074b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c500744 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015343.692469:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7480031800/0xb1a5ef690c50074b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500744 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015343.692479:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7480031800, rc 0) 00000100:00100000:0.0:1786015343.692518:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304369152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015343.692524:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:3.0:1786015343.692649:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304369152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015343.692664:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50074b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015343.692986:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c50074b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015343.693195:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304369280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015343.693225:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015343.693284:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486543c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786015343.693312:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304369280 00000100:00100000:0.0:1786015343.693317:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304369280 00000100:00100000:0.0:1786015343.693374:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:0.0:1786015343.693382:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304369280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015343.693677:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304369280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015343.693685:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:3.0:1786015343.693741:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304369280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015343.693816:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304369408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786015343.693863:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015343.694485:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486543c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015343.694547:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304369408 00000100:00100000:1.0:1786015343.694553:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304369408 00000100:00100000:1.0:1786015343.694586:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1786015343.694603:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304369408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786015343.695284:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304369408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 686us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015343.695295:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1786015343.695620:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304369408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786015343.698580:0:17348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17348:1872772304369536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786015343.699332:0:17348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015343.699404:0:17348:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce0180 going to sleep for 11 seconds 00000100:00100000:3.0:1786015343.699495:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304369536 00000100:00100000:3.0:1786015343.699507:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304369536 00000100:00100000:3.0:1786015343.699618:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:3.0:1786015343.699630:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:17348:x1872772304369536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015343.700089:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:17348:x1872772304369536:12345-0@lo:502:llog_process_th.0 Request processed in 458us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015343.700099:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1786015343.700523:0:17348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17348:1872772304369536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786015343.700576:0:17348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786015343.700591:0:17348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786015343.700594:0:17348:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre-MDT0000-m rem lustre.test_11c.lustre-OST0001_UUID 00000020:00000080:1.0:1786015343.700601:0:17348:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1786015343.700623:0:17348:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from test_11c 00000020:01000004:0.0:1786015343.710882:0:17349:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b7483242800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1786015343.710901:0:17349:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b7483242800 4 00000100:00100000:1.0:1786015343.711446:0:17348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17348:1872772304369664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786015343.711589:0:17348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015343.712200:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304369664 00000100:00100000:0.0:1786015343.712211:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304369664 00000100:00100000:0.0:1786015343.712320:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:0.0:1786015343.712333:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:17348:x1872772304369664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786015343.712749:0:17348:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74ac59c240 going to sleep for 11 seconds 00000100:00100000:0.0:1786015343.712972:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:17348:x1872772304369664:12345-0@lo:502:llog_process_th.0 Request processed in 640us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015343.712983:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1786015343.713256:0:17348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17348:1872772304369664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786015343.713313:0:17348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786015343.713324:0:17348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786015343.713327:0:17348:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre-MDT0000-m rem lustre.test_11c.lustre-OST0001_UUID 00000040:00080000:1.0:1786015343.713332:0:17348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1786015343.713623:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1786015343.713659:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1786015343.713680:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50074b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.713696:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50074b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786015343.713710:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1786015343.713714:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8b74b00a4d40 from 1 10000000:01000000:2.0:1786015343.713717:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1786015343.713798:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.713809:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.713823:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015343.713856:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304369792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786015343.713904:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015343.717616:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb540 going to sleep for 11 seconds 00000100:00100000:3.0:1786015343.718202:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304369792 00000100:00100000:3.0:1786015343.718219:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304369792 00000100:00100000:2.0:1786015343.718425:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:2.0:1786015343.718438:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304369792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786015343.718466:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015343.718500:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7383907c00/0xb1a5ef690c500759 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c500752 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.718570:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7383907c00/0xb1a5ef690c500759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c500752 expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.718585:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7383907c00/0xb1a5ef690c500759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500752 expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015343.718611:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907c00, rc 0) 00000100:00100000:2.0:1786015343.718869:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:5792:x1872772304369792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 432us (4963us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015343.718878:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:3.0:1786015343.720456:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304369792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015343.720494:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500752 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500759 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015343.720534:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500752 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c500759 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015343.722279:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304369920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015343.722393:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015343.722462:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486543540 going to sleep for 11 seconds 00000100:00100000:2.0:1786015343.722730:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304369920 00000100:00100000:2.0:1786015343.722742:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304369920 00000100:00100000:2.0:1786015343.723181:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1786015343.723195:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:5792:x1872772304369920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015343.723581:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:5792:x1872772304369920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 388us (1188us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786015343.723591:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:3.0:1786015343.724250:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304369920:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1786015343.724315:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1786015343.724328:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500752 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500759 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015343.724341:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500759 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015344.492011:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015344.963690:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015344.963705:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015344.964298:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015344.964310:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786015345.516752:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015345.726994:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015345.727931:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280381696 00000100:00100000:0.0:1786015345.727945:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280381696 00000100:00100000:0.0:1786015345.728018:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 501 00000100:00100000:0.0:1786015345.728039:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280381696:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015345.728350:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280381696:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 320us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015345.728377:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 501 00000100:00100000:1.0:1786015345.731602:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015345.731651:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015345.731685:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015345.731706:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015345.731725:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015345.731749:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015345.731813:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280381952 00000100:00100000:1.0:1786015345.731825:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280381952 00000100:00100000:1.0:1786015345.731879:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280382464 00000100:00100000:1.0:1786015345.731883:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280382464 00000100:00100000:1.0:1786015345.731897:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280382080 00000100:00100000:1.0:1786015345.731900:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280382080 00000100:00100000:1.0:1786015345.731925:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280382336 00000100:00100000:1.0:1786015345.731929:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280382336 00000100:00100000:1.0:1786015345.731947:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 312 00000100:00100000:1.0:1786015345.731955:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+10:2354:x1872772280381952:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015345.732038:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+10:2354:x1872772280381952:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 73us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015345.732046:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 312 00000100:00100000:1.0:1786015345.732065:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 313 00000100:00100000:1.0:1786015345.732072:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280382464:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015345.733177:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 314 00000100:00100000:0.0:1786015345.733196:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280382080:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015345.733421:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280382080:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 231us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015345.733428:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 314 00000100:00100000:0.0:1786015345.733450:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 315 00000100:00100000:0.0:1786015345.733457:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280382336:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015345.733483:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280382336:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (1733us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015345.733488:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 315 00000100:00080000:0.0:1786015345.733509:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015345.733513:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015345.733692:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280382208 00000100:00100000:3.0:1786015345.733702:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280382208 00000100:00100000:3.0:1786015345.733790:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280381824 00000100:00100000:3.0:1786015345.733794:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280381824 00000100:00100000:3.0:1786015345.733819:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 350 00000100:00100000:3.0:1786015345.733827:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+31:2354:x1872772280382208:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015345.733861:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+31:2354:x1872772280382208:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 35us (2208us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015345.733867:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 350 00000100:00100000:3.0:1786015345.733880:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 351 00000100:00100000:3.0:1786015345.733886:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+74:2353:x1872772280381824:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015345.733939:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+74:2353:x1872772280381824:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 53us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015345.733945:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 351 00000100:00080000:0.0:1786015345.734419:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015345.734856:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280382464:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 2780us (3166us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015345.734865:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 313 00000100:00100000:0.0:1786015345.847521:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304370048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015345.847604:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015345.847693:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304370048 00000100:00100000:0.0:1786015345.847701:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304370048 00000100:00100000:0.0:1786015345.847821:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1786015345.847832:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304370048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015345.847875:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015345.847940:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304370048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015345.847948:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1786015345.847988:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015345.848034:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304370048:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1786015346.495959:0:17447:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff376bbf30 20000000:00000080:1.0:1786015346.495978:0:17447:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8b74bf52fc00 uarg=0000000000000000 00000040:00100000:1.0:1786015346.497068:0:17447:0:(llog.c:1072:llog_reverse_process()) index 51 : idx 48 20000000:01000000:1.0:1786015346.497078:0:17447:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 50 cmd:0xce022 lustre.test_11c lustre-OST0001_UUID 20000000:01000000:1.0:1786015346.497094:0:17447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.test_11c fl=4 20000000:01000000:3.0:1786015346.498475:0:17448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 42 marker 28 1->4: lustre-clilov new lustre.test_11c 20000000:01000000:3.0:1786015346.498600:0:17448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 44 marker 28 2->4: lustre-clilov new lustre.test_11c 00000040:00080000:3.0:1786015346.498661:0:17448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000040:00080000:1.0:1786015346.499342:0:17447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17416 20000000:01000000:1.0:1786015346.499359:0:17447:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre test_11c (null) (null) 00000040:00080000:1.0:1786015346.499394:0:17447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 112 off17528 00000040:00080000:1.0:1786015346.499427:0:17447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17752 20000000:01000000:1.0:1786015346.499445:0:17447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.test_11c fl=4 20000000:01000000:3.0:1786015346.500158:0:17449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 37 marker 29 1->4: lustre-MDT0000-mdtlov new lustre.test_11c 20000000:01000000:3.0:1786015346.500403:0:17449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 39 marker 29 2->4: lustre-MDT0000-mdtlov new lustre.test_11c 00000040:00080000:3.0:1786015346.500476:0:17449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000040:00080000:1.0:1786015346.501027:0:17447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16608 20000000:01000000:1.0:1786015346.501043:0:17447:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre test_11c (null) (null) 00000040:00080000:1.0:1786015346.501082:0:17447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].48, 120 off16728 00000040:00080000:1.0:1786015346.501316:0:17447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16952 10000000:01000000:1.0:1786015346.501335:0:17447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1786015346.501357:0:17447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b73813be000/0xb1a5ef690c500760 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.501379:0:17447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81b8 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.501387:0:17447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7383906400/0xb1a5ef690c5006f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81bf expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.501394:0:17447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5006f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81c6 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.501416:0:17447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7383907200/0xb1a5ef690c500705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c5006fe expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.501423:0:17447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c50070c expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.501430:0:17447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7383907600/0xb1a5ef690c500721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c50071a expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.501438:0:17447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7383907000/0xb1a5ef690c50072f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500728 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.501444:0:17447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c50073d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500736 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.501451:0:17447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7480031800/0xb1a5ef690c50074b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500744 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.501459:0:17447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b7383907c00/0xb1a5ef690c500759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500752 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.501467:0:17447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b73813be000/0xb1a5ef690c500760 lrc: 13/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.501507:0:17447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7383907c00/0xb1a5ef690c500759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c500752 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.501524:0:17447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b7383907c00/0xb1a5ef690c500759 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c500752 expref: 18 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.501552:0:17447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304370176:0@lo:104: 00000100:00100000:1.0:1786015346.501616:0:17447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786015346.501688:0:17447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7480031800/0xb1a5ef690c50074b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c500744 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.501698:0:17447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b7480031800/0xb1a5ef690c50074b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c500744 expref: 18 pid: 5790 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.501707:0:17447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304370304:0@lo:104: 00000100:00100000:1.0:1786015346.501729:0:17447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786015346.501787:0:17447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c50073d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c500736 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.501797:0:17447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c50073d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c500736 expref: 18 pid: 5790 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.501805:0:17447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304370432:0@lo:104: 00000100:00100000:1.0:1786015346.501828:0:17447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786015346.501866:0:17447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7383907000/0xb1a5ef690c50072f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c500728 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.501875:0:17447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b7383907000/0xb1a5ef690c50072f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c500728 expref: 18 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.501884:0:17447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381941180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304370560:0@lo:104: 00000100:00100000:1.0:1786015346.501916:0:17447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786015346.501934:0:17447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7383907600/0xb1a5ef690c500721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c50071a expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.501954:0:17447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b7383907600/0xb1a5ef690c500721 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c50071a expref: 18 pid: 5789 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.501964:0:17447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381940700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304370688:0@lo:104: 00000100:00100000:1.0:1786015346.501987:0:17447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786015346.502005:0:17447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c50070c expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.502013:0:17447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500713 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c50070c expref: 18 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.502021:0:17447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381940380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304370816:0@lo:104: 00000100:00100000:1.0:1786015346.502041:0:17447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786015346.502059:0:17447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7383907200/0xb1a5ef690c500705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1a5ef690c5006fe expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.502067:0:17447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b7383907200/0xb1a5ef690c500705 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1a5ef690c5006fe expref: 18 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.502074:0:17447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381943480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304370944:0@lo:104: 00000100:00100000:2.0:1786015346.502331:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304370176 00000100:00100000:2.0:1786015346.502339:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304370176 00000100:00100000:2.0:1786015346.502381:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304370304 00000100:00100000:2.0:1786015346.502385:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304370304 00000100:00100000:2.0:1786015346.502398:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304370432 00000100:00100000:2.0:1786015346.502401:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304370432 00000100:00100000:2.0:1786015346.502409:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304370560 00000100:00100000:2.0:1786015346.502412:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304370560 00000100:00100000:2.0:1786015346.502420:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304370688 00000100:00100000:2.0:1786015346.502421:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304370688 00000100:00100000:2.0:1786015346.502429:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304370816 00000100:00100000:2.0:1786015346.502438:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304370816 00000100:00100000:2.0:1786015346.502455:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1786015346.502463:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+8:17447:x1872772304370176:12345-0@lo:104: 00010000:00010000:2.0:1786015346.502475:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c500759 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015346.502566:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1786015346.502577:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+8:17447:x1872772304370304:12345-0@lo:104: 00010000:00010000:3.0:1786015346.502585:0:8307:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c50074b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.502626:0:17447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015346.502716:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1786015346.502728:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:0.0:1786015346.502733:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00000100:00100000:0.0:1786015346.502884:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304370944 00000100:00100000:0.0:1786015346.502888:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304370944 00000100:00100000:0.0:1786015346.502982:0:17450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1786015346.502990:0:17450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+9:17447:x1872772304370432:12345-0@lo:104: 00010000:00010000:0.0:1786015346.503000:0:17450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b73813bf800/0xb1a5ef690c500736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c50073d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503151:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786015346.503158:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+9:17447:x1872772304370176:12345-0@lo:104: Request processed in 696us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015346.503166:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1786015346.503186:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1786015346.503192:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+8:17447:x1872772304370560:12345-0@lo:104: 00010000:00010000:2.0:1786015346.503211:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b73813bfa00/0xb1a5ef690c500728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c50072f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503248:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1786015346.503253:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+8:17447:x1872772304370560:12345-0@lo:104: Request processed in 62us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015346.503259:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1786015346.503273:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1786015346.503278:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+7:17447:x1872772304370688:12345-0@lo:104: 00010000:00010000:2.0:1786015346.503286:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b73813bec00/0xb1a5ef690c50071a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c500721 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503320:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1786015346.503324:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+7:17447:x1872772304370688:12345-0@lo:104: Request processed in 47us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015346.503329:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1786015346.503352:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1786015346.503357:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+6:17447:x1872772304370816:12345-0@lo:104: 00010000:00010000:2.0:1786015346.503365:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c50070c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c500713 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503401:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1786015346.503406:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+6:17447:x1872772304370816:12345-0@lo:104: Request processed in 49us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015346.503411:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1786015346.503423:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1786015346.503429:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aec5a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+5:17447:x1872772304370944:12345-0@lo:104: 00010000:00010000:2.0:1786015346.503437:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff8b7480031200/0xb1a5ef690c5006fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c500705 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503464:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1786015346.503468:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aec5a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+5:17447:x1872772304370944:12345-0@lo:104: Request processed in 40us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015346.503474:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:2.0:1786015346.503491:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1786015346.503498:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c500759 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503506:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907400 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1786015346.503510:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c500759 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503519:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c500759 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786015346.503536:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c500759 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786015346.503542:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786015346.503576:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500752 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500759 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503582:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786015346.503603:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500752 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500759 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503610:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b7383907400/0xb1a5ef690c500752 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500759 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503623:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1786015346.503626:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b73813bfa00/0xb1a5ef690c500728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c50072f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503631:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bfa00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1786015346.503634:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b73813bfa00/0xb1a5ef690c500728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c50072f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503640:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b73813bfa00/0xb1a5ef690c500728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c50072f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786015346.503647:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b73813bfa00/0xb1a5ef690c500728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c50072f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786015346.503653:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786015346.503672:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b73813bfa00/0xb1a5ef690c500728 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c50072f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503677:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786015346.503698:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b73813bfa00/0xb1a5ef690c500728 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c50072f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503705:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b73813bfa00/0xb1a5ef690c500728 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c50072f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503714:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786015346.503717:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b73813bec00/0xb1a5ef690c50071a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c500721 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503723:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bec00 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1786015346.503726:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b73813bec00/0xb1a5ef690c50071a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c500721 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503732:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b73813bec00/0xb1a5ef690c50071a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c500721 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786015346.503737:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b73813bec00/0xb1a5ef690c50071a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c500721 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786015346.503742:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786015346.503754:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b73813bec00/0xb1a5ef690c50071a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500721 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503780:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786015346.503786:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b73813bec00/0xb1a5ef690c50071a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500721 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503801:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b73813bec00/0xb1a5ef690c50071a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500721 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503810:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786015346.503813:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c50070c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c500713 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503818:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813be200 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1786015346.503820:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c50070c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c500713 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503826:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c50070c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c500713 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786015346.503832:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c50070c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c500713 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786015346.503837:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786015346.503851:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c50070c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500713 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503856:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786015346.503863:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c50070c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500713 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503869:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b73813be200/0xb1a5ef690c50070c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500713 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503877:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786015346.503889:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b7480031200/0xb1a5ef690c5006fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c500705 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503895:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7480031200 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1786015346.503897:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b7480031200/0xb1a5ef690c5006fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c500705 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503917:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b7480031200/0xb1a5ef690c5006fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c500705 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786015346.503923:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b7480031200/0xb1a5ef690c5006fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c500705 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786015346.503929:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786015346.503943:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b7480031200/0xb1a5ef690c5006fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500705 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503949:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786015346.503954:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b7480031200/0xb1a5ef690c5006fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500705 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503961:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b7480031200/0xb1a5ef690c5006fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c500705 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.503973:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015346.503975:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015346.503977:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015346.503986:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015346.503992:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015346.504014:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304371072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786015346.504058:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015346.504098:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304371584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786015346.504122:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015346.504141:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786015346.504146:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304371456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786015346.504165:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786015346.504452:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015346.504466:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304371072 00000100:00100000:3.0:1786015346.504472:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304371072 00010000:00010000:3.0:1786015346.504498:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7383907c00/0xb1a5ef690c500759 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c500752 expref: 19 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015346.504523:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304371584 00000100:00100000:3.0:1786015346.504526:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304371584 00010000:00010000:3.0:1786015346.504537:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7383907200/0xb1a5ef690c500705 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c5006fe expref: 20 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015346.504551:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304371456 00000100:00100000:3.0:1786015346.504554:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304371456 00010000:00010000:3.0:1786015346.504565:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500713 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c50070c expref: 21 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015346.504594:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1786015346.504601:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74865ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+21:3315:x1872772304371072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786015346.504613:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015346.504619:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7383907c00/0xb1a5ef690c500759 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c500752 expref: 21 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.504631:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7383907c00/0xb1a5ef690c500759 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c500752 expref: 21 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.504650:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015346.504696:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74865ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+21:3315:x1872772304371072:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015346.504703:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1786015346.504748:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1786015346.504754:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+20:3315:x1872772304371584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786015346.504788:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015346.504793:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7383907200/0xb1a5ef690c500705 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c5006fe expref: 20 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.504801:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7383907200/0xb1a5ef690c500705 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c5006fe expref: 20 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.504811:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015346.504835:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+20:3315:x1872772304371584:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015346.504841:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1786015346.504854:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1786015346.504867:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304371456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786015346.504875:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015346.504879:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500713 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c50070c expref: 19 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.504887:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500713 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c50070c expref: 19 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.504896:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015346.504933:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304371456:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015346.504940:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1786015346.504979:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304371456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015346.504990:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304371072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015346.504997:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304371584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015346.507300:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304371328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015346.507380:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015346.507435:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786015346.507442:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304371200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015346.507468:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015346.507514:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304371328 00000100:00100000:3.0:1786015346.507522:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304371328 00010000:00010000:3.0:1786015346.507555:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7383907600/0xb1a5ef690c500721 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c50071a expref: 19 pid: 5789 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015346.507583:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304371200 00000100:00100000:3.0:1786015346.507586:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304371200 00010000:00010000:3.0:1786015346.507614:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7383907000/0xb1a5ef690c50072f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c500728 expref: 20 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015346.507628:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1786015346.507634:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+20:3313:x1872772304371328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786015346.507648:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015346.507653:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7383907600/0xb1a5ef690c500721 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c50071a expref: 20 pid: 5789 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.507663:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7383907600/0xb1a5ef690c500721 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c50071a expref: 20 pid: 5789 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.507682:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015346.507719:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+20:3313:x1872772304371328:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015346.507726:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1786015346.507747:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1786015346.507754:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304371200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786015346.507787:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015346.507792:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7383907000/0xb1a5ef690c50072f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c500728 expref: 19 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.507801:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7383907000/0xb1a5ef690c50072f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c500728 expref: 19 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.507811:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015346.507835:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304371200:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015346.507841:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1786015346.507892:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304371200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015346.507899:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304371328:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786015346.508288:0:8307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786015346.508298:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+4:17447:x1872772304370304:12345-0@lo:104: Request processed in 5723us (6567us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015346.508307:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1786015346.508405:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786015346.508414:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c50074b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.508423:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819ba200 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:3.0:1786015346.508427:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c50074b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.508436:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c50074b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786015346.508443:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c50074b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786015346.508449:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786015346.508494:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500744 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c50074b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.508501:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786015346.508519:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500744 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c50074b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.508526:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500744 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c50074b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.508540:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015346.508542:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015346.508544:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015346.508561:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304371712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015346.508594:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015346.508626:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304371712 00000100:00100000:3.0:1786015346.508631:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304371712 00010000:00010000:3.0:1786015346.508648:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7480031800/0xb1a5ef690c50074b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c500744 expref: 19 pid: 5790 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015346.508669:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1786015346.508675:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304371712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786015346.508684:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015346.508689:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7480031800/0xb1a5ef690c50074b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c500744 expref: 19 pid: 5790 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.508698:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7480031800/0xb1a5ef690c50074b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c500744 expref: 19 pid: 5790 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.508711:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015346.508741:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304371712:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015346.508748:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1786015346.508799:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304371712:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786015346.509465:0:17447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5006f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81c6 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.509480:0:17447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5006f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81c6 expref: 12 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.509493:0:17447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381941500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304371840:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015346.509577:0:17447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b7383906400/0xb1a5ef690c5006f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81bf expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.509586:0:17447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b7383906400/0xb1a5ef690c5006f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81bf expref: 12 pid: 5789 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.509595:0:17447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381942680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304371968:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015346.509626:0:17447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81b8 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.509635:0:17447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81b8 expref: 12 pid: 5790 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.509643:0:17447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381942d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304372096:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015346.509666:0:17447:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce00c0 going to sleep for 11 seconds 00010000:00010000:1.0:1786015346.509685:0:17447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7383907c00/0xb1a5ef690c500759 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c500752 expref: 18 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.509696:0:17447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304370176:0@lo:104: 00010000:00010000:1.0:1786015346.509707:0:17447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7480031800/0xb1a5ef690c50074b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c500744 expref: 17 pid: 5790 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.509716:0:17447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304370304:0@lo:104: 00010000:00010000:1.0:1786015346.509726:0:17447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7383907000/0xb1a5ef690c50072f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c500728 expref: 16 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.509733:0:17447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381941180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304370560:0@lo:104: 00010000:00010000:1.0:1786015346.509743:0:17447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7383907600/0xb1a5ef690c500721 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c50071a expref: 15 pid: 5789 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.509995:0:17447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381940700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304370688:0@lo:104: 00010000:00010000:1.0:1786015346.510011:0:17447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7383907e00/0xb1a5ef690c500713 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c50070c expref: 14 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.510021:0:17447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381940380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304370816:0@lo:104: 00010000:00010000:1.0:1786015346.510031:0:17447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7383907200/0xb1a5ef690c500705 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c5006fe expref: 13 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.510038:0:17447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381943480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304370944:0@lo:104: 00010000:00010000:0.0:1786015346.510805:0:17450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786015346.510817:0:17450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+3:17447:x1872772304370432:12345-0@lo:104: Request processed in 7825us (8984us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015346.510827:0:17450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:2.0:1786015346.510934:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786015346.510941:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff8b73813bf800/0xb1a5ef690c500736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1a5ef690c50073d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.510949:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf800 already unused, calling callback (ffffffffc1c3fc20) 10000000:00010000:2.0:1786015346.510953:0:8308:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff8b73813bf800/0xb1a5ef690c500736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1a5ef690c50073d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.510963:0:8308:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff8b73813bf800/0xb1a5ef690c500736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1a5ef690c50073d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786015346.510971:0:8308:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff8b73813bf800/0xb1a5ef690c500736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1a5ef690c50073d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786015346.510976:0:8308:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786015346.511018:0:8308:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff8b73813bf800/0xb1a5ef690c500736 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c50073d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.511025:0:8308:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786015346.511047:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff8b73813bf800/0xb1a5ef690c500736 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c50073d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.511069:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff8b73813bf800/0xb1a5ef690c500736 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1a5ef690c50073d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.511110:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015346.511112:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015346.511114:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015346.511353:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786015346.511370:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304372224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786015346.511416:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015346.511619:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304372224 00000100:00100000:2.0:1786015346.511627:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304372224 00010000:00010000:2.0:1786015346.511653:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c50073d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c500736 expref: 13 pid: 5790 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015346.511688:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1786015346.511696:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:3312:x1872772304372224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786015346.511708:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015346.511713:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c50073d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1a5ef690c500736 expref: 13 pid: 5790 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.511723:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c50073d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1a5ef690c500736 expref: 13 pid: 5790 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.511739:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015346.511804:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:3312:x1872772304372224:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015346.511811:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1786015346.511913:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304372224:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786015346.513314:0:17447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7480031a00/0xb1a5ef690c50073d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1a5ef690c500736 expref: 12 pid: 5790 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.513335:0:17447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304370432:0@lo:104: 00000100:00100000:2.0:1786015346.516651:0:17447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381941500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304371840:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015346.520312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015346.520404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015346.520527:0:17447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381942680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304371968:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015346.520539:0:17447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381942d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17447:1872772304372096:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015346.520609:0:17447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b73813be000/0xb1a5ef690c500760 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.520747:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280382720 00000100:00100000:1.0:1786015346.520756:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280382720 00010000:00010000:1.0:1786015346.520870:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b7383906400/0xb1a5ef690c5006f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81bf expref: 13 pid: 5789 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.520900:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280382848 00000100:00100000:1.0:1786015346.520913:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280382848 00010000:00010000:1.0:1786015346.520927:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81b8 expref: 14 pid: 5790 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015346.520955:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 241 00000100:00100000:1.0:1786015346.520964:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74865a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+14:2353:x1872772280382720:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015346.520979:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015346.520985:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b7383906400/0xb1a5ef690c5006f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81bf expref: 14 pid: 5789 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.521002:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b7383906400/0xb1a5ef690c5006f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81bf expref: 14 pid: 5789 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.521020:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7383906400/0xb1a5ef690c5006f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81bf expref: 14 pid: 5789 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.521035:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015346.521091:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74865a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280382720:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 128us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015346.521099:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 241 00000100:00100000:1.0:1786015346.521144:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 242 00000100:00100000:1.0:1786015346.521152:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8979f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:2353:x1872772280382848:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015346.521160:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015346.521165:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81b8 expref: 12 pid: 5790 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.521173:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81b8 expref: 12 pid: 5790 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.521182:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b73819bb800/0xb1a5ef690c5006e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81b8 expref: 12 pid: 5790 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015346.521190:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015346.521221:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8979f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:2353:x1872772280382848:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 70us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015346.521228:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 242 00000100:00100000:1.0:1786015346.528058:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015346.528215:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280382592 00000100:00100000:3.0:1786015346.528225:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280382592 00010000:00010000:3.0:1786015346.528268:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5006f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81c6 expref: 11 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015346.528329:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 243 00000100:00100000:3.0:1786015346.528342:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:2351:x1872772280382592:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015346.528365:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015346.528373:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5006f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81c6 expref: 11 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.528389:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5006f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81c6 expref: 11 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.528413:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b73813bf600/0xb1a5ef690c5006f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81c6 expref: 11 pid: 5787 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.528435:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b73813be000/0xb1a5ef690c500760 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.528444:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b73813be000/0xb1a5ef690c500760 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.528464:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b73813be000/0xb1a5ef690c500760 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.528472:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b73813be000/0xb1a5ef690c500760 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.528479:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b73813be000/0xb1a5ef690c500760 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.528486:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b73813be000/0xb1a5ef690c500760 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.528504:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813be000 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015346.528510:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b73813be000/0xb1a5ef690c500760 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.528520:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b73813be000/0xb1a5ef690c500760 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.528543:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b73813be000/0xb1a5ef690c500760 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015346.528555:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015346.528612:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+10:2351:x1872772280382592:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 273us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015346.528621:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 243 00010000:00010000:2.0:1786015346.528713:0:17447:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b73813be000/0xb1a5ef690c500760 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.528723:0:17447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b73813be000/0xb1a5ef690c500760 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.528730:0:17447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b73813be000/0xb1a5ef690c500760 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015346.540124:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015347.374977:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304372736:0@lo:400:kworker.0 00000100:00100000:3.0:1786015347.375064:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.375142:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786015347.375149:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304372608:0@lo:400:kworker.0 00000100:00100000:3.0:1786015347.375178:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015347.375325:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304372608 00000100:00100000:1.0:1786015347.375335:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304372608 00000100:00100000:1.0:1786015347.375404:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1786015347.375415:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304372608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015347.375480:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304372608:12345-0@lo:400:kworker.0 Request processed in 67us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015347.375487:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1786015347.375537:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304372608:0@lo:400:kworker.0 00000100:00100000:0.0:1786015347.375695:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304372736 00000100:00100000:0.0:1786015347.375701:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304372736 00000100:00100000:0.0:1786015347.375751:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1786015347.375791:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304372736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015347.375836:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304372736:12345-0@lo:400:kworker.0 Request processed in 77us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015347.375843:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1786015347.375864:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304372480:0@lo:400:kworker.0 00000100:00100000:0.0:1786015347.375924:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015347.375945:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304372992:0@lo:400:kworker.0 00000100:00100000:0.0:1786015347.375967:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015347.375989:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00080000:3.0:1786015347.375993:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015347.375997:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304372352:0@lo:400:kworker.0 00000100:00080000:3.0:1786015347.376000:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015347.376029:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304372480 00000100:00100000:0.0:1786015347.376030:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.376036:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304372480 00000100:00100000:0.0:1786015347.376064:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304372864:0@lo:400:kworker.0 00000100:00100000:3.0:1786015347.376085:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1786015347.376091:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.376098:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304372480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015347.376123:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304372992 00000100:00100000:0.0:1786015347.376128:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304372992 00000100:00100000:3.0:1786015347.376159:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304372480:12345-0@lo:400:kworker.0 Request processed in 65us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015347.376169:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1786015347.376179:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304372992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015347.376181:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1786015347.376201:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304372864 00000100:00100000:3.0:1786015347.376205:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304372864 00000100:00100000:0.0:1786015347.376220:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304372992:12345-0@lo:400:kworker.0 Request processed in 41us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015347.376226:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1786015347.376250:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1786015347.376258:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304372864:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786015347.376278:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015347.376283:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015347.376287:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304372864:12345-0@lo:400:kworker.0 Request processed in 31us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015347.376294:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1786015347.376325:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304372864:0@lo:400:kworker.0 00000100:00100000:0.0:1786015347.376333:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304372480:0@lo:400:kworker.0 00000100:00100000:0.0:1786015347.376340:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304372992:0@lo:400:kworker.0 00000100:00100000:1.0:1786015347.378042:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304372352 00000100:00100000:1.0:1786015347.378057:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304372352 00000100:00100000:1.0:1786015347.378128:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1786015347.378145:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+12:3315:x1872772304372352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015347.378246:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+12:3315:x1872772304372352:12345-0@lo:400:kworker.0 Request processed in 109us (2215us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015347.378253:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1786015347.378332:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304372736:0@lo:400:kworker.0 00000100:00100000:2.0:1786015347.378442:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304372352:0@lo:400:kworker.0 00010000:00010000:3.0:1786015347.565145:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1786015347.759057:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1786015347.759098:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b74bf8dd800 from 52 10000000:01000000:0.0:1786015347.759106:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1786015347.759155:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7480031000/0xb1a5ef690c500767 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015347.759169:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b7480031000/0xb1a5ef690c500767 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015347.759180:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b7480031000/0xb1a5ef690c500767 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015347.759208:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304373120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786015347.759282:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015347.759334:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786015347.759514:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304373120 00000100:00100000:2.0:1786015347.759523:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304373120 00000100:00100000:2.0:1786015347.759579:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:2.0:1786015347.759589:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+12:5792:x1872772304373120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786015347.759604:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015347.759620:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7383907400/0xb1a5ef690c50076e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c500767 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015347.759643:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7383907400/0xb1a5ef690c50076e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c500767 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015347.759653:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7383907400/0xb1a5ef690c50076e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500767 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015347.759663:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907400, rc 0) 00000100:00100000:2.0:1786015347.759722:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304373120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015347.759729:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1786015347.762076:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304373120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015347.762107:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b7480031000/0xb1a5ef690c500767 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50076e expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015347.762120:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b7480031000/0xb1a5ef690c500767 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c50076e expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015347.762214:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304373248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.762275:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.762328:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174600 going to sleep for 11 seconds 00000100:00100000:0.0:1786015347.762526:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304373248 00000100:00100000:0.0:1786015347.762534:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304373248 00000100:00100000:0.0:1786015347.762590:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:0.0:1786015347.762600:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304373248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015347.762985:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304373248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 386us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015347.762996:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1786015347.763119:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304373248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.763153:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304373376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.763191:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.763224:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174600 going to sleep for 11 seconds 00000100:00100000:0.0:1786015347.763756:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304373376 00000100:00100000:0.0:1786015347.763793:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304373376 00000100:00100000:0.0:1786015347.763830:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1786015347.763837:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304373376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015347.764054:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304373376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 216us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015347.764061:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1786015347.764094:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304373376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786015347.765522:0:17451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381942a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17451:1872772304373504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786015347.765599:0:17451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015347.765645:0:17451:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015347.765889:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304373504 00000100:00100000:0.0:1786015347.765905:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304373504 00000100:00100000:0.0:1786015347.765953:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1786015347.765961:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:17451:x1872772304373504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015347.766215:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:17451:x1872772304373504:12345-0@lo:502:llog_process_th.0 Request processed in 254us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015347.766223:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:2.0:1786015347.766327:0:17451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381942a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17451:1872772304373504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015347.766374:0:17451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17451:1872772304373632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015347.766407:0:17451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015347.766441:0:17451:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb540 going to sleep for 11 seconds 00000100:00100000:3.0:1786015347.766493:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304373632 00000100:00100000:3.0:1786015347.766498:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304373632 00000100:00100000:3.0:1786015347.766525:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1786015347.766531:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:17451:x1872772304373632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015347.766658:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:17451:x1872772304373632:12345-0@lo:502:llog_process_th.0 Request processed in 126us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015347.766665:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1786015347.766731:0:17451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17451:1872772304373632:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1786015347.766748:0:17451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1786015347.766944:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1786015347.766967:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786015347.766977:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7480031000/0xb1a5ef690c500767 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50076e expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015347.766988:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b7480031000/0xb1a5ef690c500767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50076e expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786015347.766999:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1786015347.767002:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1786015347.767005:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1786015347.767030:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500775 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015347.767038:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500775 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015347.767048:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500775 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015347.767062:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304373760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.767094:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.767122:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786015347.767170:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304373760 00000100:00100000:2.0:1786015347.767175:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304373760 00000100:00100000:2.0:1786015347.767195:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1786015347.767201:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+13:5792:x1872772304373760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786015347.767209:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015347.767222:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7383906a00/0xb1a5ef690c50077c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c500775 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015347.767241:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7383906a00/0xb1a5ef690c50077c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c500775 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015347.767251:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7383906a00/0xb1a5ef690c50077c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500775 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015347.767260:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906a00, rc 0) 00000100:00100000:2.0:1786015347.767299:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304373760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015347.767305:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:3.0:1786015347.767376:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304373760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015347.767389:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500775 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50077c expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015347.767403:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500775 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c50077c expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015347.767450:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304373888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.767475:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.767497:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786015347.767609:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304373888 00000100:00100000:2.0:1786015347.767613:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304373888 00000100:00100000:2.0:1786015347.767631:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:2.0:1786015347.767636:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304373888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015347.767925:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304373888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015347.767933:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1786015347.768074:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304373888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.768104:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304374016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.768142:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.768173:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015347.768246:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304374016 00000100:00100000:1.0:1786015347.768252:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304374016 00000100:00100000:1.0:1786015347.768273:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1786015347.768279:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304374016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786015347.768438:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304374016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015347.768454:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:3.0:1786015347.768577:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304374016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786015347.769574:0:17452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:3.0:1786015347.770693:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1786015347.770726:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1786015347.770738:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500775 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50077c expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015347.770750:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b73819ba200/0xb1a5ef690c500775 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50077c expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786015347.770791:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1786015347.770795:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b74aaa08000 from 52 10000000:01000000:3.0:1786015347.770798:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786015347.770836:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73819bb000/0xb1a5ef690c500783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015347.770844:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b73819bb000/0xb1a5ef690c500783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015347.770868:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b73819bb000/0xb1a5ef690c500783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015347.770904:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304374144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.771093:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.771142:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015347.772466:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304374144 00000100:00100000:1.0:1786015347.772481:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304374144 00000100:00100000:1.0:1786015347.772550:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1786015347.772561:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+14:5792:x1872772304374144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786015347.772591:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015347.772613:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b73813bfc00/0xb1a5ef690c50078a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c500783 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015347.772639:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b73813bfc00/0xb1a5ef690c50078a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c500783 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015347.772651:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b73813bfc00/0xb1a5ef690c50078a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500783 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015347.772660:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bfc00, rc 0) 00000100:00100000:1.0:1786015347.772748:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304374144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015347.772755:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:3.0:1786015347.773842:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304374144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015347.773871:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b73819bb000/0xb1a5ef690c500783 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50078a expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015347.773884:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b73819bb000/0xb1a5ef690c500783 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c50078a expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015347.774064:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304374272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.774120:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.774161:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786015347.777694:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304374272 00000100:00100000:2.0:1786015347.777711:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304374272 00000100:00100000:2.0:1786015347.777792:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1786015347.777806:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304374272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015347.781144:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304374272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3331us (7013us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015347.781161:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:3.0:1786015347.782323:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304374272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.782399:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304374400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.782472:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.782529:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786015347.782617:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304374400 00000100:00100000:0.0:1786015347.782625:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304374400 00000100:00100000:0.0:1786015347.782674:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1786015347.782682:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304374400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015347.782945:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304374400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 263us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015347.782954:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:3.0:1786015347.783715:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304374400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786015347.786189:0:17453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381940000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17453:1872772304374528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786015347.786324:0:17453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015347.786439:0:17453:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786015347.788155:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304374528 00000100:00100000:2.0:1786015347.788179:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304374528 00000100:00100000:2.0:1786015347.788273:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:2.0:1786015347.788286:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:17453:x1872772304374528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015347.789229:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:17453:x1872772304374528:12345-0@lo:502:llog_process_th.0 Request processed in 941us (2899us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015347.789242:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:1.0:1786015347.789629:0:17453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381940000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17453:1872772304374528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786015347.789733:0:17453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381940000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17453:1872772304374656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786015347.789831:0:17453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015347.789912:0:17453:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015347.790268:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304374656 00000100:00100000:0.0:1786015347.790279:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304374656 00000100:00100000:0.0:1786015347.790349:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:0.0:1786015347.790367:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:17453:x1872772304374656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015347.790687:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:17453:x1872772304374656:12345-0@lo:502:llog_process_th.0 Request processed in 321us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015347.790696:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1786015347.791339:0:17453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381940000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17453:1872772304374656:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1786015347.791392:0:17453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1786015347.793060:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1786015347.793124:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786015347.793140:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73819bb000/0xb1a5ef690c500783 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50078a expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015347.793156:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b73819bb000/0xb1a5ef690c500783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c50078a expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786015347.793194:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1786015347.793197:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1786015347.793200:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1786015347.793257:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7480031a00/0xb1a5ef690c500791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015347.793265:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b7480031a00/0xb1a5ef690c500791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015347.793277:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b7480031a00/0xb1a5ef690c500791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015347.793310:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304374784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786015347.793426:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015347.793645:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce1000 going to sleep for 11 seconds 00000100:00100000:2.0:1786015347.793988:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304374784 00000100:00100000:2.0:1786015347.794000:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304374784 00000100:00100000:2.0:1786015347.794058:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:2.0:1786015347.794070:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+15:5792:x1872772304374784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786015347.794104:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015347.794127:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7383906200/0xb1a5ef690c500798 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c500791 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015347.794160:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7383906200/0xb1a5ef690c500798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c500791 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015347.794173:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7383906200/0xb1a5ef690c500798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c500791 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015347.794188:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906200, rc 0) 00000100:00100000:2.0:1786015347.794267:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304374784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015347.794276:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:3.0:1786015347.794415:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304374784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015347.794435:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b7480031a00/0xb1a5ef690c500791 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500798 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015347.794464:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b7480031a00/0xb1a5ef690c500791 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c500798 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015347.794554:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304374912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.794592:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.794637:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015347.794700:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304374912 00000100:00100000:1.0:1786015347.794706:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304374912 00000100:00100000:1.0:1786015347.794794:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:1.0:1786015347.794803:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304374912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786015347.795167:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304374912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 364us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015347.795175:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1786015347.795798:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304374912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.795860:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304375040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.795932:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.795975:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015347.796184:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304375040 00000100:00100000:1.0:1786015347.796192:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304375040 00000100:00100000:1.0:1786015347.796241:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:1.0:1786015347.796251:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304375040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786015347.796988:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304375040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 736us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015347.796997:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:3.0:1786015347.797129:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304375040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786015347.798675:0:17454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:0.0:1786015347.799604:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1786015347.799647:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1786015347.799664:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7480031a00/0xb1a5ef690c500791 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500798 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015347.799679:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b7480031a00/0xb1a5ef690c500791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c500798 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786015347.799693:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1786015347.799697:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8b7483242800 from 52 10000000:01000000:0.0:1786015347.799700:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1786015347.800068:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c50079f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015347.800109:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c50079f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015347.800125:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c50079f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015347.800161:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304375168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786015347.800263:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015347.800383:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce1840 going to sleep for 11 seconds 00000100:00100000:2.0:1786015347.800601:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304375168 00000100:00100000:2.0:1786015347.800612:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304375168 00000100:00100000:2.0:1786015347.800711:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:2.0:1786015347.800724:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+16:5792:x1872772304375168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786015347.800755:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015347.800817:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7383906c00/0xb1a5ef690c5007a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c50079f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015347.800856:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7383906c00/0xb1a5ef690c5007a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c50079f expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015347.800868:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7383906c00/0xb1a5ef690c5007a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c50079f expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015347.800880:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906c00, rc 0) 00000100:00100000:2.0:1786015347.800958:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304375168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015347.800965:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1786015347.801085:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304375168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015347.801108:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c50079f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5007a6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015347.801118:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c50079f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c5007a6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015347.801196:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304375296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.801231:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.806093:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174180 going to sleep for 11 seconds 00000100:00100000:0.0:1786015347.806323:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304375296 00000100:00100000:0.0:1786015347.806346:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304375296 00000100:00100000:0.0:1786015347.806652:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1786015347.806663:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304375296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015347.807339:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304375296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 666us (6095us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015347.807357:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:3.0:1786015347.807696:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304375296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.808144:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304375424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.808222:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.808367:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174180 going to sleep for 11 seconds 00000100:00100000:2.0:1786015347.808555:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304375424 00000100:00100000:2.0:1786015347.808565:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304375424 00000100:00100000:2.0:1786015347.808655:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:2.0:1786015347.808666:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304375424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786015347.808937:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304375424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 273us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015347.808945:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:3.0:1786015347.809033:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304375424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.809677:0:17455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17455:1872772304375552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015347.809735:0:17455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.810130:0:17455:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174480 going to sleep for 11 seconds 00000100:00100000:0.0:1786015347.810310:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304375552 00000100:00100000:0.0:1786015347.810318:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304375552 00000100:00100000:2.0:1786015347.810388:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1786015347.810400:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:17455:x1872772304375552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015347.811182:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:17455:x1872772304375552:12345-0@lo:502:llog_process_th.0 Request processed in 782us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015347.811192:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1786015347.811315:0:17455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17455:1872772304375552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015347.811401:0:17455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17455:1872772304375680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786015347.811456:0:17455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.811835:0:17455:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74812eda80 going to sleep for 11 seconds 00000100:00100000:1.0:1786015347.811991:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304375680 00000100:00100000:1.0:1786015347.811998:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304375680 00000100:00100000:1.0:1786015347.812044:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:1.0:1786015347.812069:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:17455:x1872772304375680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786015347.812320:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:17455:x1872772304375680:12345-0@lo:502:llog_process_th.0 Request processed in 266us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015347.812327:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1786015347.812541:0:17455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17455:1872772304375680:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1786015347.812578:0:17455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1786015347.812959:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1786015347.812991:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786015347.813005:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c50079f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5007a6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015347.813020:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b7480031800/0xb1a5ef690c50079f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5007a6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786015347.813030:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1786015347.813034:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:3.0:1786015347.813037:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1786015347.813073:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c5007ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015347.813096:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c5007ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015347.813108:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c5007ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015347.813131:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304375808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.813179:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.813210:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174480 going to sleep for 11 seconds 00000100:00100000:1.0:1786015347.813293:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304375808 00000100:00100000:1.0:1786015347.813300:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304375808 00000100:00100000:1.0:1786015347.813328:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1786015347.813348:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+17:5792:x1872772304375808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786015347.813544:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015347.813568:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b73813bf200/0xb1a5ef690c5007b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c5007ad expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015347.813598:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b73813bf200/0xb1a5ef690c5007b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c5007ad expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015347.813610:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b73813bf200/0xb1a5ef690c5007b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c5007ad expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015347.813620:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf200, rc 0) 00000100:00100000:1.0:1786015347.813675:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304375808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 328us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015347.813682:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:3.0:1786015347.813820:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304375808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786015347.813836:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c5007ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5007b4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015347.813846:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c5007ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c5007b4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015347.813922:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304375936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.813950:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.813974:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174480 going to sleep for 11 seconds 00000100:00100000:1.0:1786015347.814086:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304375936 00000100:00100000:1.0:1786015347.814102:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304375936 00000100:00100000:1.0:1786015347.814125:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1786015347.814133:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304375936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786015347.814940:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304375936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 802us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015347.814951:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1786015347.815277:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304375936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.815344:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304376064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786015347.815567:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015347.815599:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174480 going to sleep for 11 seconds 00000100:00100000:1.0:1786015347.815998:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304376064 00000100:00100000:1.0:1786015347.816006:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304376064 00000100:00100000:1.0:1786015347.816043:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:1.0:1786015347.816051:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304376064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786015347.817685:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304376064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1624us (2107us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015347.817702:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1786015347.822744:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304376064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015347.830191:0:17456:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17456:1872772304376192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786015347.830332:0:17456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015347.830392:0:17456:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce1000 going to sleep for 11 seconds 00000100:00100000:2.0:1786015347.830532:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304376192 00000100:00100000:2.0:1786015347.830543:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304376192 00000100:00100000:2.0:1786015347.830603:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1786015347.830614:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:17456:x1872772304376192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015347.830983:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:17456:x1872772304376192:12345-0@lo:502:llog_process_th.0 Request processed in 370us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015347.830992:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:0.0:1786015347.831703:0:17456:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17456:1872772304376192:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786015347.831755:0:17456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786015347.831811:0:17456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786015347.831814:0:17456:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre-MDT0000-m del lustre.test_11c 00000020:00000080:0.0:1786015347.831822:0:17456:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1786015347.838534:0:17456:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381941880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17456:1872772304376320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786015347.838737:0:17456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015347.838834:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304376320 00000100:00100000:1.0:1786015347.838839:0:17456:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786015347.838845:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304376320 00000100:00100000:2.0:1786015347.838912:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:2.0:1786015347.838923:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74864ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:17456:x1872772304376320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786015347.839166:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74864ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:17456:x1872772304376320:12345-0@lo:502:llog_process_th.0 Request processed in 244us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015347.839175:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1786015347.839198:0:17456:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381941880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:17456:1872772304376320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786015347.839228:0:17456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786015347.839236:0:17456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786015347.839238:0:17456:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre-MDT0000-m del lustre.test_11c 00000040:00080000:1.0:1786015347.839243:0:17456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:2.0:1786015347.839877:0:5792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:2.0:1786015347.839923:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1786015347.839938:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c5007ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5007b4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015347.839952:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b73819bb200/0xb1a5ef690c5007ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5007b4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786015347.839964:0:5792:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1786015347.839967:0:5792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8b74b00a4d40 from 1 10000000:01000000:2.0:1786015347.839970:0:5792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1786015347.840007:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7383907a00/0xb1a5ef690c5007bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015347.840016:0:5792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff8b7383907a00/0xb1a5ef690c5007bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015347.840027:0:5792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff8b7383907a00/0xb1a5ef690c5007bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015347.840045:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304376448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786015347.840087:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015347.840118:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b00420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015347.840413:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304376448 00000100:00100000:0.0:1786015347.840420:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304376448 00000100:00100000:0.0:1786015347.840516:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:0.0:1786015347.840523:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74864ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+18:5792:x1872772304376448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786015347.840536:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015347.840550:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7480031200/0xb1a5ef690c5007c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1a5ef690c5007bb expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015347.840573:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7480031200/0xb1a5ef690c5007c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1a5ef690c5007bb expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015347.840581:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7480031200/0xb1a5ef690c5007c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1a5ef690c5007bb expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015347.840592:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7480031200, rc 0) 00000100:00100000:0.0:1786015347.840648:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74864ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:5792:x1872772304376448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015347.840655:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1786015347.840687:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304376448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786015347.840703:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff8b7383907a00/0xb1a5ef690c5007bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5007c2 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015347.840713:0:5792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff8b7383907a00/0xb1a5ef690c5007bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1a5ef690c5007c2 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015347.840815:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381941880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304376576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786015347.840846:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015347.840876:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786015347.840932:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304376576 00000100:00100000:2.0:1786015347.840937:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304376576 00000100:00100000:2.0:1786015347.840968:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:2.0:1786015347.840992:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:5792:x1872772304376576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015347.841243:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:5792:x1872772304376576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (396us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786015347.841251:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:1.0:1786015347.841271:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381941880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:5792:1872772304376576:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1786015347.841308:0:5792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1786015347.841315:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff8b7383907a00/0xb1a5ef690c5007bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5007c2 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015347.841323:0:5792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff8b7383907a00/0xb1a5ef690c5007bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1a5ef690c5007c2 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015347.885126:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304376704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015347.885254:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015347.885536:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304376704 00000100:00100000:2.0:1786015347.885549:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304376704 00000100:00100000:2.0:1786015347.885678:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1786015347.885692:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304376704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015347.885743:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015347.885838:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304376704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015347.885847:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1786015347.885947:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304376704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015348.222726:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015348.223400:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280382976 00000100:00100000:0.0:1786015348.223412:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280382976 00000100:00100000:0.0:1786015348.223485:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 531 00000100:00100000:0.0:1786015348.223496:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+10:5571:x1872772280382976:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786015348.223514:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015348.223534:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7480030400/0xb1a5ef690c5007c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e81cd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015348.223572:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7480030400/0xb1a5ef690c5007c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81cd expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015348.224548:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7480030400/0xb1a5ef690c5007c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81cd expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015348.224559:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7480030400, rc 0) 00000100:00100000:0.0:1786015348.224844:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280382976:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 1348us (2124us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015348.224853:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 531 00000100:00100000:0.0:1786015348.236093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015348.237161:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280383104 00000100:00100000:2.0:1786015348.237178:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280383104 00000100:00100000:2.0:1786015348.237252:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 532 00000100:00100000:2.0:1786015348.237262:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280383104:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015348.237662:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280383104:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 399us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015348.237672:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 532 00000100:00100000:1.0:1786015348.243386:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015348.245383:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280383232 00000100:00100000:0.0:1786015348.245400:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280383232 00000100:00100000:0.0:1786015348.245480:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 533 00000100:00100000:0.0:1786015348.245504:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280383232:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786015348.245854:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280383232:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 351us (2477us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015348.245862:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 533 00000100:00100000:1.0:1786015348.289019:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015348.289610:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280383360 00000100:00100000:2.0:1786015348.289624:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280383360 00000100:00100000:2.0:1786015348.289693:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 534 00000100:00100000:2.0:1786015348.289704:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:22990:x1872772280383360:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786015348.290122:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:22990:x1872772280383360:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 418us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015348.290141:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 534 00000100:00100000:1.0:1786015348.301158:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015348.301604:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280383488 00000100:00100000:3.0:1786015348.301619:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280383488 00000100:00100000:3.0:1786015348.301700:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 535 00000100:00100000:3.0:1786015348.301712:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:22990:x1872772280383488:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786015348.302482:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:22990:x1872772280383488:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 767us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015348.302492:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 535 00000100:00100000:1.0:1786015348.312063:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015348.312354:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280383616 00000100:00100000:0.0:1786015348.312366:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280383616 00000100:00100000:0.0:1786015348.312427:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 536 00000100:00100000:0.0:1786015348.312438:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+11:5571:x1872772280383616:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786015348.312454:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015348.312477:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7381934800/0xb1a5ef690c5007d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e81d4 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015348.312508:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7381934800/0xb1a5ef690c5007d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81d4 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015348.312540:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7381934800/0xb1a5ef690c5007d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81d4 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015348.312551:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7381934800, rc 0) 00000100:00100000:0.0:1786015348.312613:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280383616:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 176us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015348.312620:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 536 00000100:00100000:1.0:1786015348.316968:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015348.319374:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280383744 00000100:00100000:2.0:1786015348.319392:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280383744 00000100:00100000:2.0:1786015348.319454:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 537 00000100:00100000:2.0:1786015348.319466:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280383744:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786015348.320006:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280383744:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 540us (3048us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015348.320016:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 537 00000100:00100000:1.0:1786015348.324527:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015348.327624:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280383872 00000100:00100000:3.0:1786015348.327641:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280383872 00000100:00100000:3.0:1786015348.327940:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 538 00000100:00100000:3.0:1786015348.327953:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280383872:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786015348.328258:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280383872:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 306us (3739us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015348.328267:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 538 00000100:00100000:2.0:1786015348.342862:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015348.342990:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280384000 00000100:00100000:3.0:1786015348.343004:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280384000 00000100:00100000:3.0:1786015348.343079:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 539 00000100:00100000:3.0:1786015348.343090:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:22991:x1872772280384000:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786015348.343419:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:22991:x1872772280384000:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 329us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015348.343429:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 539 00000100:00100000:2.0:1786015348.349539:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015348.349669:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280384128 00000100:00100000:3.0:1786015348.349738:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280384128 00000100:00100000:0.0:1786015348.350253:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 540 00000100:00100000:0.0:1786015348.350267:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:22991:x1872772280384128:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786015348.350566:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:22991:x1872772280384128:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 302us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015348.350574:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 540 00000100:00100000:2.0:1786015348.364193:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015348.364644:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280384256 00000100:00100000:1.0:1786015348.364656:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280384256 00000100:00100000:1.0:1786015348.364724:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 541 00000100:00100000:1.0:1786015348.364735:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+12:5571:x1872772280384256:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786015348.364757:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015348.364824:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b73813bea00/0xb1a5ef690c5007d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e81db expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015348.364858:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b73813bea00/0xb1a5ef690c5007d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81db expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015348.364871:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b73813bea00/0xb1a5ef690c5007d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81db expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015348.364893:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bea00, rc 0) 00000100:00100000:1.0:1786015348.365181:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:5571:x1872772280384256:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 446us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015348.365190:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 541 00000100:00100000:1.0:1786015348.392548:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015348.392659:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280384384 00000100:00100000:0.0:1786015348.392670:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280384384 00000100:00100000:0.0:1786015348.392740:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 542 00000100:00100000:0.0:1786015348.392751:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:5571:x1872772280384384:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786015348.393282:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:5571:x1872772280384384:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 531us (744us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786015348.393292:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 542 00010000:00010000:3.0:1786015348.588364:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015349.612093:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015350.638657:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015350.852682:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015350.852810:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015350.852840:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015350.852882:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015350.852901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015350.852915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015350.852936:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015350.852961:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280384768 00000100:00100000:3.0:1786015350.852970:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280384768 00000100:00100000:3.0:1786015350.853025:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280385280 00000100:00100000:3.0:1786015350.853028:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280385280 00000100:00100000:3.0:1786015350.853040:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280384896 00000100:00100000:3.0:1786015350.853048:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280384896 00000100:00100000:3.0:1786015350.853060:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280385152 00000100:00100000:3.0:1786015350.853062:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280385152 00000100:00100000:3.0:1786015350.853074:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 318 00000100:00100000:3.0:1786015350.853083:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280384768:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015350.853158:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280384768:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 76us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015350.853166:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 318 00000100:00100000:3.0:1786015350.853183:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 319 00000100:00100000:3.0:1786015350.853189:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280385280:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015350.853230:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280385280:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 41us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015350.853237:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 319 00000100:00100000:3.0:1786015350.853259:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 320 00000100:00100000:3.0:1786015350.853265:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280384896:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015350.853288:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280384896:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015350.853302:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 320 00000100:00100000:3.0:1786015350.853314:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 321 00000100:00100000:3.0:1786015350.853319:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280385152:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015350.853346:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280385152:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015350.853362:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 321 00000100:00100000:3.0:1786015350.853381:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280385024 00000100:00100000:3.0:1786015350.853385:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280385024 00000100:00100000:3.0:1786015350.853409:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280384640 00000100:00100000:3.0:1786015350.853412:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280384640 00000100:00100000:3.0:1786015350.853429:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 355 00000100:00100000:3.0:1786015350.853434:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+31:2353:x1872772280385024:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015350.853461:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+31:2353:x1872772280385024:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015350.853467:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 355 00000100:00100000:3.0:1786015350.853479:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 356 00000100:00100000:3.0:1786015350.853484:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+74:2353:x1872772280384640:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015350.853507:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+74:2353:x1872772280384640:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015350.853513:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 356 00000100:00080000:3.0:1786015350.853536:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015350.853596:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015350.853599:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015350.858490:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280384512 00000100:00100000:1.0:1786015350.858529:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280384512 00000100:00100000:3.0:1786015350.859559:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 543 00000100:00100000:3.0:1786015350.859576:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280384512:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015350.859685:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280384512:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 114us (7012us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015350.859693:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 543 00000100:00100000:0.0:1786015350.958521:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304376832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015350.958590:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015350.958662:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304376832 00000100:00100000:0.0:1786015350.958670:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304376832 00000100:00100000:0.0:1786015350.958732:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1786015350.958741:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304376832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015350.958800:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015350.958856:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304376832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015350.958875:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:0.0:1786015350.958896:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015350.958932:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304376832:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1786015351.113670:0:17507:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12a: Restore an imported file explicitly ========================================================== 07:22:29 (1786015349) 00000100:00100000:3.0:1786015351.644518:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015351.644825:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280385536 00000100:00100000:1.0:1786015351.644840:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280385536 00000100:00100000:1.0:1786015351.644936:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 746 00000100:00100000:1.0:1786015351.644949:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+31:23182:x1872772280385536:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015351.644981:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015351.645011:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5007de lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e81e2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.646338:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5007e5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.646369:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5007e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.646390:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5007e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015351.646489:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1786015351.648399:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5007de lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81e2 expref: 34 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.648451:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be000/0xb1a5ef690c5007e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81e2 expref: 33 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.648462:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:1.0:1786015351.648465:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786015351.648470:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813be000, rc 0) 00000100:00100000:1.0:1786015351.649081:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+33:23182:x1872772280385536:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 4129us (4570us total) trans 4294967788 rc 0/0 00000100:00100000:1.0:1786015351.649119:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 746 00000100:00100000:2.0:1786015351.660467:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015351.660818:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280385664 00000100:00100000:0.0:1786015351.660834:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280385664 00000100:00100000:0.0:1786015351.660922:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 747 00000100:00100000:0.0:1786015351.660937:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+33:23182:x1872772280385664:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1786015351.661112:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+33:23182:x1872772280385664:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 180us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015351.661122:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 747 00010000:00010000:3.0:1786015351.663358:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015351.704943:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015351.705171:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280385792 00000100:00100000:1.0:1786015351.705185:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280385792 00000100:00100000:1.0:1786015351.705275:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 748 00000100:00100000:1.0:1786015351.705287:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+74:23183:x1872772280385792:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015351.705321:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015351.705349:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5007f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e81e9 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.705441:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5007fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.705459:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5007fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.705472:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5007fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.705487:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500801 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.705494:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.705501:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.705869:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5007fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.705889:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5007fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.705897:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5007fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.705903:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015351.705908:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5007fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.705917:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5007fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.705932:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:1.0:1786015351.705935:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015351.705940:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5007fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.705946:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5007fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.705959:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.705966:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500801 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.705972:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500801 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.705976:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813be200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015351.705983:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500801 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.705990:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500801 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.705996:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b990ec8 (ffff8b7483ee6800) 00010000:00010000:1.0:1786015351.705998:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015351.706001:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500801 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.706006:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c500801 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.706054:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5007f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81e9 expref: 75 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.706064:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:1.0:1786015351.706066:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015351.706070:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5007f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81e9 expref: 75 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.706078:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf600, rc 0) 00000100:00100000:1.0:1786015351.706151:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+74:23183:x1872772280385792:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 865us (1224us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015351.706159:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 748 00000100:00100000:1.0:1786015351.722957:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015351.723177:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280386048 00000100:00100000:2.0:1786015351.723193:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280386048 00000100:00100000:2.0:1786015351.723277:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 749 00000100:00100000:2.0:1786015351.723289:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+74:23183:x1872772280386048:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:2.0:1786015351.723370:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015351.723753:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a0400/0xb1a5ef690c500664 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e818e expref: 74 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015351.724562:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:2.0:1786015351.725055:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015351.727085:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500808 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015351.727118:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c50068e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e819c expref: 32 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015351.727128:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500808 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015351.727186:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c50068e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e819c expref: 32 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015351.727206:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c50068e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e819c expref: 32 pid: 7673 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015351.727227:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304376960:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015351.727385:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486632c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786015351.737473:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015351.739421:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280386176 00000100:00100000:1.0:1786015351.739441:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280386176 00010000:00010000:1.0:1786015351.739514:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c50068e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e819c expref: 33 pid: 7673 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015351.739609:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 244 00000100:00100000:1.0:1786015351.739622:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+33:2353:x1872772280386176:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015351.739643:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015351.739653:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c50068e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e819c expref: 33 pid: 7673 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.739669:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c50068e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e819c expref: 33 pid: 7673 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.739700:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:1.0:1786015351.739706:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500808 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.739718:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500808 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.739727:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500808 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015351.739753:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015351.740648:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+33:2353:x1872772280386176:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1017us (3180us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015351.740660:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 244 00010000:00010000:2.0:1786015351.742698:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c50068e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e819c expref: 32 pid: 7673 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015351.742734:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304376960:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015351.742898:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500808 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015351.742972:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500808 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015351.742980:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500808 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015351.743018:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50080f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015351.743034:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50080f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015351.743057:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50080f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015351.760116:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 512 00010000:00010000:0.0:1786015351.760152:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500808 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015351.760167:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500808 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015351.760176:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500808 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015351.760185:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015351.760191:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500808 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015351.760220:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500808 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015351.760246:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:0.0:1786015351.760250:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015351.760258:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500808 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015351.760265:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500808 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015351.760297:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000daf289f8 reply state 00000000813a6c26 transno 4294967789 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50080f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015351.760308:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015351.765813:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+75:23183:x1872772280386048:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 42473us (42820us total) trans 4294967789 rc 0/0 00000100:00100000:0.0:1786015351.765838:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 749 00010000:00010000:3.0:1786015351.778605:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50080f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015351.778632:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50080f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015351.778640:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50080f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015351.778647:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015351.778654:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50080f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015351.778685:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50080f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015351.778713:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b990ec8 (ffff8b74a04b5e00) 00010000:00010000:3.0:1786015351.778716:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015351.778723:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50080f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015351.778729:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50080f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786015352.172124:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015352.172139:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015352.172713:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015352.172729:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015352.366150:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015352.369727:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280386304 00000100:00100000:1.0:1786015352.369752:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280386304 00000100:00100000:1.0:1786015352.370094:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 750 00000100:00100000:1.0:1786015352.370113:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+74:23220:x1872772280386304:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:1.0:1786015352.370154:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015352.370189:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c500816 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e81f0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.370281:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50081d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.370299:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50081d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.370312:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50081d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015352.370402:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1786015352.370407:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015352.370440:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50081d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.370472:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c500816 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81f0 expref: 76 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.370494:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50081d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81f0 expref: 75 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.370504:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:1.0:1786015352.370507:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015352.370701:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813be200, rc 0) 00000100:00100000:1.0:1786015352.371055:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+75:23220:x1872772280386304:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 947us (4917us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015352.371065:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 750 00000100:00080000:0.0:1786015352.376863:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015352.377734:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015352.377931:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280386560 00000100:00100000:2.0:1786015352.377946:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280386560 00000100:00100000:2.0:1786015352.378032:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 751 00000100:00100000:2.0:1786015352.378045:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+75:23220:x1872772280386560:12345-192.168.202.56@tcp:36:mkdir.0 00010000:00010000:2.0:1786015352.378141:0:12526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015352.378203:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50081d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81f0 expref: 75 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.378227:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:2.0:1786015352.378244:0:12526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015352.378476:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+74:23220:x1872772280386560:12345-192.168.202.56@tcp:36:mkdir.0 Request processed in 433us (751us total) trans 0 rc -17/-17 00000100:00100000:2.0:1786015352.378485:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 751 00000100:00100000:1.0:1786015352.383073:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015352.383552:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280386688 00000100:00100000:0.0:1786015352.383571:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280386688 00000100:00100000:0.0:1786015352.383687:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 752 00000100:00100000:0.0:1786015352.383703:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+74:23220:x1872772280386688:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:0.0:1786015352.383737:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015352.383827:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500824 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e81f7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.383939:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c50082b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.383978:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c50082b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.383992:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c50082b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015352.384080:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1786015352.384085:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015352.384116:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c50082b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.384145:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c500824 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81f7 expref: 76 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.384169:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c50082b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81f7 expref: 75 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.384179:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:0.0:1786015352.384182:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015352.384186:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6000, rc 0) 00000100:00100000:0.0:1786015352.384683:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+75:23220:x1872772280386688:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 931us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015352.384695:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 752 00000100:00100000:1.0:1786015352.388807:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015352.388956:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280386816 00000100:00100000:2.0:1786015352.388976:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280386816 00000100:00100000:2.0:1786015352.389091:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 753 00000100:00100000:2.0:1786015352.389105:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+75:23220:x1872772280386816:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:2.0:1786015352.389138:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015352.389171:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500832 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e81fe expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.389277:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c500839 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.389298:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c500839 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.389315:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c500839 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.389335:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500840 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.389343:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500840 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.389377:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500840 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.389515:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500847 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.389524:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.389532:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015352.389599:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 512 00000004:00200000:2.0:1786015352.389603:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015352.389631:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.389895:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c500839 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.389903:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c500839 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.389910:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c500839 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.389918:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015352.389923:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c500839 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.389932:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c500839 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.389957:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:2.0:1786015352.389961:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015352.389968:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c500839 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.389975:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c500839 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.389993:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500840 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.390000:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500840 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.390007:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500840 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.390012:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015352.390016:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500840 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.390021:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500840 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.390029:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b990ec8 (ffff8b749232d400) 00010000:00010000:2.0:1786015352.390032:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015352.390035:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500840 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.390042:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500840 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.390097:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500832 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81fe expref: 77 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.390114:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500847 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81fe expref: 76 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.390123:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8b749232dd00) 00010000:00010000:2.0:1786015352.390126:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015352.390128:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907600, rc 0) 00000100:00100000:2.0:1786015352.390223:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+76:23220:x1872772280386816:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 1121us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015352.390233:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 753 00000100:00100000:2.0:1786015352.468455:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015352.468564:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280386944 00000100:00100000:0.0:1786015352.468583:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280386944 00000100:00080000:3.0:1786015352.468752:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015352.469422:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 754 00000100:00100000:2.0:1786015352.469443:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+32:23227:x1872772280386944:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015352.469471:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015352.469503:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50084e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8205 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.469596:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500855 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.469612:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500855 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.469627:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500855 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015352.471092:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1786015352.471099:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015352.471136:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500855 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.471258:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50084e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8205 expref: 34 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.471286:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500855 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8205 expref: 33 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015352.471299:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:2.0:1786015352.471302:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015352.471307:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907000, rc 0) 00000100:00100000:2.0:1786015352.471407:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+33:23227:x1872772280386944:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1972us (2965us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015352.471418:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 754 00000100:00100000:1.0:1786015352.479208:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015352.479480:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280387200 00000100:00100000:0.0:1786015352.479493:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280387200 00000100:00100000:0.0:1786015352.479562:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 755 00000100:00100000:0.0:1786015352.479574:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+76:23227:x1872772280387200:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015352.479615:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015352.479618:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786015352.479649:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500847 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81fe expref: 76 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.479670:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8b749232dd00) 00010000:00010000:0.0:1786015352.479690:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015352.479708:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c50085c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e820c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.479904:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500863 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.479918:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500863 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.479933:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500863 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.479948:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50086a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.480739:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50086a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.480751:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50086a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.482462:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500871 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.482492:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.482503:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015352.482517:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 0 00010000:00010000:0.0:1786015352.482547:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500863 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.482554:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500863 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.482561:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500863 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.482567:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e7e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015352.482571:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500863 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.482578:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500863 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.482588:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8b748f24a700) 00010000:00010000:0.0:1786015352.482591:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015352.482594:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500863 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.482600:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500863 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015352.482611:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb16674e reply state 00000000833ec35a transno 4294967790 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50086a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015352.482628:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786015352.482672:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c50085c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e820c expref: 78 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.483443:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500871 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e820c expref: 77 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.483454:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:0.0:1786015352.483456:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015352.483459:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6600, rc 0) 00000100:00100000:0.0:1786015352.483579:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+78:23227:x1872772280387200:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 4006us (4384us total) trans 4294967790 rc 0/0 00000100:00100000:0.0:1786015352.483589:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 755 00000100:00100000:0.0:1786015352.489659:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:1.0:1786015352.489802:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50086a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.489816:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50086a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.489824:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50086a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.489830:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015352.489835:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50086a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.489853:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50086a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.489872:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x3b61a3c9 (ffff8b748f24a000) 00010000:00010000:1.0:1786015352.489875:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015352.489880:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50086a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.489886:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50086a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015352.490218:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280387456 00000100:00100000:3.0:1786015352.490230:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280387456 00000100:00100000:3.0:1786015352.490286:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 756 00000100:00100000:3.0:1786015352.490297:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+77:23227:x1872772280387456:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015352.490327:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015352.490347:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50087f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8213 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.490451:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500886 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.490465:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500871 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e820c expref: 78 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.490474:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500886 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.490516:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500871 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e820c expref: 78 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.490530:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500871 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e820c expref: 78 pid: 5794 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015352.490545:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304377088:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015352.490895:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174480 going to sleep for 11 seconds 00000100:00100000:3.0:1786015352.494492:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304377472:0@lo:400:kworker.0 00000100:00100000:3.0:1786015352.494567:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015352.494638:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786015352.494646:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304377600:0@lo:400:kworker.0 00000100:00100000:3.0:1786015352.494697:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015352.494751:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304377600 00000100:00100000:3.0:1786015352.494784:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304377600 00000100:00100000:3.0:1786015352.494863:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1786015352.494876:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304377600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015352.494936:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304377600:12345-0@lo:400:kworker.0 Request processed in 64us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015352.494956:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:3.0:1786015352.494981:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015352.495021:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304377600:0@lo:400:kworker.0 00000100:00100000:3.0:1786015352.495281:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304377472 00000100:00100000:3.0:1786015352.495287:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304377472 00000100:00100000:3.0:1786015352.495333:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1786015352.495340:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304377472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015352.495399:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304377472:12345-0@lo:400:kworker.0 Request processed in 60us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015352.495407:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00080000:3.0:1786015352.495423:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015352.495440:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304377472:0@lo:400:kworker.0 00000100:00100000:0.0:1786015352.495840:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304377216:0@lo:400:kworker.0 00000100:00100000:0.0:1786015352.495895:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015352.495946:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304377728:0@lo:400:kworker.0 00000100:00100000:0.0:1786015352.495975:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015352.496155:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786015352.496166:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304377344:0@lo:400:kworker.0 00000100:00100000:0.0:1786015352.496194:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015352.496211:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304377856:0@lo:400:kworker.0 00000100:00100000:0.0:1786015352.496234:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015352.496266:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304377856 00000100:00100000:0.0:1786015352.496272:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304377856 00000100:00100000:0.0:1786015352.496323:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1786015352.496330:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304377856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015352.496374:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304377856:12345-0@lo:400:kworker.0 Request processed in 45us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015352.496380:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:0.0:1786015352.496400:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015352.496419:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304377856:0@lo:400:kworker.0 00000100:00100000:0.0:1786015352.496439:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304377728 00000100:00100000:0.0:1786015352.496442:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304377728 00000100:00080000:0.0:1786015352.496457:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015352.496476:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304377344 00000100:00100000:0.0:1786015352.496479:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304377344 00000100:00100000:0.0:1786015352.496498:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1786015352.496504:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304377728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015352.496539:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304377728:12345-0@lo:400:kworker.0 Request processed in 35us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015352.496545:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1786015352.496558:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1786015352.496564:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304377344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015352.496591:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304377344:12345-0@lo:400:kworker.0 Request processed in 28us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015352.496596:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1786015352.496620:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304377344:0@lo:400:kworker.0 00000100:00100000:0.0:1786015352.496631:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304377728:0@lo:400:kworker.0 00000100:00100000:3.0:1786015352.497232:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304377216 00000100:00100000:3.0:1786015352.497240:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304377216 00000100:00100000:3.0:1786015352.497282:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1786015352.497290:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304377216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015352.497344:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304377216:12345-0@lo:400:kworker.0 Request processed in 53us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015352.497350:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:0.0:1786015352.497572:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304377216:0@lo:400:kworker.0 00000100:00100000:0.0:1786015352.499357:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015352.499463:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304377088:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015352.499496:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500886 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015352.499559:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280387584 00000100:00100000:1.0:1786015352.499565:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280387584 00010000:00010000:1.0:1786015352.499605:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500871 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e820c expref: 79 pid: 5794 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015352.499645:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 245 00000100:00100000:1.0:1786015352.499653:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+79:2354:x1872772280387584:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015352.499668:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015352.499677:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500871 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e820c expref: 79 pid: 5794 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.500282:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500871 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e820c expref: 79 pid: 5794 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.500306:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500871 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e820c expref: 79 pid: 5794 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.500322:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:1.0:1786015352.500327:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500886 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.500337:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500886 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.500344:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500886 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.500449:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015352.500560:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500886 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.500567:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500886 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015352.500586:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 0 00000100:00100000:0.0:1786015352.500946:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+78:2354:x1872772280387584:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1282us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015352.500956:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 245 00010000:00010000:3.0:1786015352.501369:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500886 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.501379:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500886 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.501405:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500886 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.501411:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819baa00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015352.501414:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500886 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.501422:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500886 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.501432:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:3.0:1786015352.501436:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015352.501439:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500886 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.501446:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c500886 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.501507:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50087f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8213 expref: 78 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.501516:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8b74a04b5e00) 00010000:00010000:3.0:1786015352.501519:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786015352.501522:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c50087f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8213 expref: 78 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.501535:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb800, rc 0) 00000100:00100000:3.0:1786015352.501574:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+77:23227:x1872772280387456:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 11279us (11928us total) trans 4294967791 rc 301/301 00000100:00100000:3.0:1786015352.501592:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 756 00000100:00100000:2.0:1786015352.505492:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015352.505585:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280387840 00000100:00100000:1.0:1786015352.505611:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280387840 00000100:00100000:1.0:1786015352.505823:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 154 00000100:00100000:1.0:1786015352.505835:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+77:23227:x1872772280387840:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015352.506424:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+78:23227:x1872772280387840:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 588us (939us total) trans 4294967792 rc 0/0 00000100:00100000:1.0:1786015352.506433:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 154 00000100:00100000:0.0:1786015352.509700:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015352.512280:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280387968 00000100:00100000:3.0:1786015352.512299:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280387968 00000100:00100000:3.0:1786015352.512396:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 757 00000100:00100000:3.0:1786015352.512408:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+78:23227:x1872772280387968:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015352.512441:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015352.512501:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c500894 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e821a expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.512579:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c500894 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e821a expref: 79 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.512597:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c500894 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e821a expref: 79 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.512622:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b74a04b5300) 00010000:00010000:3.0:1786015352.512626:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015352.512630:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd000, rc 0) 00000100:00100000:3.0:1786015352.512710:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+79:23227:x1872772280387968:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 304us (3022us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015352.512719:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 757 00000100:00100000:1.0:1786015352.515942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015352.516063:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280388224 00000100:00100000:3.0:1786015352.516073:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280388224 00000100:00100000:3.0:1786015352.516131:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 758 00000100:00100000:3.0:1786015352.516141:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+79:23227:x1872772280388224:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1786015352.516210:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c50089b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.516238:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c50089b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.516251:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c50089b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.516492:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c50089b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.516500:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c50089b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.516507:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c50089b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.516513:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015352.516518:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c50089b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.516526:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c50089b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.516538:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b74a04b5300) 00010000:00010000:3.0:1786015352.516541:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1786015352.516545:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c50089b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.516551:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c50089b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015352.516634:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+80:23227:x1872772280388224:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 494us (712us total) trans 4294967793 rc 0/0 00000100:00100000:3.0:1786015352.516650:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 758 00000100:00100000:2.0:1786015352.519961:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015352.520065:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280388480 00000100:00100000:3.0:1786015352.520075:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280388480 00000100:00100000:3.0:1786015352.520142:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 759 00000100:00100000:3.0:1786015352.520152:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+80:23227:x1872772280388480:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786015352.520452:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c5008a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.520472:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c5008a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.520485:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c5008a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786015352.520559:0:12526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967794 00000004:00010000:3.0:1786015352.520604:0:12526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009bc53aec reply state 0000000004fe8d6a transno 4294967795 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c5008a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015352.520615:0:12526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015352.520725:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+83:23227:x1872772280388480:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 573us (776us total) trans 4294967795 rc 0/0 00000100:00100000:3.0:1786015352.520734:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 759 00000020:00080000:3.0:1786015352.520739:0:12526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786015352.523374:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c5008a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.523393:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c5008a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.523400:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c5008a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.523421:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015352.523426:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c5008a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.523435:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c5008a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.523452:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b74a04b5300) 00010000:00010000:3.0:1786015352.523455:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786015352.523461:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c5008a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015352.523478:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c5008a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015352.525862:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015352.526168:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280388736 00000100:00100000:3.0:1786015352.526182:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280388736 00000100:00100000:3.0:1786015352.526258:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 155 00000100:00100000:3.0:1786015352.526269:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916b6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+82:23227:x1872772280388736:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786015352.526538:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916b6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+83:23227:x1872772280388736:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 270us (694us total) trans 4294967796 rc 0/0 00000100:00100000:3.0:1786015352.526547:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 155 00000100:00100000:2.0:1786015352.560333:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015352.560455:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280388864 00000100:00100000:1.0:1786015352.560467:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280388864 00000100:00100000:1.0:1786015352.560585:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 760 00000100:00100000:1.0:1786015352.560596:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+33:23230:x1872772280388864:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015352.560623:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015352.560657:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5008a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8221 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.560738:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5008b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.560752:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5008b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.560809:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5008b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.560825:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5008b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.560832:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5008b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.560867:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5008b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.560989:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5008be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.560998:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5008be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.561005:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5008be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015352.561053:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 512 00000004:00200000:1.0:1786015352.561057:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015352.561080:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5008be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.561094:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5008b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.561101:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5008b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.561108:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5008b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.561115:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015352.561119:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5008b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.561127:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5008b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.561145:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:1.0:1786015352.561149:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015352.561154:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5008b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.561160:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5008b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.561173:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5008b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.561180:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5008b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.561186:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5008b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.561191:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bec00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015352.561194:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5008b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.561200:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5008b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.561207:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b990ec8 (ffff8b7483ee6900) 00010000:00010000:1.0:1786015352.561209:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015352.561211:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5008b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.561217:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5008b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.561256:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5008a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8221 expref: 35 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.561270:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfa00/0xb1a5ef690c5008be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8221 expref: 34 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.561278:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8b7483ee6000) 00010000:00010000:1.0:1786015352.561281:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1786015352.561283:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bfa00, rc 0) 00000100:00100000:1.0:1786015352.561606:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+34:23230:x1872772280388864:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1010us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015352.561615:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 760 00000100:00100000:0.0:1786015352.566037:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015352.566117:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280389120 00000100:00100000:1.0:1786015352.566129:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280389120 00000100:00100000:1.0:1786015352.566194:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 761 00000100:00100000:1.0:1786015352.566204:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+34:23230:x1872772280389120:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015352.566231:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015352.566255:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c5008c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8228 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566334:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5008cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566349:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5008cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566362:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5008cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566396:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5008d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566404:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5008d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566411:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5008d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566544:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5008da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566553:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5008da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566560:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5008da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015352.566571:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 158 00010000:00010000:1.0:1786015352.566677:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5008cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566699:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5008cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566707:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5008cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566713:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015352.566718:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5008cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566736:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5008cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566750:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8b7483ee6000) 00010000:00010000:1.0:1786015352.566753:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015352.566758:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5008cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566813:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5008cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566826:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5008d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566832:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5008d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566837:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5008d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566841:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2179200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015352.566853:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5008d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566861:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5008d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566869:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x3b61a3c9 (ffff8b7483ee6100) 00010000:00010000:1.0:1786015352.566871:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015352.566875:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5008d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566890:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5008d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566935:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c5008c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8228 expref: 37 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566948:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5008da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8228 expref: 36 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.566955:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b74a04b5300) 00010000:00010000:1.0:1786015352.566958:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015352.566960:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2178c00, rc 0) 00000100:00100000:1.0:1786015352.567036:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+36:23230:x1872772280389120:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 832us (1023us total) trans 4294967797 rc 0/0 00000100:00100000:1.0:1786015352.567043:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 761 00000100:00100000:2.0:1786015352.573148:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015352.573291:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280389248 00000100:00100000:0.0:1786015352.573302:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280389248 00000100:00100000:0.0:1786015352.573365:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 762 00000100:00100000:0.0:1786015352.573376:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+36:23230:x1872772280389248:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:0.0:1786015352.573458:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5008e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.573476:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5008e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.573489:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5008e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.573516:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5008e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.573523:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5008e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.573530:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5008e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.573542:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e7000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015352.573563:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5008e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.573570:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5008e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.573583:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b74a04b5300) 00010000:00010000:0.0:1786015352.573586:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015352.573591:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5008e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.573598:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5008e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015352.573687:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+36:23230:x1872772280389248:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 303us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015352.573695:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 762 00000100:00100000:2.0:1786015352.592213:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015352.592436:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280389504 00000100:00100000:3.0:1786015352.592446:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280389504 00000100:00100000:3.0:1786015352.592522:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 156 00000100:00100000:3.0:1786015352.592533:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+36:23230:x1872772280389504:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:3.0:1786015352.592929:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+37:23230:x1872772280389504:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 397us (728us total) trans 4294967798 rc 0/0 00000100:00100000:3.0:1786015352.593137:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 156 00010000:00010000:3.0:1786015352.684133:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015352.696863:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015352.697040:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280389632 00000100:00100000:0.0:1786015352.697050:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280389632 00000100:00100000:0.0:1786015352.697109:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 763 00000100:00100000:0.0:1786015352.697119:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+37:23238:x1872772280389632:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015352.697148:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015352.697174:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5008ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e822f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.697253:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5008f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.697269:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5008f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.697302:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5008f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015352.697358:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 512 00000004:00200000:0.0:1786015352.697362:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015352.697385:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5008f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.697413:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5008ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e822f expref: 39 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.697433:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5008f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e822f expref: 38 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.697442:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8b7483ee6000) 00010000:00010000:0.0:1786015352.697445:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015352.697449:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6800, rc 0) 00000100:00100000:0.0:1786015352.697528:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+38:23238:x1872772280389632:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 411us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015352.697536:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 763 00000100:00100000:2.0:1786015352.717987:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015352.722348:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280389888 00000100:00100000:1.0:1786015352.722365:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280389888 00000100:00100000:1.0:1786015352.722449:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:1.0:1786015352.722458:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+38:23238:x1872772280389888:12345-192.168.202.56@tcp:103:lfs.0 00010000:00010000:1.0:1786015352.722474:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015352.722498:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5008da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8228 expref: 38 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.722521:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b74a04b5300) 00010000:00010000:1.0:1786015352.722525:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015352.722592:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+37:23238:x1872772280389888:12345-192.168.202.56@tcp:103:lfs.0 Request processed in 136us (4618us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015352.722601:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:2.0:1786015352.728375:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015352.728470:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280390016 00000100:00100000:0.0:1786015352.728481:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280390016 00000100:00100000:0.0:1786015352.728543:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 764 00000100:00100000:0.0:1786015352.728553:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+37:23238:x1872772280390016:12345-192.168.202.56@tcp:58:lfs.0 00010000:00010000:0.0:1786015352.728654:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5008fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.728673:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c500894 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e821a expref: 82 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.728697:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5008fd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.728736:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c500894 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e821a expref: 82 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.728749:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c500894 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e821a expref: 82 pid: 5796 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015352.728791:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304377984:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015352.728895:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359240 going to sleep for 11 seconds 00000100:00100000:0.0:1786015352.734853:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015352.734962:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304377984:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015352.734993:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5008fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015352.735206:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280390144 00000100:00100000:1.0:1786015352.735214:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280390144 00010000:00010000:1.0:1786015352.735253:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c500894 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e821a expref: 83 pid: 5796 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015352.735293:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 246 00000100:00100000:1.0:1786015352.735303:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+83:2354:x1872772280390144:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015352.735320:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015352.735327:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c500894 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e821a expref: 83 pid: 5796 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.735340:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c500894 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e821a expref: 83 pid: 5796 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.735365:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c500894 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e821a expref: 83 pid: 5796 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.735381:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b74a04b5300) 00010000:00010000:1.0:1786015352.735386:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5008fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.735396:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5008fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.735404:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5008fd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015352.735447:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015352.735499:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+82:2354:x1872772280390144:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 197us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015352.735507:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 246 00010000:00010000:0.0:1786015352.735793:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5008fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015352.735802:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5008fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786015352.736069:0:12526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].18, 136 off10640 00000100:00100000:0.0:1786015352.736141:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+37:23238:x1872772280390016:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 7588us (7774us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015352.736152:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 764 00000100:00100000:2.0:1786015353.004298:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786015353.004321:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304378112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015353.004409:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015353.004480:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304378112 00000100:00100000:2.0:1786015353.004487:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304378112 00000100:00100000:2.0:1786015353.004533:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1786015353.004542:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304378112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015353.004580:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015353.004627:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304378112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015353.004634:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1786015353.004678:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304378112:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1786015353.198237:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015353.198253:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015353.198304:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 19 count 2 00000040:00080000:1.0:1786015353.198316:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015353.198498:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381941500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304378240:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015353.198650:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786015353.203581:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381941500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304378240:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786015353.204185:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015353.204278:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280390272 00000100:00100000:3.0:1786015353.204290:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280390272 00000100:00100000:3.0:1786015353.204360:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 765 00000100:00100000:3.0:1786015353.204374:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+37:23248:x1872772280390272:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015353.204435:0:7673:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015353.204583:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+37:23248:x1872772280390272:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 212us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015353.204591:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 765 00000100:00100000:0.0:1786015353.214656:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015353.214827:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280390400 00000100:00100000:1.0:1786015353.214853:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280390400 00000100:00100000:1.0:1786015353.214945:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 766 00000100:00100000:1.0:1786015353.214958:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+37:23248:x1872772280390400:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1786015353.215080:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500904 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.215103:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500904 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.215122:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500904 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.217906:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50090b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.217940:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50090b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219088:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50090b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219172:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500912 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219184:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500912 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219193:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500912 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015353.219262:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 158 00000004:00200000:1.0:1786015353.219269:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015353.219289:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500912 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219305:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500904 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219312:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500904 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219320:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500904 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219327:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015353.219332:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500904 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219341:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500904 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219375:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:1.0:1786015353.219379:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015353.219384:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500904 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219391:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500904 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219416:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50090b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219422:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50090b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219428:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50090b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219434:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2179200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015353.219437:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50090b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219443:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50090b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219450:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x43be2ce7 (ffff8b7483ee6a00) 00010000:00010000:1.0:1786015353.219452:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015353.219456:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50090b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219461:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50090b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219491:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500912 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219498:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500912 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219504:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500912 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219510:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015353.219513:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500912 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219520:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500912 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219528:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b74a04b5300) 00010000:00010000:1.0:1786015353.219530:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015353.219533:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500912 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.219540:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500912 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015353.219675:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+37:23248:x1872772280390400:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 4713us (5027us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015353.219688:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 766 00000100:00100000:2.0:1786015353.228363:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015353.229575:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280390656 00000100:00100000:0.0:1786015353.229598:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280390656 00000100:00100000:0.0:1786015353.229782:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 767 00000100:00100000:0.0:1786015353.229798:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+37:23248:x1872772280390656:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015353.229862:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015353.229896:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c500919 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8236 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.230057:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500920 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.230076:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.230091:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015353.230106:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 158 00010000:00010000:0.0:1786015353.230246:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.230255:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500920 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.230263:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500920 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.230271:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e7e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015353.230276:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500920 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.230284:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500920 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.230299:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b74a04b5300) 00010000:00010000:0.0:1786015353.230310:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015353.230316:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500920 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.230323:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500920 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.230383:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c500919 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8236 expref: 39 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.230709:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:0.0:1786015353.230713:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015353.230718:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c500919 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8236 expref: 39 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.230731:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e7200, rc 0) 00000100:00100000:0.0:1786015353.230896:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+38:23248:x1872772280390656:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1101us (2548us total) trans 4294967799 rc 301/301 00000100:00100000:0.0:1786015353.230905:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 767 00000100:00100000:2.0:1786015353.236663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015353.236854:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280390784 00000100:00100000:0.0:1786015353.236868:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280390784 00000100:00100000:0.0:1786015353.236955:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 768 00000100:00100000:0.0:1786015353.236966:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+38:23248:x1872772280390784:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015353.237022:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015353.237184:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+38:23248:x1872772280390784:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 219us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015353.237192:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 768 00000100:00100000:2.0:1786015353.248830:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015353.249077:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280391040 00000100:00100000:1.0:1786015353.249092:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280391040 00000100:00100000:1.0:1786015353.249181:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 769 00000100:00100000:1.0:1786015353.249208:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+38:23248:x1872772280391040:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015353.249241:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015353.249245:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786015353.249285:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5008f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e822f expref: 38 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.249309:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8b7483ee6000) 00010000:00010000:1.0:1786015353.249315:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015353.249334:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c50092e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e823d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786015353.250426:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf:0x0], index 0: 0 00010000:00010000:1.0:1786015353.250802:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c500935 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.250822:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c500935 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.250836:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c500935 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.250934:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c50092e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e823d expref: 40 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.250959:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c500935 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e823d expref: 39 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.250967:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:1.0:1786015353.250970:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015353.250982:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2179200, rc 0) 00000100:00100000:1.0:1786015353.251088:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+39:23248:x1872772280391040:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1881us (2271us total) trans 4294967800 rc 0/0 00000100:00100000:1.0:1786015353.251100:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 769 00000100:00100000:2.0:1786015353.262958:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015353.263546:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280391296 00000100:00100000:0.0:1786015353.263570:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280391296 00000100:00100000:0.0:1786015353.263656:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 770 00000100:00100000:0.0:1786015353.263669:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+39:23248:x1872772280391296:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786015353.263755:0:12526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015353.263824:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c500935 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e823d expref: 39 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.263857:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:0.0:1786015353.263871:0:12526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015353.263905:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500943 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.263922:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500943 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.263935:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500943 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.263950:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50094a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0xc9ed151f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.263955:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50094a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xc9ed151f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.263959:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50094a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xc9ed151f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.264568:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500943 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.264576:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500943 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.264588:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500943 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.264593:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e7e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015353.264597:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500943 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.264602:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500943 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.264610:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8b7483ee6000) 00010000:00010000:0.0:1786015353.264612:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015353.264615:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500943 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.264620:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500943 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.264628:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50094a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xc9ed151f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.264633:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50094a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xc9ed151f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.264639:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50094a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xc9ed151f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.264643:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015353.264646:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50094a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xc9ed151f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.264662:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50094a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xc9ed151f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.264670:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0xc9ed151f (ffff8b748f24a700) 00010000:00010000:0.0:1786015353.264673:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015353.264675:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50094a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xc9ed151f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.264682:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c50094a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xc9ed151f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015353.266127:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+38:23248:x1872772280391296:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 2451us (3171us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786015353.266139:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 770 00000100:00100000:1.0:1786015353.277448:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015353.277704:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280391424 00000100:00100000:2.0:1786015353.277720:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280391424 00000100:00100000:2.0:1786015353.277858:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 771 00000100:00100000:2.0:1786015353.277872:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+38:23248:x1872772280391424:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015353.277904:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015353.277937:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500951 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8244 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015353.278259:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500958 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015353.278277:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015353.278312:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015353.278522:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500951 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8244 expref: 40 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015353.278627:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500958 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8244 expref: 39 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015353.278638:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8b749232d400) 00010000:00010000:2.0:1786015353.278642:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015353.278647:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906800, rc 0) 00000100:00100000:2.0:1786015353.278737:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+39:23248:x1872772280391424:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 868us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015353.278745:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 771 00000100:00100000:2.0:1786015353.282339:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015353.282519:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280391680 00000100:00100000:3.0:1786015353.282599:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280391680 00000100:00100000:3.0:1786015353.282675:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 772 00000100:00100000:3.0:1786015353.282685:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+39:23248:x1872772280391680:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786015353.282828:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50095f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.282858:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50095f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.282872:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50095f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786015353.286197:0:7673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8600 00000004:00080000:3.0:1786015353.286220:0:7673:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 588537458299ns, next at 589537455263ns, rc = 0 00000004:00010000:3.0:1786015353.286373:0:7673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000022203a2a reply state 000000001e651b81 transno 4294967801 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50095f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015353.286386:0:7673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015353.286563:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+41:23248:x1872772280391680:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 3874us (4232us total) trans 4294967801 rc 0/0 00000100:00100000:3.0:1786015353.286571:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 772 00010000:00010000:0.0:1786015353.290116:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50095f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.290144:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50095f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.290154:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50095f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.290160:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015353.290167:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50095f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.290175:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50095f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.290215:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8b749232d400) 00010000:00010000:0.0:1786015353.290218:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786015353.290226:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50095f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.290233:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50095f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015353.292830:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015353.293539:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280391808 00000100:00100000:0.0:1786015353.293558:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280391808 00000100:00100000:0.0:1786015353.293656:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 773 00000100:00100000:0.0:1786015353.293671:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+40:23248:x1872772280391808:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015353.293713:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015353.293748:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c500966 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e824b expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.293872:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c500966 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e824b expref: 41 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.293893:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c500966 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e824b expref: 41 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.293919:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8b749232d400) 00010000:00010000:0.0:1786015353.293922:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015353.293928:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6a00, rc 0) 00000100:00100000:0.0:1786015353.294005:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+41:23248:x1872772280391808:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 338us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015353.294023:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 773 00000100:00100000:3.0:1786015353.311754:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015353.311849:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280391936 00000100:00100000:3.0:1786015353.311862:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280391936 00000100:00100000:3.0:1786015353.311940:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 186 00000100:00100000:3.0:1786015353.311954:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280391936:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1786015353.314272:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280391936:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 2304us (2516us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1786015353.314292:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 186 00000100:00080000:3.0:1786015353.314341:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015353.320892:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015353.321104:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280392192 00000100:00100000:1.0:1786015353.321118:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280392192 00000100:00100000:1.0:1786015353.321214:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 157 00000100:00100000:1.0:1786015353.321227:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+41:23248:x1872772280392192:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015353.321585:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+42:23248:x1872772280392192:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 359us (703us total) trans 4294967802 rc 0/0 00000100:00100000:1.0:1786015353.321595:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 157 00000100:00100000:1.0:1786015353.333394:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015353.333462:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280392448 00000100:00100000:1.0:1786015353.333475:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280392448 00000100:00100000:1.0:1786015353.333554:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 774 00000100:00100000:1.0:1786015353.333567:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+42:23248:x1872772280392448:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786015353.333733:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+42:23248:x1872772280392448:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 169us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015353.333742:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 774 00000100:00100000:1.0:1786015353.340127:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015353.340653:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280392576 00000100:00100000:3.0:1786015353.340667:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280392576 00000100:00100000:3.0:1786015353.340739:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 775 00000100:00100000:3.0:1786015353.340750:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+42:23248:x1872772280392576:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015353.340803:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015353.341177:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afde00/0xb1a5ef690c50096d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8252 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.341300:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500974 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.341319:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.341335:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015353.341389:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015353.341416:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.341451:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afde00/0xb1a5ef690c50096d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8252 expref: 44 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.341471:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500974 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8252 expref: 43 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.341481:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8b749232d400) 00010000:00010000:3.0:1786015353.341484:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786015353.341488:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc000, rc 0) 00000100:00100000:3.0:1786015353.343077:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+43:23248:x1872772280392576:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 2308us (2944us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015353.343092:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 775 00000100:00100000:1.0:1786015353.351373:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015353.351534:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280392704 00000100:00100000:3.0:1786015353.351548:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280392704 00000100:00100000:3.0:1786015353.351634:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 187 00000100:00100000:3.0:1786015353.351656:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280392704:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015353.351684:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015353.351713:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c50097b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8259 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015353.351752:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a746e79, blocks: 0x1 00010000:00010000:3.0:1786015353.351812:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=588s v=(0 0) 00010000:00010000:3.0:1786015353.351819:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015353.351832:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c50097b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8259 expref: 10 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.351868:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c50097b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8259 expref: 10 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.351887:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc200, rc 0) 00000100:00100000:3.0:1786015353.351969:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280392704:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 316us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015353.351977:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 187 00000100:00100000:1.0:1786015353.354251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015353.354642:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280392960 00000100:00100000:3.0:1786015353.354655:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280392960 00000100:00100000:3.0:1786015353.354727:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 776 00000100:00100000:3.0:1786015353.354739:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:23248:x1872772280392960:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786015353.354923:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:23248:x1872772280392960:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 186us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015353.354931:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 776 00000100:00100000:1.0:1786015353.357414:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015353.357568:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280393088 00000100:00100000:3.0:1786015353.357584:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280393088 00000100:00100000:3.0:1786015353.357659:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 188 00000100:00100000:3.0:1786015353.357672:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:23248:x1872772280393088:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015353.357700:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015353.357727:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4320011/0xb1a5ef690c500982 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8260 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.357799:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c50097b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8259 expref: 11 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.357810:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015353.357814:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015353.357820:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4320011/0xb1a5ef690c500982 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8260 expref: 11 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.357881:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c50097b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8259 expref: 11 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.357897:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c50097b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8259 expref: 11 pid: 6592 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015353.357915:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304378368:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015353.358044:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482d07840 going to sleep for 11 seconds 00000100:00100000:1.0:1786015353.362630:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304378368:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015353.362681:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c4320011/0xb1a5ef690c500982 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8260 expref: 11 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.362728:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afde00, rc 0) 00000100:00100000:1.0:1786015353.362864:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:23248:x1872772280393088:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 5193us (5465us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015353.362875:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 188 00000100:00100000:1.0:1786015353.373911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015353.374090:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280393216 00000100:00100000:2.0:1786015353.374105:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280393216 00010000:00010000:2.0:1786015353.374165:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c50097b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8259 expref: 11 pid: 6592 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015353.374225:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 247 00000100:00100000:2.0:1786015353.374237:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74865aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280393216:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015353.374261:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015353.374295:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c50097b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8259 expref: 11 pid: 6592 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015353.374333:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c50097b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8259 expref: 11 pid: 6592 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015353.374366:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c50097b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8259 expref: 11 pid: 6592 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015353.374402:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015353.374408:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015353.374419:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4320011/0xb1a5ef690c500982 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8260 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015353.374431:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4320011/0xb1a5ef690c500982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8260 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015353.374490:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c4320011/0xb1a5ef690c500982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8260 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015353.374507:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1221180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5782:1872772304378496:192.168.202.56@tcp:105: 00000100:00100000:2.0:1786015353.374858:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486632c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786015353.383975:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015353.384086:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1221180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5782:1872772304378496:192.168.202.56@tcp:105: 00010000:00010000:3.0:1786015353.384122:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015353.384137:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280393344 00000100:00100000:1.0:1786015353.384147:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280393344 00002000:00100000:1.0:1786015353.384221:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xf:0x0] (0->157) req@ffff8b74c1222a00 x1872772280393344/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:199/0 lens 648/0 e 0 to 0 dl 1786015364 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015353.384234:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c1222a00 with x1872772280393344 ext(0->157) 00002000:00010000:1.0:1786015353.384241:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74c1222a00 00000100:00100000:1.0:1786015353.384280:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:1.0:1786015353.384290:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280393344:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1786015353.384350:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74865aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280393216:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 10114us (10451us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015353.384362:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 247 00000100:00100000:1.0:1786015353.385100:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280393344:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 808us (1144us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1786015353.385110:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 61 00002000:00100000:1.0:1786015353.385118:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xf:0x0] (0->157) req@ffff8b74c1222a00 x1872772280393344/t4294967329(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:199/0 lens 648/448 e 0 to 0 dl 1786015364 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015353.385128:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c1222a00 with x1872772280393344 ext(0->157) 00002000:00010000:1.0:1786015353.385133:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74c1222a00 00000100:00100000:3.0:1786015353.394398:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015353.394751:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280393472 00000100:00100000:0.0:1786015353.394799:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280393472 00000100:00100000:0.0:1786015353.394894:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 777 00000100:00100000:0.0:1786015353.394907:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+43:23248:x1872772280393472:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1786015353.504284:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967799 is committed 00000001:00080000:0.0:1786015353.504313:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967790 is committed 00000001:00080000:0.0:1786015353.504322:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967802 is committed 00000001:00080000:0.0:1786015353.504340:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967792 is committed 00000004:00080000:0.0:1786015353.504351:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:0.0:1786015353.504372:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967796 is committed 00000100:00100000:0.0:1786015353.504611:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304378624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786015353.504708:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015353.504860:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304378624 00000100:00100000:0.0:1786015353.504872:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304378624 00000100:00100000:0.0:1786015353.506112:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1786015353.506134:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304378624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786015353.508445:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+36:23248:x1872772280393472:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 113524us (114046us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015353.508461:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 777 00002000:00010000:0.0:1786015353.509079:0:11384:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1786015353.509084:0:11384:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb mtime from disk: 0 -> 1786015353 00002000:00010000:0.0:1786015353.509087:0:11384:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786015353.509090:0:11384:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb ctime from disk: 1786015353 -> 1786015353 00002000:00010000:0.0:1786015353.509092:0:11384:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1786015353.509162:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304378624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3036us (4451us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1786015353.509172:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000004:00080000:0.0:1786015353.509251:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b74b8c7f100/2, rc 0, transno 4294967330 00000100:00100000:0.0:1786015353.509259:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304378624:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1786015353.528921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015353.528999:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280393600 00000100:00100000:0.0:1786015353.529014:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280393600 00000100:00100000:0.0:1786015353.529085:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 190 00000100:00100000:0.0:1786015353.529095:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280393600:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1786015353.588708:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967330 is committed 00000001:00080000:2.0:1786015353.588739:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967329 is committed 00000100:00100000:2.0:1786015353.588999:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280393600:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 59894us (60081us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015353.589203:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 190 00000100:00100000:3.0:1786015353.611033:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015353.611362:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280393856 00000100:00100000:1.0:1786015353.611377:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280393856 00000100:00100000:1.0:1786015353.611457:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 778 00000100:00100000:1.0:1786015353.611468:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+36:23248:x1872772280393856:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786015353.611546:0:7673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015353.611584:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500974 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8252 expref: 36 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.611607:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8b749232d400) 00010000:00010000:1.0:1786015353.611613:0:7673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015353.611655:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500989 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.611671:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500989 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.611683:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500989 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786015353.612112:0:7673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004eff5e93 reply state 000000000b09531e transno 4294967803 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500989 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015353.612124:0:7673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786015353.612270:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+37:23248:x1872772280393856:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 803us (1256us total) trans 4294967803 rc 0/0 00000100:00100000:1.0:1786015353.612278:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 778 00000100:00100000:3.0:1786015353.621635:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015353.621719:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280393984 00000100:00100000:2.0:1786015353.621735:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280393984 00000100:00100000:2.0:1786015353.621845:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 191 00000100:00100000:2.0:1786015353.621858:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280393984:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1786015353.622244:0:14547:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb size from disk: 158 -> 158 00002000:00010000:2.0:1786015353.622249:0:14547:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb mtime from disk: 1786015353 -> 1536580263 00002000:00010000:2.0:1786015353.622252:0:14547:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb atime from disk: 0 -> 1786014790 00002000:00010000:2.0:1786015353.622255:0:14547:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb ctime from disk: 1786015353 -> 1786015352 00002000:00010000:2.0:1786015353.622257:0:14547:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1786015353.622337:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280393984:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 480us (716us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1786015353.622346:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 191 00010000:00010000:1.0:1786015353.625032:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500989 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.625060:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500989 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.625089:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500989 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.625096:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015353.625103:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500989 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.625113:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500989 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.625137:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8b749232d400) 00010000:00010000:1.0:1786015353.625140:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015353.625146:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500989 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.625153:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500989 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015353.629680:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015353.630221:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280394240 00000100:00100000:3.0:1786015353.630238:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280394240 00000100:00100000:3.0:1786015353.630323:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 779 00000100:00100000:3.0:1786015353.630337:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+36:23248:x1872772280394240:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1786015353.630620:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500990 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.630647:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500958 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8244 expref: 36 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.630659:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500990 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.630722:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500958 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8244 expref: 36 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.630742:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500958 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8244 expref: 36 pid: 5796 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015353.630848:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304378752:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015353.631073:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7490aeb780 going to sleep for 11 seconds 00000100:00100000:3.0:1786015353.634372:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304378752:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015353.634428:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500990 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015353.634509:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015353.634830:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280394368 00000100:00100000:0.0:1786015353.634848:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280394368 00010000:00010000:0.0:1786015353.634900:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500958 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8244 expref: 37 pid: 5796 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015353.634986:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 248 00000100:00100000:0.0:1786015353.634998:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2353:x1872772280394368:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015353.635019:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015353.635033:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500958 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8244 expref: 37 pid: 5796 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.635045:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500958 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8244 expref: 37 pid: 5796 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.635068:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500958 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8244 expref: 37 pid: 5796 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.635084:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8b749232d400) 00010000:00010000:0.0:1786015353.635088:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500990 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.635106:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500990 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.635112:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500990 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.635138:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015353.635165:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500990 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.635172:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500990 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.635209:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500990 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015353.635210:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+36:2353:x1872772280394368:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 213us (958us total) trans 0 rc 0/0 00010000:00010000:3.0:1786015353.635217:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500990 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015353.635218:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 248 00010000:00010000:3.0:1786015353.635223:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500990 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.635229:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015353.635234:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500990 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.635397:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500990 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.635411:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8b749232d400) 00010000:00010000:3.0:1786015353.635414:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1786015353.635419:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500990 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.635425:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500990 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015353.635565:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+35:23248:x1872772280394240:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 5231us (5899us total) trans 0 rc -22/-22 00000100:00100000:3.0:1786015353.635575:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 779 00000100:00100000:2.0:1786015353.639137:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015353.639202:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280394496 00000100:00100000:1.0:1786015353.639216:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280394496 00000100:00100000:1.0:1786015353.639296:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 192 00000100:00100000:1.0:1786015353.639310:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280394496:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015353.639373:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500997 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.639395:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4320011/0xb1a5ef690c500982 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8260 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.639417:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015353.639422:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015353.639426:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500997 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.639473:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4320011/0xb1a5ef690c500982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8260 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.639491:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4320011/0xb1a5ef690c500982 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8260 expref: 10 pid: 14547 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015353.639511:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381940e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304378880:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015353.639619:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d066c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786015353.646368:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015353.646522:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280394624 00000100:00100000:3.0:1786015353.646535:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280394624 00010000:00010000:3.0:1786015353.646603:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4320011/0xb1a5ef690c500982 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8260 expref: 11 pid: 14547 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015353.646713:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 249 00000100:00100000:3.0:1786015353.646726:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280394624:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015353.646751:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015353.646823:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4320011/0xb1a5ef690c500982 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8260 expref: 11 pid: 14547 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.646853:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4320011/0xb1a5ef690c500982 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8260 expref: 11 pid: 14547 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.646901:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015353.646908:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015353.646917:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500997 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.646930:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500997 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.646987:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015353.647198:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4320011/0xb1a5ef690c500982 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8260 expref: 11 pid: 14547 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015353.647217:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381940e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304378880:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015353.647248:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500997 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015353.647261:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280394624:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 536us (910us total) trans 0 rc 0/0 00010000:00010000:0.0:1786015353.647261:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500997 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.647269:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500997 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015353.647270:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 249 00010000:00010000:0.0:1786015353.647301:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500997 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.647324:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500997 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.647333:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500997 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.647342:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178000 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015353.647348:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500997 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.647359:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500997 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.647372:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500997 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.647379:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500997 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015353.647438:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280394496:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 8133us (8318us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015353.647447:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 192 00000100:00100000:2.0:1786015353.650943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015353.651030:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280394880 00000100:00100000:1.0:1786015353.651046:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280394880 00000100:00100000:1.0:1786015353.651137:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 780 00000100:00100000:1.0:1786015353.651149:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+35:23248:x1872772280394880:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786015353.651270:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50099e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.651293:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50099e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.651308:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50099e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.651669:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178600/0xb1a5ef690c5009a5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.651683:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c500966 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e824b expref: 36 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.651691:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178600/0xb1a5ef690c5009a5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.651736:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c500966 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e824b expref: 36 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.651753:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c500966 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e824b expref: 36 pid: 12526 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015353.651810:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381943b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304379008:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015353.651932:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d066c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786015353.661574:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015353.661798:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280395008 00000100:00100000:3.0:1786015353.661812:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280395008 00010000:00010000:3.0:1786015353.661886:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c500966 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e824b expref: 37 pid: 12526 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015353.661949:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 250 00000100:00100000:3.0:1786015353.661962:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2354:x1872772280395008:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015353.661983:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015353.661992:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c500966 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e824b expref: 37 pid: 12526 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.662009:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c500966 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e824b expref: 37 pid: 12526 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.662039:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8b749232d400) 00010000:00010000:3.0:1786015353.662045:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178600/0xb1a5ef690c5009a5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.662057:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178600/0xb1a5ef690c5009a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.662066:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178600/0xb1a5ef690c5009a5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.662109:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015353.662190:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2354:x1872772280395008:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 229us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015353.662198:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 250 00010000:00010000:1.0:1786015353.667708:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c500966 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e824b expref: 36 pid: 12526 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015353.667748:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381943b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304379008:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015353.667847:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178600/0xb1a5ef690c5009a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.667959:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178600/0xb1a5ef690c5009a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.667995:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178600/0xb1a5ef690c5009a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786015353.668289:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967804 00000001:00080000:0.0:1786015353.668486:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967805 00000001:00080000:0.0:1786015353.668668:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967806 00000100:00100000:0.0:1786015353.668826:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5794:1872772304379136:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786015353.668948:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015353.668993:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359600 going to sleep for 11 seconds 00000100:00100000:1.0:1786015353.669380:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304379136 00000100:00100000:1.0:1786015353.669390:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304379136 00000100:00100000:1.0:1786015353.669597:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786015353.669618:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1872772304379136:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1786015353.669745:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1872772304379136:12345-0@lo:1000:mdt00_000.0 Request processed in 129us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015353.669754:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786015353.671516:0:5794:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967330 gen 2 00000004:00080000:0.0:1786015353.671532:0:5794:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b74b8c7f100, transno 4294967330 00000100:00100000:0.0:1786015353.671568:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5794:1872772304379136:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1786015353.672119:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967807 00000100:00100000:0.0:1786015353.672227:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5794:1872772304379264:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786015353.672304:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015353.679734:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74866320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786015353.682159:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304379264 00000100:00100000:2.0:1786015353.682187:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304379264 00000100:00100000:3.0:1786015353.682409:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786015353.682424:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5794:x1872772304379264:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786015353.682918:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5794:x1872772304379264:12345-0@lo:1000:mdt00_000.0 Request processed in 495us (10610us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1786015353.682928:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786015353.683075:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5794:1872772304379264:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1786015353.683143:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178600/0xb1a5ef690c5009a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683156:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178600/0xb1a5ef690c5009a5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683165:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178600/0xb1a5ef690c5009a5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683172:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015353.683178:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178600/0xb1a5ef690c5009a5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683210:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178600/0xb1a5ef690c5009a5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683234:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8b749232d400) 00010000:00010000:0.0:1786015353.683238:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015353.683245:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178600/0xb1a5ef690c5009a5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683251:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178600/0xb1a5ef690c5009a5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683296:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5008fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683303:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5008fd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683309:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5008fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683314:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015353.683317:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5008fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683323:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5008fd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683331:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b74a04b5300) 00010000:00010000:0.0:1786015353.683334:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015353.683337:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5008fd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683353:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5008fd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683383:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5009ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683398:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5009ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683411:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5009ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683419:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5009ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683425:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5009ac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683430:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5009ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683435:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015353.683438:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5009ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683445:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5009ac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683452:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b74a04b5300) 00010000:00010000:0.0:1786015353.683455:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015353.683458:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5009ac lrc: 2/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683470:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5009ac lrc: 0/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683481:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50099e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683487:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50099e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683492:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50099e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683497:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015353.683500:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50099e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683505:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50099e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683514:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b74a04b5300) 00010000:00010000:0.0:1786015353.683516:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015353.683518:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50099e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015353.683523:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50099e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015353.683822:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+39:23248:x1872772280394880:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 32671us (32890us total) trans 4294967808 rc 0/0 00000100:00100000:0.0:1786015353.683848:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 780 00000020:00080000:0.0:1786015353.683861:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1786015353.684387:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015353.684395:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015353.684966:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1786015353.684983:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015353.698001:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015353.698151:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280395264 00000100:00100000:1.0:1786015353.698167:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280395264 00000100:00100000:1.0:1786015353.698272:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 158 00000100:00100000:1.0:1786015353.698283:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+39:23248:x1872772280395264:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1786015353.699172:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x14:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1786015353.699303:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967809 00010000:00010000:1.0:1786015353.699366:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.699388:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.699403:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.699413:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009b3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.699421:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009b3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.699428:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.699459:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786015353.699594:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+41:23248:x1872772280395264:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1309us (1610us total) trans 4294967810 rc 0/0 00000100:00100000:1.0:1786015353.699612:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 158 00000020:00080000:1.0:1786015353.699618:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786015353.699661:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786015353.699668:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009b3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.699676:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178a00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015353.699680:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009b3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.699688:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.699704:0:8308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8b7483ee6900) 00010000:00010000:1.0:1786015353.699707:0:8308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786015353.699713:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009b3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.699719:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009b3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.699739:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015353.699741:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015353.699743:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015353.716913:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015353.851492:0:17558:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015353.851505:0:17558:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015353.851550:0:17558:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 19 count 2 00000040:00080000:1.0:1786015353.851559:0:17558:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015353.959673:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015353.960038:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280395520 00000100:00100000:1.0:1786015353.960052:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280395520 00000100:00100000:1.0:1786015353.960142:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 781 00000100:00100000:1.0:1786015353.960154:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+41:23251:x1872772280395520:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015353.960188:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015353.960216:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c5009ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8267 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.960317:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.960334:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.960350:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.960368:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5009c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.960375:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5009c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.960381:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5009c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.960914:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178600/0xb1a5ef690c5009cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.960924:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178600/0xb1a5ef690c5009cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.960932:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178600/0xb1a5ef690c5009cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015353.960955:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 158 00010000:00010000:1.0:1786015353.961069:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.961077:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.961084:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.961090:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015353.961095:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.961103:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.961116:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8b7483ee6000) 00010000:00010000:1.0:1786015353.961119:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015353.961124:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.961130:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5009c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.961145:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5009c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.961150:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5009c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.961166:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5009c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.961171:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015353.961174:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5009c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.961180:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5009c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.961187:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x3b61a3c9 (ffff8b7483ee6900) 00010000:00010000:1.0:1786015353.961189:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015353.961191:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5009c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.961196:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5009c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.961243:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c5009ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8267 expref: 44 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.961258:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178600/0xb1a5ef690c5009cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8267 expref: 43 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015353.961266:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b7483ee6100) 00010000:00010000:1.0:1786015353.961268:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015353.961270:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2178600, rc 0) 00000100:00100000:1.0:1786015353.961348:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+43:23251:x1872772280395520:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1197us (1689us total) trans 4294967811 rc 0/0 00000100:00100000:1.0:1786015353.961365:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 781 00000100:00100000:0.0:1786015353.966174:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015353.966880:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280395648 00000100:00100000:3.0:1786015353.966895:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280395648 00000100:00100000:3.0:1786015353.969001:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 782 00000100:00100000:3.0:1786015353.969182:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:23251:x1872772280395648:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:3.0:1786015353.969292:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5009dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.969316:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5009dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.969333:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5009dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.969373:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5009dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.969380:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5009dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.969398:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5009dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.969405:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015353.969410:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5009dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.969419:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5009dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.969435:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b7483ee6100) 00010000:00010000:3.0:1786015353.969438:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786015353.969444:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5009dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015353.969451:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5009dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015353.969564:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:23251:x1872772280395648:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 548us (3405us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015353.969574:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 782 00000100:00100000:2.0:1786015353.976738:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015353.976965:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280395904 00000100:00100000:1.0:1786015353.976980:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280395904 00000100:00100000:1.0:1786015353.977231:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 159 00000100:00100000:1.0:1786015353.977244:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+43:23251:x1872772280395904:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:1.0:1786015353.977561:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:23251:x1872772280395904:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 318us (837us total) trans 4294967812 rc 0/0 00000100:00100000:1.0:1786015353.977570:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 159 00000100:00100000:2.0:1786015354.179214:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015354.179346:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280396032 00000100:00100000:0.0:1786015354.179360:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280396032 00000100:00100000:0.0:1786015354.179460:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 783 00000100:00100000:0.0:1786015354.179474:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+74:23267:x1872772280396032:12345-192.168.202.56@tcp:101:diff.0 00010000:00010000:0.0:1786015354.179508:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015354.179536:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5009e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e826e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.179617:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5009eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.179634:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5009eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.179646:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5009eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.179661:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c5009f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.179668:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c5009f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.179674:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c5009f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180259:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5009f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180281:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5009f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180290:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5009f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015354.180387:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 7680 00000004:00200000:0.0:1786015354.180392:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015354.180478:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5009f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180494:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5009eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180502:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5009eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180510:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5009eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180516:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015354.180521:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5009eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180531:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5009eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180546:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:0.0:1786015354.180550:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015354.180555:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5009eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180572:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5009eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180588:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c5009f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180594:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c5009f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180600:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c5009f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180605:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e7200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015354.180609:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c5009f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180615:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c5009f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180623:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b990ec8 (ffff8b748f24a200) 00010000:00010000:0.0:1786015354.180626:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015354.180629:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c5009f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180636:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c5009f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180676:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6800/0xb1a5ef690c5009e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e826e expref: 76 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180692:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7000/0xb1a5ef690c5009f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e826e expref: 75 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.180707:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8b7483ee6000) 00010000:00010000:0.0:1786015354.180710:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786015354.180713:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e7000, rc 0) 00000100:00100000:0.0:1786015354.180854:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+75:23267:x1872772280396032:12345-192.168.202.56@tcp:101:diff.0 Request processed in 1383us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015354.180864:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 783 00000100:00080000:3.0:1786015354.181828:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015354.184154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015354.186011:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280396160 00000100:00100000:3.0:1786015354.186037:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280396160 00000100:00100000:3.0:1786015354.186132:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 784 00000100:00100000:3.0:1786015354.186144:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+75:23267:x1872772280396160:12345-192.168.202.56@tcp:101:diff.0 00010000:00010000:3.0:1786015354.186175:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015354.186205:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500a00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8275 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.186340:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c500a07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.186358:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c500a07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.186373:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c500a07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.186391:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500a0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.186398:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500a0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.186405:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500a0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.186919:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afdc00/0xb1a5ef690c500a15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.186931:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afdc00/0xb1a5ef690c500a15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.186940:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afdc00/0xb1a5ef690c500a15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015354.186988:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 158 00000004:00200000:3.0:1786015354.186994:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015354.187022:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afdc00/0xb1a5ef690c500a15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.187049:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afdc00/0xb1a5ef690c500a15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.187059:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c500a07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.187067:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c500a07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.187074:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c500a07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.187081:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015354.187086:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c500a07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.187096:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c500a07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.187111:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8b7483ee6000) 00010000:00010000:3.0:1786015354.187115:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015354.187120:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c500a07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.187128:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c500a07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.187143:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500a0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.187150:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500a0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.187162:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500a0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.187167:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015354.187170:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500a0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.187176:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500a0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.187185:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x3b61a3c9 (ffff8b74a04b5400) 00010000:00010000:3.0:1786015354.187187:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015354.187190:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500a0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.187196:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500a0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.187236:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500a00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8275 expref: 77 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.187253:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afdc00/0xb1a5ef690c500a15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8275 expref: 76 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.187261:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b7483ee6100) 00010000:00010000:3.0:1786015354.187264:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015354.187267:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afdc00, rc 0) 00000100:00100000:3.0:1786015354.189064:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+76:23267:x1872772280396160:12345-192.168.202.56@tcp:101:diff.0 Request processed in 2902us (4902us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015354.189105:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 784 00000100:00100000:2.0:1786015354.196563:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015354.196657:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280396288 00000100:00100000:0.0:1786015354.196671:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280396288 00000100:00100000:0.0:1786015354.196795:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 193 00000100:00100000:0.0:1786015354.196809:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280396288:12345-192.168.202.56@tcp:101:diff.0 00010000:00010000:0.0:1786015354.196847:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015354.196880:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032923b65/0xb1a5ef690c500a1c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e827c expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015354.196926:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 158, mtime: 0x5b965aa7, atime: 0x6a746c46, ctime: 0x6a746e78, blocks: 0xb 00010000:00010000:0.0:1786015354.196959:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=589s v=(0 0) 00010000:00010000:0.0:1786015354.196964:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015354.196977:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032923b65/0xb1a5ef690c500a1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e827c expref: 11 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.197005:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032923b65/0xb1a5ef690c500a1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e827c expref: 11 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.197024:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6800, rc 0) 00000100:00100000:0.0:1786015354.197136:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+11:2353:x1872772280396288:12345-192.168.202.56@tcp:101:diff.0 Request processed in 330us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015354.197145:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 193 00000100:00080000:3.0:1786015354.197244:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015354.199903:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015354.200023:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280396544 00000100:00100000:3.0:1786015354.200037:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280396544 00000100:00100000:3.0:1786015354.200105:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 785 00000100:00100000:3.0:1786015354.200117:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+76:23267:x1872772280396544:12345-192.168.202.56@tcp:101:diff.0 00010000:00010000:3.0:1786015354.200147:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015354.200176:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c500a23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8283 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.200319:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500a2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.200337:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500a2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.200351:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500a2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015354.200364:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 158 00010000:00010000:3.0:1786015354.200540:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c500a23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8283 expref: 79 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.200565:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500a2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8283 expref: 78 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015354.200575:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b7483ee6100) 00010000:00010000:3.0:1786015354.200577:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015354.200599:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd400, rc 0) 00000100:00100000:3.0:1786015354.200685:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+78:23267:x1872772280396544:12345-192.168.202.56@tcp:101:diff.0 Request processed in 570us (794us total) trans 4294967813 rc 0/0 00000100:00100000:3.0:1786015354.200694:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 785 00000100:00100000:1.0:1786015354.210713:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015354.210811:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015354.210903:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280396672 00000100:00100000:2.0:1786015354.210926:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280396672 00002000:00100000:2.0:1786015354.210994:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xf:0x0] (0->4095) req@ffff8b7381940e00 x1872772280396672/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:200/0 lens 488/0 e 0 to 0 dl 1786015365 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015354.211007:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381940e00 with x1872772280396672 ext(0->4095) 00002000:00010000:2.0:1786015354.211014:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7381940e00 00000100:00100000:2.0:1786015354.211050:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:2.0:1786015354.211060:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41677fca-39fb-471c-b582-96bce6540a36+11:2353:x1872772280396672:12345-192.168.202.56@tcp:3:diff.0 00000100:00100000:2.0:1786015354.211350:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41677fca-39fb-471c-b582-96bce6540a36+11:2353:x1872772280396672:12345-192.168.202.56@tcp:3:diff.0 Request processed in 289us (537us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786015354.211359:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 62 00002000:00100000:2.0:1786015354.211367:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xf:0x0] (0->4095) req@ffff8b7381940e00 x1872772280396672/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:200/0 lens 488/4536 e 0 to 0 dl 1786015365 ref 1 fl Complete:/600/0 rc 4096/4096 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015354.211377:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381940e00 with x1872772280396672 ext(0->4095) 00002000:00010000:2.0:1786015354.211381:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7381940e00 00000100:00100000:0.0:1786015354.212311:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280396800 00000100:00100000:0.0:1786015354.212326:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280396800 00000100:00100000:0.0:1786015354.212400:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 32 00000100:00100000:0.0:1786015354.212411:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+78:2351:x1872772280396800:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015354.212438:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015354.212470:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500a2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8283 expref: 78 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015354.212493:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8b7483ee6100) 00010000:00010000:0.0:1786015354.212499:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015354.212563:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+77:2351:x1872772280396800:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 155us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015354.212570:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 32 00000100:00100000:1.0:1786015354.233589:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015354.238337:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280397056 00000100:00100000:3.0:1786015354.238364:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280397056 00000100:00100000:3.0:1786015354.238569:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 160 00000100:00100000:3.0:1786015354.238583:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+77:23267:x1872772280397056:12345-192.168.202.56@tcp:35:diff.0 00000001:00080000:3.0:1786015354.239098:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967814 00000100:00100000:3.0:1786015354.239314:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+79:23267:x1872772280397056:12345-192.168.202.56@tcp:35:diff.0 Request processed in 731us (5737us total) trans 4294967815 rc 0/0 00000100:00100000:3.0:1786015354.239325:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 160 00000020:00080000:3.0:1786015354.239332:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786015354.732863:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015354.733501:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015354.733511:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015354.733557:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 19 count 2 00000040:00080000:2.0:1786015354.733568:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786015355.760071:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015355.975848:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015355.975899:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015355.975920:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015355.975965:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015355.975988:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015355.976021:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015355.976047:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015355.976075:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280397184 00000100:00100000:3.0:1786015355.976084:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280397184 00000100:00100000:3.0:1786015355.976134:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 545 00000100:00100000:3.0:1786015355.976143:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280397184:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015355.976211:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280397184:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 69us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015355.976472:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 545 00000100:00100000:3.0:1786015355.976517:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280397312 00000100:00100000:3.0:1786015355.976521:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280397312 00000100:00100000:3.0:1786015355.976548:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280397696 00000100:00100000:3.0:1786015355.976550:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280397696 00000100:00100000:3.0:1786015355.976578:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 360 00000100:00100000:3.0:1786015355.976585:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+79:2353:x1872772280397312:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015355.976623:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+79:2353:x1872772280397312:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 39us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015355.976629:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 360 00000100:00100000:3.0:1786015355.976641:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 361 00000100:00100000:3.0:1786015355.976648:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2353:x1872772280397696:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015355.976674:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2353:x1872772280397696:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015355.976681:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 361 00000100:00080000:3.0:1786015355.976704:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015355.976802:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280397568 00000100:00100000:0.0:1786015355.976808:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280397568 00000100:00100000:0.0:1786015355.976861:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280397824 00000100:00100000:0.0:1786015355.976865:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280397824 00000100:00100000:0.0:1786015355.976881:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280397440 00000100:00100000:0.0:1786015355.976883:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280397440 00000100:00100000:0.0:1786015355.976894:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280397952 00000100:00100000:0.0:1786015355.976896:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280397952 00000100:00100000:0.0:1786015355.976908:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 324 00000100:00100000:0.0:1786015355.976914:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280397568:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015355.976942:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+10:2353:x1872772280397568:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015355.976958:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 324 00000100:00100000:0.0:1786015355.976973:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 325 00000100:00100000:0.0:1786015355.976978:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280397824:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015355.977019:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280397824:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 40us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015355.977024:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 325 00000100:00100000:0.0:1786015355.977035:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 326 00000100:00100000:0.0:1786015355.977041:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+11:2353:x1872772280397440:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015355.977059:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+11:2353:x1872772280397440:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 19us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015355.977063:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 326 00000100:00100000:0.0:1786015355.977074:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 327 00000100:00100000:0.0:1786015355.977079:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280397952:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015355.977099:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280397952:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 19us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015355.977105:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 327 00000100:00080000:3.0:1786015355.978786:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786015355.978796:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015356.076553:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786015356.076577:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304379392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015356.076658:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015356.076793:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304379392 00000100:00100000:0.0:1786015356.076801:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304379392 00000100:00100000:0.0:1786015356.076865:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1786015356.076874:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304379392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015356.076907:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64684032 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015356.076956:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304379392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015356.076979:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1786015356.077100:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304379392:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786015356.077429:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786015356.784080:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015357.613930:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b748825ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304379904:0@lo:400:kworker.0 00000100:00100000:3.0:1786015357.614033:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015357.614110:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786015357.614117:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304379520:0@lo:400:kworker.0 00000100:00100000:3.0:1786015357.614147:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015357.614184:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304380032:0@lo:400:kworker.0 00000100:00100000:3.0:1786015357.614228:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015357.614265:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304379904 00000100:00100000:3.0:1786015357.614273:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304379904 00000100:00100000:3.0:1786015357.614321:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1786015357.614330:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304379904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015357.614385:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304379904:12345-0@lo:400:kworker.0 Request processed in 56us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015357.614392:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1786015357.614420:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304380032 00000100:00100000:3.0:1786015357.614423:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304380032 00000100:00100000:3.0:1786015357.614455:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1786015357.614461:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304380032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015357.614492:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304380032:12345-0@lo:400:kworker.0 Request processed in 32us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015357.614499:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00080000:3.0:1786015357.614519:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015357.615164:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304380032:0@lo:400:kworker.0 00000100:00100000:3.0:1786015357.615179:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b748825ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304379904:0@lo:400:kworker.0 00000100:00100000:0.0:1786015357.618309:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304379648:0@lo:400:kworker.0 00000100:00100000:0.0:1786015357.618393:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015357.618430:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304380160:0@lo:400:kworker.0 00000100:00100000:0.0:1786015357.618456:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015357.618485:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786015357.618492:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304379776:0@lo:400:kworker.0 00000100:00100000:0.0:1786015357.618515:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015357.618552:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304379520 00000100:00100000:0.0:1786015357.618560:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304379520 00000100:00100000:0.0:1786015357.618607:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1786015357.618615:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304379520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015357.618669:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304379520:12345-0@lo:400:kworker.0 Request processed in 54us (4520us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015357.618676:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1786015357.618711:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304380160 00000100:00100000:0.0:1786015357.618714:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304380160 00000100:00100000:0.0:1786015357.618750:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1786015357.618758:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304380160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015357.618852:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304380160:12345-0@lo:400:kworker.0 Request processed in 95us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015357.618859:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1786015357.618898:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304380160:0@lo:400:kworker.0 00000100:00100000:3.0:1786015357.619607:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304379648 00000100:00100000:3.0:1786015357.619615:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304379648 00000100:00100000:3.0:1786015357.619660:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304379776 00000100:00100000:3.0:1786015357.619664:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304379776 00000100:00100000:3.0:1786015357.619690:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1786015357.619698:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304379648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015357.619783:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304379648:12345-0@lo:400:kworker.0 Request processed in 63us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015357.619820:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1786015357.619837:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1786015357.619843:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304379776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015357.619876:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304379776:12345-0@lo:400:kworker.0 Request processed in 32us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015357.619882:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1786015357.619923:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304379776:0@lo:400:kworker.0 00000100:00100000:3.0:1786015357.619936:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304379648:0@lo:400:kworker.0 00000100:00080000:3.0:1786015357.620243:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015357.620251:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015357.620282:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304379520:0@lo:400:kworker.0 00010000:00010000:0.0:1786015357.804113:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015358.125240:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786015358.125276:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304380288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015358.125357:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015358.125451:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304380288 00000100:00100000:3.0:1786015358.125460:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304380288 00000100:00100000:3.0:1786015358.125515:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1786015358.125525:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304380288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015358.125567:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015358.125615:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304380288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015358.125622:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1786015358.125680:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304380288:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1786015358.710901:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967331 is committed 00000001:00080000:1.0:1786015358.710919:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967332 is committed 00000001:00080000:1.0:1786015358.716488:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967808 is committed 00000020:00080000:1.0:1786015358.716501:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b74b0174480 refcount 2 committed 0 result 0 batchid 11 00000020:00080000:1.0:1786015358.716505:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b73848b5b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b7495d4fe40 00000020:00080000:1.0:1786015358.716509:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b73848b5a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74c11bfc00 00000020:00080000:3.0:1786015358.716549:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 11 committed batchid 10 00000020:00080000:3.0:1786015358.716830:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 10 00000001:00080000:1.0:1786015358.717348:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967812 is committed 00000001:00080000:1.0:1786015358.717464:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967815 is committed 00010000:00010000:3.0:1786015358.827855:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015359.715498:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015359.715694:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280398080 00000100:00100000:3.0:1786015359.715706:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280398080 00000100:00100000:3.0:1786015359.716006:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 786 00000100:00100000:3.0:1786015359.716017:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+34:23182:x1872772280398080:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1786015359.716134:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+34:23182:x1872772280398080:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 119us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015359.716142:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 786 00000100:00080000:0.0:1786015359.716636:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786015359.852170:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015360.880552:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015361.090560:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015361.090604:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015361.090639:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015361.090681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015361.090700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015361.090732:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015361.090788:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015361.090914:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280398208 00000100:00100000:0.0:1786015361.090926:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280398208 00000100:00100000:0.0:1786015361.090986:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 547 00000100:00100000:0.0:1786015361.090996:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280398208:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015361.091071:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280398208:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 77us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015361.091078:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 547 00000100:00100000:1.0:1786015361.091188:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280398464 00000100:00100000:1.0:1786015361.091199:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280398464 00000100:00100000:1.0:1786015361.091239:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280398976 00000100:00100000:1.0:1786015361.091242:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280398976 00000100:00100000:1.0:1786015361.091256:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280398592 00000100:00100000:1.0:1786015361.091258:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280398592 00000100:00100000:1.0:1786015361.091270:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280398848 00000100:00100000:1.0:1786015361.091272:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280398848 00000100:00100000:1.0:1786015361.091287:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 330 00000100:00100000:1.0:1786015361.091294:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+11:2352:x1872772280398464:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015361.091326:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+11:2352:x1872772280398464:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015361.091333:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 330 00000100:00100000:1.0:1786015361.091346:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 331 00000100:00100000:1.0:1786015361.091352:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280398976:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015361.091372:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280398976:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015361.091378:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 331 00000100:00100000:1.0:1786015361.091389:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 332 00000100:00100000:1.0:1786015361.091394:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+10:2352:x1872772280398592:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015361.091413:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+10:2352:x1872772280398592:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 18us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015361.091418:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 332 00000100:00100000:1.0:1786015361.091429:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 333 00000100:00100000:1.0:1786015361.091435:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280398848:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015361.091454:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280398848:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015361.091467:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 333 00000100:00080000:0.0:1786015361.091527:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015361.091531:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015361.093917:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280398720 00000100:00100000:2.0:1786015361.093934:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280398720 00000100:00100000:2.0:1786015361.094072:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280398336 00000100:00100000:2.0:1786015361.094077:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280398336 00000100:00100000:1.0:1786015361.094315:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 365 00000100:00100000:1.0:1786015361.094330:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+34:2352:x1872772280398720:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015361.094410:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+34:2352:x1872772280398720:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 85us (3769us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015361.094430:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 365 00000100:00080000:0.0:1786015361.094530:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015361.100054:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 366 00000100:00100000:2.0:1786015361.100071:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+76:2352:x1872772280398336:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015361.100157:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+76:2352:x1872772280398336:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 90us (9454us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015361.100165:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 366 00000100:00100000:1.0:1786015361.196960:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786015361.196993:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304380416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015361.197092:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015361.197186:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304380416 00000100:00100000:1.0:1786015361.197196:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304380416 00000100:00100000:1.0:1786015361.197274:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1786015361.197285:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304380416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015361.197337:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64684032 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015361.197394:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304380416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015361.197402:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1786015361.197427:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015361.197465:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967332 gen 2 00000004:00080000:1.0:1786015361.197473:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967332 committed transno 4294967332 00000100:00100000:1.0:1786015361.197511:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304380416:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1786015361.420148:0:17755:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12b: Restore an imported file implicitly ========================================================== 07:22:40 (1786015360) 00000100:00100000:2.0:1786015361.749636:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015361.753914:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280399104 00000100:00100000:2.0:1786015361.754601:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280399104 00000100:00100000:2.0:1786015361.754706:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 787 00000100:00100000:2.0:1786015361.754719:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+34:23881:x1872772280399104:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1786015361.754908:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+34:23881:x1872772280399104:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 191us (7979us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015361.754918:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 787 00000100:00100000:3.0:1786015361.780625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015361.781110:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280399232 00000100:00100000:1.0:1786015361.781124:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280399232 00000100:00100000:1.0:1786015361.781188:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 788 00000100:00100000:1.0:1786015361.782374:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+76:23882:x1872772280399232:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015361.782415:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015361.782513:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c500a38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e828a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.783189:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c500a3f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.783206:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c500a3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.783221:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c500a3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.783234:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500a46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.783240:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500a46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.783246:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500a46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.784233:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c500a3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.784247:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c500a3f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.784255:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c500a3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.784262:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2179600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015361.784275:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c500a3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.785381:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c500a3f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.785402:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:1.0:1786015361.785406:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015361.785411:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c500a3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.785418:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c500a3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.786914:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500a46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.786922:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500a46 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.786928:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500a46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.786934:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015361.786939:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500a46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.786946:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500a46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.786960:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5954980 (ffff8b7483ee6a00) 00010000:00010000:1.0:1786015361.786963:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015361.786980:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500a46 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.786986:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500a46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.787040:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c500a38 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e828a expref: 77 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.787053:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:1.0:1786015361.787056:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015361.787059:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c500a38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e828a expref: 77 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015361.787070:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2178a00, rc 0) 00000100:00100000:1.0:1786015361.787175:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+76:23882:x1872772280399232:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 5974us (6646us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015361.787184:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 788 00000100:00100000:2.0:1786015361.794850:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015361.795115:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280399488 00000100:00100000:3.0:1786015361.795129:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280399488 00000100:00100000:3.0:1786015361.795211:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 789 00000100:00100000:3.0:1786015361.795223:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+76:23882:x1872772280399488:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:3.0:1786015361.795306:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015361.795344:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c50082b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e81f7 expref: 76 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015361.795369:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:3.0:1786015361.795375:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015361.800360:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500a4d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015361.800397:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500855 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8205 expref: 33 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015361.800407:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500a4d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015361.800475:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500855 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8205 expref: 33 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015361.800495:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500855 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8205 expref: 33 pid: 7673 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015361.800515:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304380544:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015361.800724:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d2180 going to sleep for 11 seconds 00000100:00100000:3.0:1786015361.812988:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304380544:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015361.813050:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500a4d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015361.821989:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015361.822096:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280399616 00000100:00100000:2.0:1786015361.822111:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280399616 00010000:00010000:2.0:1786015361.822175:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500855 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8205 expref: 34 pid: 7673 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015361.822231:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 251 00000100:00100000:2.0:1786015361.822264:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+34:2353:x1872772280399616:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015361.822285:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015361.822294:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500855 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8205 expref: 34 pid: 7673 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015361.822310:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500855 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8205 expref: 34 pid: 7673 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015361.822340:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500855 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8205 expref: 34 pid: 7673 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015361.822361:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:2.0:1786015361.822367:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500a4d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015361.822379:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500a4d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015361.822389:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500a4d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015361.822429:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015361.822514:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+33:2353:x1872772280399616:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 252us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015361.822525:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 251 00010000:00010000:3.0:1786015361.822724:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500a4d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015361.822734:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500a4d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015361.823084:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c500a54 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015361.823098:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c500a54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015361.823110:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c500a54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015361.833093:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x33:0x0]: returning size 512 00010000:00010000:3.0:1786015361.833449:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500a4d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015361.833465:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500a4d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015361.833473:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500a4d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015361.833480:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015361.833485:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500a4d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015361.833505:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500a4d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015361.833542:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:3.0:1786015361.833546:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015361.833552:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500a4d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015361.833559:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500a4d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015361.833592:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000073eb70 reply state 00000000282a420b transno 4294967816 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c500a54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015361.833605:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015361.833752:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+77:23882:x1872772280399488:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 38525us (38914us total) trans 4294967816 rc 0/0 00000100:00100000:3.0:1786015361.833801:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 789 00010000:00010000:0.0:1786015361.842052:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c500a54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015361.842079:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c500a54 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015361.842088:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c500a54 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015361.842095:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015361.842101:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c500a54 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015361.842110:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c500a54 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015361.842137:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5954980 (ffff8b74a04b5100) 00010000:00010000:0.0:1786015361.842140:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015361.842168:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c500a54 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015361.842175:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c500a54 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786015361.900537:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015361.900551:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015361.901076:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1786015361.901090:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015361.901703:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015362.227407:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015362.227748:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280399744 00000100:00100000:2.0:1786015362.227802:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280399744 00000100:00100000:2.0:1786015362.227887:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 790 00000100:00100000:2.0:1786015362.227900:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+76:23919:x1872772280399744:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:2.0:1786015362.228078:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015362.228114:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500a5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8291 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.228208:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500a62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.228227:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500a62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.228241:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500a62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015362.228333:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1786015362.228338:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015362.228369:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500a62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.228401:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500a5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8291 expref: 78 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.228419:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500a62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8291 expref: 77 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.228429:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d000) 00010000:00010000:2.0:1786015362.228432:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015362.228457:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907200, rc 0) 00000100:00100000:2.0:1786015362.228554:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+77:23919:x1872772280399744:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 656us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015362.228563:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 790 00000100:00100000:2.0:1786015362.243509:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015362.243627:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280400000 00000100:00100000:1.0:1786015362.243643:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280400000 00000100:00100000:1.0:1786015362.243738:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 791 00000100:00100000:1.0:1786015362.243750:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+77:23919:x1872772280400000:12345-192.168.202.56@tcp:36:mkdir.0 00010000:00010000:1.0:1786015362.243887:0:12526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015362.243925:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500a62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8291 expref: 77 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.243948:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d000) 00010000:00010000:1.0:1786015362.243962:0:12526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015362.244221:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+76:23919:x1872772280400000:12345-192.168.202.56@tcp:36:mkdir.0 Request processed in 473us (728us total) trans 0 rc -17/-17 00000100:00100000:1.0:1786015362.244228:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 791 00000100:00100000:3.0:1786015362.246895:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015362.247040:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280400128 00000100:00100000:2.0:1786015362.247055:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280400128 00000100:00100000:2.0:1786015362.247137:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 792 00000100:00100000:2.0:1786015362.247148:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+76:23919:x1872772280400128:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:2.0:1786015362.247179:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015362.247220:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500a69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8298 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.247305:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500a70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.247322:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500a70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.247337:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500a70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015362.247422:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1786015362.247426:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015362.247453:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500a70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.247482:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500a69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8298 expref: 78 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.247518:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500a70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8298 expref: 77 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.247528:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:2.0:1786015362.247531:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015362.247535:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906000, rc 0) 00000100:00100000:2.0:1786015362.247610:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+77:23919:x1872772280400128:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 464us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015362.247617:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 792 00000100:00100000:0.0:1786015362.255876:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015362.256042:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280400256 00000100:00100000:2.0:1786015362.256056:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280400256 00000100:00100000:2.0:1786015362.256137:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 793 00000100:00100000:2.0:1786015362.256149:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+77:23919:x1872772280400256:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:2.0:1786015362.256182:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015362.256210:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500a77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e829f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256303:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500a7e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256321:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500a7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256335:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500a7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256351:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500a85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256379:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500a85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256386:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500a85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256531:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500a8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256540:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500a8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256547:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500a8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015362.256600:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x33:0x0]: returning size 512 00000004:00200000:2.0:1786015362.256604:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015362.256630:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500a8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256645:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500a7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256652:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500a7e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256659:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500a7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256665:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015362.256669:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500a7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256701:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500a7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256715:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:2.0:1786015362.256718:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015362.256724:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500a7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256730:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500a7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256746:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500a85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256806:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500a85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256813:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500a85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256818:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015362.256821:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500a85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256827:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500a85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256834:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5954980 (ffff8b749232d400) 00010000:00010000:2.0:1786015362.256837:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015362.256840:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500a85 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256855:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500a85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256895:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500a77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e829f expref: 79 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256909:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500a8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e829f expref: 78 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.256918:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff8b749232dd00) 00010000:00010000:2.0:1786015362.256920:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015362.256923:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907600, rc 0) 00000100:00100000:2.0:1786015362.257137:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+78:23919:x1872772280400256:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 989us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015362.257147:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 793 00000100:00100000:3.0:1786015362.347898:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015362.348881:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280400384 00000100:00100000:0.0:1786015362.348897:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280400384 00000100:00100000:0.0:1786015362.349001:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 794 00000100:00100000:0.0:1786015362.349015:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+33:23925:x1872772280400384:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015362.349048:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015362.349085:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500a93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e82a6 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.349205:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500a9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.349224:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500a9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.349239:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500a9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015362.349338:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1786015362.349343:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015362.349376:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500a9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.349406:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500a93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82a6 expref: 35 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.349447:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500a9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82a6 expref: 34 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.349456:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:0.0:1786015362.349459:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015362.349463:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e7e00, rc 0) 00000100:00100000:0.0:1786015362.349545:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+34:23925:x1872772280400384:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 533us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015362.349552:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 794 00000100:00100000:3.0:1786015362.370406:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015362.370595:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280400640 00000100:00100000:2.0:1786015362.370609:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280400640 00000100:00100000:2.0:1786015362.370871:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 795 00000100:00100000:2.0:1786015362.370884:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+78:23925:x1872772280400640:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015362.370914:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015362.370919:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786015362.370965:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500a8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x33:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e829f expref: 78 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.370990:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff8b749232dd00) 00010000:00010000:2.0:1786015362.371005:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015362.371041:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500aa1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e82ad expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.371492:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500aa8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.371509:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.371523:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.371539:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500aaf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.371547:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500aaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.371553:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500aaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.378609:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500ab6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.378635:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.378649:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015362.378662:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 0 00010000:00010000:2.0:1786015362.381317:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.381367:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500aa8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.381376:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500aa8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.381383:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015362.381389:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500aa8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.381398:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500aa8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.381418:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff8b749232d400) 00010000:00010000:2.0:1786015362.381421:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015362.381426:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500aa8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.381433:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500aa8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015362.381455:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb9cd537 reply state 000000009d020119 transno 4294967817 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500aaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015362.381465:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786015362.381541:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500aa1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82ad expref: 80 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.381567:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82ad expref: 79 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.381585:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8b7499c59700) 00010000:00010000:2.0:1786015362.381588:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015362.381590:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906800, rc 0) 00000100:00100000:2.0:1786015362.384594:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+80:23925:x1872772280400640:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 13692us (14181us total) trans 4294967817 rc 0/0 00000100:00100000:2.0:1786015362.384614:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 795 00010000:00010000:1.0:1786015362.391464:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500aaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.391489:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500aaf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.391498:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500aaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.391506:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015362.391511:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500aaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.391520:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500aaf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.391543:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x4f0c1d45 (ffff8b749232d000) 00010000:00010000:1.0:1786015362.391547:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015362.391553:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500aaf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.391559:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500aaf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015362.391807:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015362.391920:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280400896 00000100:00100000:2.0:1786015362.391941:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280400896 00000100:00100000:2.0:1786015362.392007:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 796 00000100:00100000:2.0:1786015362.392018:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+79:23925:x1872772280400896:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015362.392051:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015362.392079:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500ac4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e82b4 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.392270:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500acb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.392286:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500ab6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82ad expref: 80 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.392295:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500acb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.392340:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82ad expref: 80 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.392355:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500ab6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82ad expref: 80 pid: 5794 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015362.392382:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304380672:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015362.392509:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74934e09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786015362.396458:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304380672:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015362.396499:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500acb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015362.408283:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015362.408529:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280401024 00000100:00100000:0.0:1786015362.408544:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280401024 00010000:00010000:0.0:1786015362.408607:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500ab6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82ad expref: 81 pid: 5794 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015362.408663:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 252 00000100:00100000:0.0:1786015362.408675:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+81:2354:x1872772280401024:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015362.408707:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015362.408716:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500ab6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82ad expref: 81 pid: 5794 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.408732:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82ad expref: 81 pid: 5794 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.408816:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500ab6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82ad expref: 81 pid: 5794 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.408865:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8b7499c59700) 00010000:00010000:0.0:1786015362.408871:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500acb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.408881:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500acb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.408891:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500acb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.408924:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015362.409018:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+80:2354:x1872772280401024:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 345us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015362.409026:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 252 00010000:00010000:1.0:1786015362.409658:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500acb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.409671:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500acb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015362.409715:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 0 00010000:00010000:1.0:1786015362.410150:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500acb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.410160:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500acb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.410168:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500acb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.410175:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015362.410180:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500acb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.410189:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500acb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.410204:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8b7499c59700) 00010000:00010000:1.0:1786015362.410207:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015362.410212:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500acb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.410218:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500acb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.410299:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500ac4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82b4 expref: 80 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.410311:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff8b7499c59b00) 00010000:00010000:1.0:1786015362.410313:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786015362.410326:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500ac4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82b4 expref: 80 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.410341:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907600, rc 0) 00000100:00100000:1.0:1786015362.410417:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+79:23925:x1872772280400896:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 18400us (18672us total) trans 4294967818 rc 301/301 00000100:00100000:1.0:1786015362.410427:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 796 00000100:00100000:3.0:1786015362.429961:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015362.430111:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280401280 00000100:00100000:1.0:1786015362.430125:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280401280 00000100:00100000:1.0:1786015362.430214:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 161 00000100:00100000:1.0:1786015362.430225:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916b7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+79:23925:x1872772280401280:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015362.430701:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916b7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+80:23925:x1872772280401280:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 476us (753us total) trans 4294967819 rc 0/0 00000100:00100000:1.0:1786015362.430710:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 161 00000100:00100000:0.0:1786015362.440396:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015362.440531:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280401408 00000100:00100000:3.0:1786015362.440546:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280401408 00000100:00100000:3.0:1786015362.440625:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 797 00000100:00100000:3.0:1786015362.440638:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+80:23925:x1872772280401408:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015362.440675:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015362.440709:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500ad9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e82bb expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015362.440862:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500ad9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82bb expref: 81 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015362.440882:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500ad9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82bb expref: 81 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015362.440906:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:3.0:1786015362.440909:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015362.440914:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd200, rc 0) 00000100:00100000:3.0:1786015362.441005:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+81:23925:x1872772280401408:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 369us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015362.441013:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 797 00000100:00100000:3.0:1786015362.444202:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015362.444361:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280401664 00000100:00100000:2.0:1786015362.444376:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280401664 00000100:00100000:2.0:1786015362.444451:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 798 00000100:00100000:2.0:1786015362.444464:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+81:23925:x1872772280401664:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1786015362.444557:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500ae0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.444580:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.444595:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.444964:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.444972:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500ae0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.444979:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500ae0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.445006:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015362.445011:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500ae0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.445019:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500ae0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.445034:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:2.0:1786015362.445037:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1786015362.445043:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500ae0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.445050:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500ae0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015362.445528:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+82:23925:x1872772280401664:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 1062us (1335us total) trans 4294967820 rc 0/0 00000100:00100000:2.0:1786015362.445539:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 798 00000100:00100000:1.0:1786015362.458926:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015362.459061:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280401920 00000100:00100000:2.0:1786015362.459092:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280401920 00000100:00100000:2.0:1786015362.459174:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 799 00000100:00100000:2.0:1786015362.459189:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+82:23925:x1872772280401920:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786015362.459624:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500ae7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.459650:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.459667:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786015362.459828:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967821 00000004:00010000:2.0:1786015362.459878:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000044df4c60 reply state 0000000010b7a73e transno 4294967822 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015362.459889:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786015362.460015:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+85:23925:x1872772280401920:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 827us (1102us total) trans 4294967822 rc 0/0 00000100:00100000:2.0:1786015362.460024:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 799 00000020:00080000:2.0:1786015362.460029:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786015362.467347:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.467373:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500ae7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.467381:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500ae7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.467389:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015362.467395:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500ae7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.467403:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500ae7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.467446:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:1.0:1786015362.467449:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786015362.467456:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500ae7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.467463:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500ae7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015362.468200:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015362.468285:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280402176 00000100:00100000:0.0:1786015362.468301:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280402176 00000100:00100000:0.0:1786015362.468400:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 162 00000100:00100000:0.0:1786015362.468412:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+84:23925:x1872772280402176:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786015362.468810:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+85:23925:x1872772280402176:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 399us (617us total) trans 4294967823 rc 0/0 00000100:00100000:0.0:1786015362.468818:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 162 00000100:00100000:0.0:1786015362.556314:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015362.556516:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280402304 00000100:00100000:1.0:1786015362.556532:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280402304 00000100:00100000:1.0:1786015362.556617:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 800 00000100:00100000:1.0:1786015362.556630:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+85:23928:x1872772280402304:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015362.556669:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015362.556711:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c500aee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e82c2 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.556868:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500af5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.556889:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500af5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.556902:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500af5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557018:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500afc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557043:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500afc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557056:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500afc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557196:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c500b03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557206:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c500b03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557213:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c500b03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015362.557255:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x33:0x0]: returning size 512 00000004:00200000:2.0:1786015362.557260:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015362.557299:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c500b03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557328:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500af5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557334:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500af5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557341:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500af5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557347:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015362.557351:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500af5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557371:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500af5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557386:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:2.0:1786015362.557389:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015362.557394:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500af5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557400:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c500af5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557415:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500afc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557423:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500afc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557429:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500afc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557439:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015362.557442:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500afc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557447:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500afc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557454:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5954980 (ffff8b7499c59200) 00010000:00010000:2.0:1786015362.557456:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015362.557458:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500afc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557463:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500afc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557502:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c500aee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82c2 expref: 87 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557516:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907c00/0xb1a5ef690c500b03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82c2 expref: 86 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.557522:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff8b7499c59800) 00010000:00010000:2.0:1786015362.557524:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786015362.557526:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907c00, rc 0) 00000100:00100000:2.0:1786015362.557610:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+86:23928:x1872772280402304:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 982us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015362.557619:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 800 00000100:00100000:3.0:1786015362.561040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015362.563260:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280402560 00000100:00100000:2.0:1786015362.563303:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280402560 00000100:00100000:2.0:1786015362.563404:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 801 00000100:00100000:2.0:1786015362.563416:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+86:23928:x1872772280402560:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015362.563444:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015362.563467:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e82c9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.563553:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500b11 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.563568:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500b11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.563580:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500b11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.563596:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500b18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.563603:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500b18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.563609:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500b18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.563813:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500b1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.563822:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.563829:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015362.563848:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 158 00010000:00010000:2.0:1786015362.563956:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500b11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.563965:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500b11 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.563972:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500b11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.563978:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015362.563983:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500b11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.563991:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500b11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.564003:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff8b7499c59800) 00010000:00010000:2.0:1786015362.564006:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015362.564010:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500b11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.564017:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500b11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.564029:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500b18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.564035:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500b18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.564053:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500b18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.564058:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015362.564061:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500b18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.564068:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500b18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.564076:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x4f0c1d45 (ffff8b7499c59200) 00010000:00010000:2.0:1786015362.564079:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015362.564082:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500b18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.564086:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500b18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.564131:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82c9 expref: 89 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.564274:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500b1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82c9 expref: 88 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.564283:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:2.0:1786015362.564285:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015362.564288:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906800, rc 0) 00000100:00100000:2.0:1786015362.564591:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+88:23928:x1872772280402560:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1174us (3561us total) trans 4294967824 rc 0/0 00000100:00100000:2.0:1786015362.564611:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 801 00000100:00100000:3.0:1786015362.572329:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015362.572438:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280402688 00000100:00100000:2.0:1786015362.572449:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280402688 00000100:00100000:2.0:1786015362.572514:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 802 00000100:00100000:2.0:1786015362.572525:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+88:23928:x1872772280402688:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:2.0:1786015362.572596:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.572615:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.572627:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.572656:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.572663:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.572671:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.572678:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015362.572682:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.572689:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.572702:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:2.0:1786015362.572721:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786015362.572727:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.572734:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015362.572857:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+88:23928:x1872772280402688:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 333us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015362.572865:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 802 00000100:00100000:0.0:1786015362.574967:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015362.575080:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280402944 00000100:00100000:2.0:1786015362.575093:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280402944 00000100:00100000:2.0:1786015362.575215:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 163 00000100:00100000:2.0:1786015362.575225:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+88:23928:x1872772280402944:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1786015362.575641:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+89:23928:x1872772280402944:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 416us (691us total) trans 4294967825 rc 0/0 00000100:00100000:2.0:1786015362.575649:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 163 00000100:00100000:3.0:1786015362.624847:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015362.625149:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280403200 00000100:00100000:0.0:1786015362.625165:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280403200 00000100:00100000:0.0:1786015362.625251:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 803 00000100:00100000:0.0:1786015362.625286:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+89:23933:x1872772280403200:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1786015362.625332:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015362.625366:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e82d0 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.625504:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c500b3b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.625525:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c500b3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.625540:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c500b3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015362.625556:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 158 00010000:00010000:0.0:1786015362.625716:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82d0 expref: 92 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.625820:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c500b3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82d0 expref: 91 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.625831:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:0.0:1786015362.625835:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1786015362.625839:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e7200, rc 0) 00000100:00100000:0.0:1786015362.625917:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+91:23933:x1872772280403200:12345-192.168.202.56@tcp:101:cat.0 Request processed in 634us (1087us total) trans 4294967826 rc 0/0 00000100:00100000:0.0:1786015362.625925:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 803 00000100:00100000:3.0:1786015362.632458:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015362.632568:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280403456 00000100:00100000:0.0:1786015362.632582:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280403456 00000100:00100000:0.0:1786015362.632693:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:0.0:1786015362.632705:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74865ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+91:23933:x1872772280403456:12345-192.168.202.56@tcp:103:cat.0 00010000:00010000:0.0:1786015362.632736:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1786015362.632799:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500b1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82c9 expref: 91 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.632825:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c500b3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82d0 expref: 90 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.632904:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500ad9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82bb expref: 89 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.632979:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:0.0:1786015362.632994:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015362.633076:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74865ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+88:23933:x1872772280403456:12345-192.168.202.56@tcp:103:cat.0 Request processed in 372us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015362.633084:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:1.0:1786015362.635069:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015362.635442:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280403584 00000100:00100000:2.0:1786015362.635455:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280403584 00000100:00100000:2.0:1786015362.635534:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 804 00000100:00100000:2.0:1786015362.635546:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+88:23933:x1872772280403584:12345-192.168.202.56@tcp:58:cat.0 00010000:00010000:2.0:1786015362.635697:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b49 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.635720:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015362.635756:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786015362.637630:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].19, 136 off10776 00000100:00100000:2.0:1786015362.637828:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+88:23933:x1872772280403584:12345-192.168.202.56@tcp:58:cat.0 Request processed in 2277us (2765us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015362.637843:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 804 00000100:00100000:3.0:1786015362.642198:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015362.642498:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280403712 00000100:00100000:0.0:1786015362.642511:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280403712 00000100:00100000:0.0:1786015362.642592:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 805 00000100:00100000:0.0:1786015362.642606:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+88:23933:x1872772280403712:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1786015362.642637:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015362.642671:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c500b50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e82d7 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.642828:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b49 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.642869:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c500b50 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82d7 expref: 89 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.642894:0:12526:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.642910:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c500b50 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82d7 expref: 89 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.642928:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8b7499c59200) 00010000:00010000:0.0:1786015362.642931:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015362.642935:0:12526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c500b50 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82d7 expref: 89 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.642943:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e7200, rc 0) 00000100:00100000:0.0:1786015362.643022:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+89:23933:x1872772280403712:12345-192.168.202.56@tcp:101:cat.0 Request processed in 419us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015362.643031:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 805 00000100:00100000:2.0:1786015362.732698:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304381056:0@lo:400:kworker.0 00000100:00100000:2.0:1786015362.732857:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015362.732948:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1786015362.732955:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304380928:0@lo:400:kworker.0 00000100:00100000:2.0:1786015362.732984:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015362.733003:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304381440:0@lo:400:kworker.0 00000100:00100000:2.0:1786015362.733032:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015362.733314:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304381184:0@lo:400:kworker.0 00000100:00100000:3.0:1786015362.733362:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015362.733406:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786015362.733411:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304380800:0@lo:400:kworker.0 00000100:00100000:3.0:1786015362.733445:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015362.733473:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304381312:0@lo:400:kworker.0 00000100:00100000:3.0:1786015362.733497:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015362.733532:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304380800 00000100:00100000:3.0:1786015362.733541:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304380800 00000100:00100000:3.0:1786015362.733601:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:3.0:1786015362.733611:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304380800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015362.733673:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304380800:12345-0@lo:400:kworker.0 Request processed in 63us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015362.733681:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:2.0:1786015362.733955:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304381440 00000100:00100000:2.0:1786015362.733960:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304381440 00000100:00100000:2.0:1786015362.734010:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304381184 00000100:00100000:2.0:1786015362.734014:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304381184 00000100:00100000:2.0:1786015362.734038:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1786015362.734046:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304381440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015362.734096:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304381440:12345-0@lo:400:kworker.0 Request processed in 51us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015362.734103:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1786015362.734118:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1786015362.734138:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304381184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015362.734169:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304381184:12345-0@lo:400:kworker.0 Request processed in 32us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015362.734175:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1786015362.734242:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304381440:0@lo:400:kworker.0 00000100:00100000:2.0:1786015362.734275:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304381056 00000100:00100000:2.0:1786015362.734280:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304381056 00000100:00100000:2.0:1786015362.734309:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304380928 00000100:00100000:2.0:1786015362.734312:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304380928 00000100:00100000:2.0:1786015362.734340:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304381312 00000100:00100000:2.0:1786015362.734343:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304381312 00000100:00100000:2.0:1786015362.734358:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1786015362.734364:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304381056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015362.734405:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304381056:12345-0@lo:400:kworker.0 Request processed in 42us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015362.734411:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1786015362.734434:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304381056:0@lo:400:kworker.0 00000100:00100000:2.0:1786015362.734451:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1786015362.734456:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304380928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015362.734490:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304380928:12345-0@lo:400:kworker.0 Request processed in 34us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015362.734495:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1786015362.734517:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304380928:0@lo:400:kworker.0 00000100:00100000:2.0:1786015362.734536:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1786015362.734545:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304381312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015362.734576:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304381312:12345-0@lo:400:kworker.0 Request processed in 33us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015362.734581:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1786015362.734847:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304380800:0@lo:400:kworker.0 00000100:00100000:3.0:1786015362.734862:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304381312:0@lo:400:kworker.0 00000100:00100000:3.0:1786015362.734873:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304381184:0@lo:400:kworker.0 00000100:00080000:1.0:1786015362.735072:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015362.735079:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786015362.923955:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015362.924285:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015362.924294:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015362.924388:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 20 count 3 00000040:00080000:2.0:1786015362.924398:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015362.924593:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304381568:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786015362.925075:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b8d19600 going to sleep for 11 seconds 00000100:00100000:3.0:1786015362.938694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015362.939173:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280403840 00000100:00100000:0.0:1786015362.939186:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280403840 00000100:00100000:0.0:1786015362.939309:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 806 00000100:00100000:0.0:1786015362.939332:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+35:23934:x1872772280403840:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015362.939380:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x35:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015362.939526:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+35:23934:x1872772280403840:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 207us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015362.939534:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 806 00000100:00100000:2.0:1786015362.940617:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304381568:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015362.947437:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015362.947695:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280403968 00000100:00100000:0.0:1786015362.947710:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280403968 00000100:00100000:0.0:1786015362.948208:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 807 00000100:00100000:0.0:1786015362.948223:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+34:23934:x1872772280403968:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1786015362.948344:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b57 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948368:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948385:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948405:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b5e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948414:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948421:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948451:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500b65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948460:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500b65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948466:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500b65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015362.948520:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 158 00000004:00200000:0.0:1786015362.948536:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015362.948554:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500b65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948569:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948576:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b57 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948583:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b57 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948590:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015362.948595:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b57 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948602:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b57 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948617:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:0.0:1786015362.948620:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015362.948625:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b57 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948632:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b57 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948646:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948651:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b5e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948667:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948671:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015362.948674:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948680:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b5e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948688:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3d0032c8 (ffff8b748f24ab00) 00010000:00010000:0.0:1786015362.948690:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015362.948693:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b5e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948698:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b5e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948718:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500b65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948736:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500b65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948742:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500b65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948756:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015362.948780:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500b65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948799:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500b65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948809:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8b7499c59200) 00010000:00010000:0.0:1786015362.948812:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015362.948815:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500b65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.948820:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500b65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015362.948930:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+34:23934:x1872772280403968:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 709us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015362.948941:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 807 00000100:00100000:2.0:1786015362.954355:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015362.954402:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280404224 00000100:00100000:1.0:1786015362.954436:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280404224 00000100:00100000:1.0:1786015362.954535:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 808 00000100:00100000:1.0:1786015362.954548:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+34:23934:x1872772280404224:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015362.954582:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015362.954616:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c500b6c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e82de expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.954799:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500b73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.954818:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.954833:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015362.954861:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 158 00010000:00010000:1.0:1786015362.955023:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.955030:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500b73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.955036:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500b73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.955043:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015362.955048:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500b73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.955056:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500b73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.955081:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8b7499c59200) 00010000:00010000:1.0:1786015362.955084:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015362.955091:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500b73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.955097:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500b73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.955157:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c500b6c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82de expref: 36 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.955168:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:1.0:1786015362.955171:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786015362.955174:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c500b6c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82de expref: 36 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015362.955186:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2179600, rc 0) 00000100:00100000:1.0:1786015362.955708:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+35:23934:x1872772280404224:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1160us (1367us total) trans 4294967827 rc 301/301 00000100:00100000:1.0:1786015362.955718:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 808 00000100:00100000:3.0:1786015362.966419:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015362.968919:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280404352 00000100:00100000:0.0:1786015362.968942:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280404352 00000100:00100000:0.0:1786015362.969043:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 809 00000100:00100000:0.0:1786015362.969056:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+35:23934:x1872772280404352:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015362.969148:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x35:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015362.969307:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+35:23934:x1872772280404352:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 252us (2905us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015362.969316:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 809 00000100:00100000:2.0:1786015362.979003:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015362.979132:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280404480 00000100:00100000:0.0:1786015362.979146:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280404480 00000100:00100000:0.0:1786015362.979231:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 810 00000100:00100000:0.0:1786015362.979244:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+35:23934:x1872772280404480:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015362.979276:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015362.979325:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500b81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e82e5 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979424:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979441:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979454:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979469:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979476:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979482:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979630:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c500b96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979639:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c500b96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979646:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c500b96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015362.979688:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x33:0x0]: returning size 512 00000004:00200000:0.0:1786015362.979693:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015362.979723:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c500b96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979758:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979820:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b88 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979828:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979834:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015362.979839:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979847:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979862:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:0.0:1786015362.979865:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015362.979870:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979876:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500b88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979892:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979897:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979902:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979928:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015362.979931:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979938:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979946:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5954980 (ffff8b748f24ab00) 00010000:00010000:0.0:1786015362.979948:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015362.979950:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979956:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500b8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.979995:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500b81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82e5 expref: 37 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.980010:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6a00/0xb1a5ef690c500b96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82e5 expref: 36 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015362.980017:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff8b7499c59800) 00010000:00010000:0.0:1786015362.980020:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786015362.980022:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6a00, rc 0) 00000100:00100000:0.0:1786015362.980590:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+36:23934:x1872772280404480:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1345us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015362.980602:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 810 00000100:00100000:1.0:1786015362.985921:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015362.986506:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280404736 00000100:00100000:3.0:1786015362.986521:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280404736 00000100:00100000:3.0:1786015362.986602:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 811 00000100:00100000:3.0:1786015362.986613:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+36:23934:x1872772280404736:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015362.986642:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015362.986674:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c500b9d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e82ec expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786015362.987991:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x11:0x0], index 1: 0 00010000:00010000:3.0:1786015362.989450:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c500ba4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015362.989476:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c500ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015362.989492:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c500ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015362.989613:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c500b9d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82ec expref: 39 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015362.989637:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c500ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82ec expref: 38 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015362.989648:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8b74a04b5b00) 00010000:00010000:3.0:1786015362.989651:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015362.989654:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afda00, rc 0) 00000100:00100000:3.0:1786015362.990445:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+38:23934:x1872772280404736:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 3151us (3857us total) trans 4294967828 rc 0/0 00000100:00100000:3.0:1786015362.990477:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 811 00000100:00100000:3.0:1786015363.000637:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015363.000822:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280404992 00000100:00100000:2.0:1786015363.000836:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280404992 00000100:00100000:2.0:1786015363.000938:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 812 00000100:00080000:1.0:1786015363.000940:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015363.000952:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+38:23934:x1872772280404992:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786015363.001041:0:12526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015363.001079:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c500ba4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82ec expref: 38 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001105:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8b74a04b5b00) 00010000:00010000:2.0:1786015363.001119:0:12526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015363.001151:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500bb2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001167:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500bb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001179:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500bb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001195:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500bb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x33:0x0].0x1361d314 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001227:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500bb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x1361d314 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001235:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500bb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x1361d314 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001337:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500bb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001346:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500bb2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001353:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500bb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001359:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015363.001364:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500bb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001372:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500bb2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001383:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff8b7499c59800) 00010000:00010000:2.0:1786015363.001386:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015363.001390:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500bb2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001396:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500bb2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001405:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500bb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x1361d314 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001418:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500bb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x1361d314 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001424:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500bb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x1361d314 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001429:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015363.001433:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500bb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x1361d314 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001440:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500bb9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x1361d314 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001448:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x1361d314 (ffff8b7499c59900) 00010000:00010000:2.0:1786015363.001451:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015363.001454:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500bb9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x33:0x0].0x1361d314 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.001460:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500bb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x33:0x0].0x1361d314 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015363.001575:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+37:23934:x1872772280404992:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 626us (952us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786015363.001584:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 812 00000100:00100000:2.0:1786015363.005909:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015363.006018:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280405120 00000100:00100000:0.0:1786015363.006053:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280405120 00000100:00100000:0.0:1786015363.006140:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 813 00000100:00100000:0.0:1786015363.006154:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+37:23934:x1872772280405120:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015363.006184:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015363.006217:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500bc0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e82f3 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.006266:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500bc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.006281:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.006295:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.006431:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500bc0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82f3 expref: 39 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.006453:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82f3 expref: 38 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.006463:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:0.0:1786015363.006467:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015363.006471:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6600, rc 0) 00000100:00100000:0.0:1786015363.006551:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+38:23934:x1872772280405120:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 400us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015363.006559:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 813 00000100:00100000:1.0:1786015363.010374:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015363.010454:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280405376 00000100:00100000:3.0:1786015363.010466:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280405376 00000100:00100000:3.0:1786015363.010546:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 814 00000100:00100000:3.0:1786015363.010559:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+38:23934:x1872772280405376:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786015363.010679:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500bce lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.010701:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500bce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.010716:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500bce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786015363.012408:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].9, 88 off8840 00000004:00080000:3.0:1786015363.012428:0:5795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 598263665874ns, next at 599263662611ns, rc = 0 00000004:00010000:3.0:1786015363.012561:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000934c36cc reply state 0000000052b6154b transno 4294967829 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500bce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015363.012575:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015363.013001:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+40:23934:x1872772280405376:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 2437us (2636us total) trans 4294967829 rc 0/0 00000100:00100000:3.0:1786015363.013011:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 814 00000100:00100000:3.0:1786015363.019929:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:1.0:1786015363.020009:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500bce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.020022:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500bce lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.020048:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500bce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.020053:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015363.020057:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500bce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.020063:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500bce lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.020083:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:1.0:1786015363.020087:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786015363.020092:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500bce lrc: 2/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.020099:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500bce lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015363.020453:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280405504 00000100:00100000:0.0:1786015363.020473:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280405504 00000100:00100000:0.0:1786015363.020548:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 815 00000100:00100000:0.0:1786015363.020557:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+39:23934:x1872772280405504:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015363.020589:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015363.020610:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500bd5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e82fa expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.020682:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500bd5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82fa expref: 40 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.020694:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500bd5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82fa expref: 40 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.020710:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:0.0:1786015363.020712:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015363.020714:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6000, rc 0) 00000100:00100000:0.0:1786015363.020834:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+40:23934:x1872772280405504:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 278us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015363.020840:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 815 00000100:00100000:2.0:1786015363.024235:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015363.024405:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280405632 00000100:00100000:0.0:1786015363.024419:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280405632 00000100:00100000:0.0:1786015363.024510:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 194 00000100:00100000:0.0:1786015363.024523:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280405632:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1786015363.025056:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280405632:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 534us (834us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1786015363.025067:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 194 00000100:00080000:1.0:1786015363.025163:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015363.029023:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015363.029283:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280405888 00000100:00100000:0.0:1786015363.029313:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280405888 00000100:00100000:0.0:1786015363.029412:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 164 00000100:00100000:0.0:1786015363.029424:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+40:23934:x1872772280405888:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786015363.029810:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+41:23934:x1872772280405888:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 341us (756us total) trans 4294967830 rc 0/0 00000100:00100000:0.0:1786015363.029818:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 164 00000100:00100000:3.0:1786015363.033438:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015363.033677:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280406144 00000100:00100000:2.0:1786015363.033693:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280406144 00000100:00100000:2.0:1786015363.033837:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 816 00000100:00100000:2.0:1786015363.033871:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+41:23934:x1872772280406144:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015363.034027:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+41:23934:x1872772280406144:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 159us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015363.034036:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 816 00000100:00100000:3.0:1786015363.038959:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015363.039179:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280406272 00000100:00100000:2.0:1786015363.039194:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280406272 00000100:00100000:2.0:1786015363.039282:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 817 00000100:00100000:2.0:1786015363.039294:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+41:23934:x1872772280406272:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015363.039328:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015363.039361:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500bdc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8301 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.039465:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500be3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.039483:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500be3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.039497:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500be3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015363.039545:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015363.039573:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500be3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.039604:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500bdc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8301 expref: 43 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.039628:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500be3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8301 expref: 42 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.039658:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:2.0:1786015363.039661:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786015363.039666:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907200, rc 0) 00000100:00100000:2.0:1786015363.039831:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+42:23934:x1872772280406272:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 538us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015363.039839:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 817 00000100:00100000:1.0:1786015363.043967:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015363.045496:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280406400 00000100:00100000:2.0:1786015363.045528:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280406400 00000100:00100000:2.0:1786015363.045614:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 195 00000100:00100000:2.0:1786015363.045626:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280406400:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015363.045651:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015363.045681:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500bea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8308 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015363.045714:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a746e83, blocks: 0x1 00010000:00010000:2.0:1786015363.045752:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=598s v=(0 0) 00010000:00010000:2.0:1786015363.045758:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015363.045908:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500bea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8308 expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.045998:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500bea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8308 expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.046018:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907600, rc 0) 00000100:00100000:2.0:1786015363.046307:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280406400:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 682us (2353us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015363.046316:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 195 00000100:00100000:3.0:1786015363.051797:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015363.051894:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280406656 00000100:00100000:2.0:1786015363.051910:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280406656 00000100:00100000:2.0:1786015363.051996:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 818 00000100:00100000:2.0:1786015363.052008:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+42:23934:x1872772280406656:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015363.052176:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+42:23934:x1872772280406656:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 169us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015363.052184:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 818 00000100:00100000:0.0:1786015363.055962:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015363.056139:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280406784 00000100:00100000:1.0:1786015363.056154:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280406784 00000100:00100000:1.0:1786015363.056236:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 196 00000100:00100000:1.0:1786015363.056249:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:23934:x1872772280406784:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015363.056275:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015363.056301:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500bf1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e830f expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.056369:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500bea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8308 expref: 12 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.056378:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015363.056383:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015363.056389:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500bf1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e830f expref: 12 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.056436:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500bea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8308 expref: 12 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.056452:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500bea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8308 expref: 12 pid: 6590 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015363.056467:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1223480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304381696:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015363.056591:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c0f0a240 going to sleep for 11 seconds 00000100:00100000:2.0:1786015363.063537:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1223480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304381696:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015363.063589:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500bf1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e830f expref: 12 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.063617:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2179600, rc 0) 00000100:00100000:2.0:1786015363.063741:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:23934:x1872772280406784:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 7493us (7794us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015363.063802:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 196 00000100:00100000:2.0:1786015363.072691:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015363.076018:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280406912 00000100:00100000:1.0:1786015363.076041:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280406912 00010000:00010000:1.0:1786015363.076538:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500bea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8308 expref: 12 pid: 6590 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015363.076618:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 253 00000100:00100000:1.0:1786015363.076633:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280406912:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015363.076658:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015363.076713:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500bea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8308 expref: 12 pid: 6590 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.076731:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500bea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8308 expref: 12 pid: 6590 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.076810:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500bea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8308 expref: 12 pid: 6590 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.076967:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015363.076973:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015363.076985:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500bf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e830f expref: 11 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.076998:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500bf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e830f expref: 11 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.077057:0:5780:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500bf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e830f expref: 11 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015363.077089:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1220380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5780:1872772304381824:192.168.202.56@tcp:105: 00000100:00100000:1.0:1786015363.077284:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c0f0a180 going to sleep for 11 seconds 00000100:00100000:1.0:1786015363.082420:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1220380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5780:1872772304381824:192.168.202.56@tcp:105: 00010000:00010000:1.0:1786015363.082460:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015363.082542:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280406912:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 5912us (9866us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015363.082581:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 253 00000100:00100000:2.0:1786015363.091035:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015363.092359:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280407040 00000100:00100000:0.0:1786015363.092381:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280407040 00002000:00100000:2.0:1786015363.092634:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x11:0x0] (0->157) req@ffff8b74bf3b1180 x1872772280407040/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:209/0 lens 648/0 e 0 to 0 dl 1786015374 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015363.092651:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74bf3b1180 with x1872772280407040 ext(0->157) 00002000:00010000:2.0:1786015363.092660:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74bf3b1180 00000100:00100000:2.0:1786015363.093797:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:2.0:1786015363.093954:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280407040:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1786015363.095070:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280407040:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 1116us (4146us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1786015363.099832:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015363.100055:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280407168 00000100:00100000:0.0:1786015363.100069:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280407168 00000100:00100000:0.0:1786015363.100145:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 819 00000100:00100000:0.0:1786015363.100158:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+42:23934:x1872772280407168:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1786015363.110990:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 63 00002000:00100000:2.0:1786015363.111025:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x11:0x0] (0->157) req@ffff8b74bf3b1180 x1872772280407040/t4294967337(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:209/0 lens 648/448 e 0 to 0 dl 1786015374 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015363.111039:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74bf3b1180 with x1872772280407040 ext(0->157) 00002000:00010000:2.0:1786015363.111049:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74bf3b1180 00000001:00080000:3.0:1786015363.168605:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967830 is committed 00000001:00080000:3.0:1786015363.168632:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967826 is committed 00000004:00080000:3.0:1786015363.168688:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 12 committed 00000020:00080000:3.0:1786015363.168716:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 11 batchid updated 00000020:00080000:3.0:1786015363.168738:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 11 00000020:00080000:3.0:1786015363.168790:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 11 00000100:00100000:3.0:1786015363.169124:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304381952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786015363.169234:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015363.169425:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304381952 00000100:00100000:2.0:1786015363.169434:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304381952 00000100:00100000:2.0:1786015363.169502:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1786015363.169513:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304381952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1786015363.169731:0:14547:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1786015363.169735:0:14547:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb mtime from disk: 0 -> 1786015363 00002000:00010000:2.0:1786015363.169738:0:14547:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786015363.169740:0:14547:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb ctime from disk: 1786015363 -> 1786015363 00002000:00010000:2.0:1786015363.169751:0:14547:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1786015363.169828:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304381952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 316us (594us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1786015363.169837:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1786015363.170047:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+38:23934:x1872772280407168:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 69888us (70227us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015363.170056:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 819 00000004:00080000:3.0:1786015363.171372:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b74bf3b3800/2, rc 0, transno 4294967338 00000100:00100000:3.0:1786015363.171391:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304381952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786015363.173649:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015363.174016:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280407296 00000100:00100000:2.0:1786015363.174031:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280407296 00000100:00100000:2.0:1786015363.174110:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 198 00000100:00100000:2.0:1786015363.174124:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280407296:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1786015363.232041:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280407296:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 57903us (58389us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015363.232061:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 198 00000001:00080000:1.0:1786015363.232373:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967336 is committed 00000001:00080000:1.0:1786015363.232390:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967338 is committed 00000001:00080000:1.0:1786015363.232398:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967337 is committed 00000100:00100000:2.0:1786015363.241045:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015363.241167:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280407552 00000100:00100000:3.0:1786015363.241182:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280407552 00000100:00100000:3.0:1786015363.241262:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 820 00000100:00100000:3.0:1786015363.241276:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+38:23934:x1872772280407552:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786015363.241357:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015363.241400:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500be3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8301 expref: 38 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.241423:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:3.0:1786015363.241429:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015363.241473:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500bf8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.241492:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500bf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.241517:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500bf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015363.241846:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9547ad3 reply state 000000006927a4d8 transno 4294967831 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500bf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015363.241858:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015363.242000:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+39:23934:x1872772280407552:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 727us (974us total) trans 4294967831 rc 0/0 00000100:00100000:3.0:1786015363.242009:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 820 00000100:00100000:1.0:1786015363.244230:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786015363.244262:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304382080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015363.244351:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015363.244490:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304382080 00000100:00100000:0.0:1786015363.244500:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304382080 00000100:00100000:0.0:1786015363.244561:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1786015363.244572:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304382080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015363.244603:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 61276160 pending 0 free 3857711104 avail 3854565376 00000100:00100000:0.0:1786015363.244664:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304382080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015363.244671:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1786015363.244824:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967338 gen 2 00000004:00080000:2.0:1786015363.244834:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b74bf3b3800, transno 4294967338 00000100:00100000:2.0:1786015363.244855:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304382080:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786015363.247090:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500bf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.247116:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500bf8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015363.247117:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:1.0:1786015363.247125:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500bf8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.247132:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015363.247138:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500bf8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.247147:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500bf8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.247171:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:1.0:1786015363.247175:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015363.247181:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500bf8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015363.247200:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280407680 00010000:00010000:1.0:1786015363.247207:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500bf8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015363.247212:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280407680 00000100:00100000:2.0:1786015363.247277:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 199 00000100:00100000:2.0:1786015363.247289:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280407680:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1786015363.247628:0:6591:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb size from disk: 158 -> 158 00002000:00010000:2.0:1786015363.247632:0:6591:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb mtime from disk: 1786015363 -> 1536580263 00002000:00010000:2.0:1786015363.247635:0:6591:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb atime from disk: 0 -> 1786014790 00002000:00010000:2.0:1786015363.247637:0:6591:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb ctime from disk: 1786015363 -> 1786015362 00002000:00010000:2.0:1786015363.247639:0:6591:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1786015363.248078:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280407680:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 441us (614us total) trans 4294967339 rc 0/0 00000100:00100000:2.0:1786015363.248089:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 199 00000100:00100000:1.0:1786015363.250045:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015363.250160:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280407936 00000100:00100000:0.0:1786015363.250173:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280407936 00000100:00100000:0.0:1786015363.250252:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 821 00000100:00100000:0.0:1786015363.250282:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+38:23934:x1872772280407936:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1786015363.250402:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500bff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.250422:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500bc7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82f3 expref: 38 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.250437:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500bff lrc: 4/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.250484:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82f3 expref: 38 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.250502:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500bc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82f3 expref: 38 pid: 7673 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015363.250521:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304382208:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015363.250631:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748f268d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015363.254133:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304382208:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015363.254175:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500bff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015363.255602:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015363.260534:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280408064 00000100:00100000:2.0:1786015363.260558:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280408064 00010000:00010000:3.0:1786015363.260900:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500bc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82f3 expref: 39 pid: 7673 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015363.260976:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 254 00000100:00100000:3.0:1786015363.260989:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+39:2354:x1872772280408064:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015363.261010:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015363.261018:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500bc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82f3 expref: 39 pid: 7673 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.261033:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82f3 expref: 39 pid: 7673 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.261064:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500bc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82f3 expref: 39 pid: 7673 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.261085:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:3.0:1786015363.261110:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500bff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.261123:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500bff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.261133:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500bff lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.261174:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015363.261266:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+38:2354:x1872772280408064:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 278us (5672us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015363.261274:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 254 00010000:00010000:0.0:1786015363.262485:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500bff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.262501:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500bff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.262544:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500bff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.262568:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500bff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.262576:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500bff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.262583:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015363.262588:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500bff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.262597:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500bff lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.262614:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:0.0:1786015363.262617:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1786015363.262623:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500bff lrc: 2/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.262630:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500bff lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015363.262725:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+37:23934:x1872772280407936:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 12439us (12685us total) trans 0 rc -22/-22 00000100:00100000:0.0:1786015363.262737:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 821 00000100:00100000:1.0:1786015363.269150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015363.269295:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280408192 00000100:00100000:3.0:1786015363.269309:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280408192 00000100:00100000:3.0:1786015363.269392:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 200 00000100:00100000:3.0:1786015363.269402:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280408192:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015363.269457:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000609de14b/0xb1a5ef690c500c06 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.269479:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500bf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e830f expref: 11 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.269486:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015363.269490:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015363.269494:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000609de14b/0xb1a5ef690c500c06 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.269530:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500bf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e830f expref: 11 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.269557:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500bf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e830f expref: 11 pid: 6591 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015363.269571:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304382336:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015363.269665:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7484fff9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015363.272670:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304382336:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015363.272715:0:11384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000609de14b/0xb1a5ef690c500c06 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015363.274561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015363.282608:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280408320 00000100:00100000:0.0:1786015363.282632:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280408320 00010000:00010000:0.0:1786015363.282708:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500bf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e830f expref: 12 pid: 6591 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015363.282950:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 255 00000100:00100000:0.0:1786015363.282983:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280408320:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015363.283004:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015363.283038:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500bf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e830f expref: 12 pid: 6591 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.283054:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500bf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e830f expref: 12 pid: 6591 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.283086:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500bf1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e830f expref: 12 pid: 6591 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.283107:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015363.283112:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015363.283120:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000609de14b/0xb1a5ef690c500c06 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.283132:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000609de14b/0xb1a5ef690c500c06 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.283176:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015363.283263:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280408320:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 283us (8714us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015363.283272:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 255 00010000:00010000:2.0:1786015363.283338:0:11384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000609de14b/0xb1a5ef690c500c06 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.283350:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000609de14b/0xb1a5ef690c500c06 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.283383:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000609de14b/0xb1a5ef690c500c06 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.283406:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000609de14b/0xb1a5ef690c500c06 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.283414:0:11384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000609de14b/0xb1a5ef690c500c06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.283422:0:11384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015363.283426:0:11384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000609de14b/0xb1a5ef690c500c06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.283436:0:11384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000609de14b/0xb1a5ef690c500c06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.283450:0:11384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000609de14b/0xb1a5ef690c500c06 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.283457:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000609de14b/0xb1a5ef690c500c06 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015363.283515:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280408192:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 14114us (14380us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015363.283531:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 200 00000100:00100000:1.0:1786015363.290352:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015363.290470:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280408576 00000100:00100000:0.0:1786015363.290484:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280408576 00000100:00100000:0.0:1786015363.290568:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 822 00000100:00100000:0.0:1786015363.290582:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+37:23934:x1872772280408576:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786015363.290722:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500c0d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.290754:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500c0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.290802:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500c0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.291139:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500c14 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.291153:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500bd5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82fa expref: 38 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.291162:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500c14 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.291212:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500bd5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82fa expref: 38 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.291231:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500bd5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82fa expref: 38 pid: 5796 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015363.291252:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304382464:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015363.291360:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748f268d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786015363.293881:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304382464:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015363.293929:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500c14 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015363.295718:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015363.295946:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280408704 00000100:00100000:2.0:1786015363.295961:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280408704 00010000:00010000:2.0:1786015363.296024:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500bd5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82fa expref: 39 pid: 5796 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015363.296107:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 256 00000100:00100000:2.0:1786015363.296118:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+39:2353:x1872772280408704:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015363.296148:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015363.296157:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500bd5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82fa expref: 39 pid: 5796 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.296172:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500bd5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82fa expref: 39 pid: 5796 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.296207:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c500bd5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82fa expref: 39 pid: 5796 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.296229:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:2.0:1786015363.296235:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500c14 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.296247:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500c14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.296256:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500c14 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.296296:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015363.296379:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+38:2353:x1872772280408704:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 262us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015363.296388:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 256 00010000:00010000:1.0:1786015363.296739:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500c14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.296758:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500c14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786015363.297063:0:12526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967832 00000001:00080000:1.0:1786015363.297284:0:12526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967833 00000001:00080000:1.0:1786015363.297344:0:12526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967834 00000100:00100000:1.0:1786015363.297461:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12526:1872772304382592:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1786015363.297542:0:12526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015363.297605:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b7e16900 going to sleep for 11 seconds 00000100:00100000:0.0:1786015363.297781:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304382592 00000100:00100000:0.0:1786015363.297791:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304382592 00000100:00100000:0.0:1786015363.297853:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1786015363.297865:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12526:x1872772304382592:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1786015363.297976:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12526:x1872772304382592:12345-0@lo:1000:mdt00_004.0 Request processed in 112us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015363.297984:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1786015363.298362:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12526:1872772304382592:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1786015363.298924:0:12526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967835 00000100:00100000:1.0:1786015363.299016:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12526:1872772304382720:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1786015363.299080:0:12526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015363.299115:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74af54b900 going to sleep for 11 seconds 00000100:00100000:0.0:1786015363.299272:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304382720 00000100:00100000:0.0:1786015363.299279:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304382720 00000100:00100000:0.0:1786015363.299334:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1786015363.299343:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12526:x1872772304382720:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1786015363.299590:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12526:x1872772304382720:12345-0@lo:1000:mdt00_004.0 Request processed in 247us (508us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1786015363.299599:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786015363.299894:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12526:1872772304382720:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1786015363.299945:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500c14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.299957:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500c14 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.299966:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500c14 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.299973:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015363.299978:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500c14 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.299988:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500c14 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.300008:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:1.0:1786015363.300012:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015363.300018:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500c14 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.300026:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c500c14 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.300065:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.300071:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b49 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.300089:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b49 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.300095:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015363.300098:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b49 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.300106:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b49 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.300115:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8b7499c59200) 00010000:00010000:1.0:1786015363.300118:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015363.300126:0:12526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c500b50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82d7 expref: 77 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.300139:0:12526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c500b50 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82d7 expref: 77 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.300148:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c500b50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82d7 expref: 77 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015363.300187:0:12526:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7200/0xb1a5ef690c500b50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82d7 expref: 77 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015363.300201:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304382848:192.168.202.56@tcp:105: 00000100:00100000:1.0:1786015363.300282:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015363.304543:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015363.304680:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304382848:192.168.202.56@tcp:105: 00010000:00010000:0.0:1786015363.304723:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b49 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.304737:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500b49 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.304817:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9800/0xb1a5ef690c500c1b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.304834:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9800/0xb1a5ef690c500c1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.304848:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9800/0xb1a5ef690c500c1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.304861:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9800/0xb1a5ef690c500c1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.304869:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9800/0xb1a5ef690c500c1b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.304895:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9800/0xb1a5ef690c500c1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.304901:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73829f9800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015363.304906:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9800/0xb1a5ef690c500c1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.304914:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9800/0xb1a5ef690c500c1b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.304936:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8b7499c59200) 00010000:00010000:0.0:1786015363.304940:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015363.304943:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9800/0xb1a5ef690c500c1b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.304949:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9800/0xb1a5ef690c500c1b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.304959:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500c0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.304965:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500c0d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.304971:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500c0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.304976:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015363.304979:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500c0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.304994:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500c0d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.305002:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8b7499c59200) 00010000:00010000:0.0:1786015363.305004:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015363.305006:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500c0d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.305012:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c500c0d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015363.305307:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+41:23934:x1872772280408576:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 14727us (14970us total) trans 4294967836 rc 0/0 00000100:00100000:0.0:1786015363.305319:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 822 00000020:00080000:0.0:1786015363.305326:0:12526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1786015363.305543:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015363.305556:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015363.306150:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1786015363.306163:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015363.306727:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280408832 00000100:00100000:3.0:1786015363.306739:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280408832 00000100:00100000:3.0:1786015363.306894:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 165 00000100:00100000:3.0:1786015363.306906:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+78:23933:x1872772280408832:12345-192.168.202.56@tcp:49:cat.0 00000100:00100000:3.0:1786015363.307096:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+78:23933:x1872772280408832:12345-192.168.202.56@tcp:49:cat.0 Request processed in 192us (2565us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015363.307103:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 165 00000100:00080000:0.0:1786015363.308106:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015363.318588:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015363.319400:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015363.319567:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280409216 00000100:00100000:0.0:1786015363.319580:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280409216 00000100:00100000:0.0:1786015363.319680:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 201 00000100:00100000:0.0:1786015363.319693:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+10:23933:x1872772280409216:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1786015363.319719:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015363.319784:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d613b153/0xb1a5ef690c500c22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8316 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015363.319822:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 158, mtime: 0x5b965aa7, atime: 0x6a746c46, ctime: 0x6a746e82, blocks: 0xb 00010000:00010000:0.0:1786015363.319854:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=598s v=(0 0) 00010000:00010000:0.0:1786015363.319860:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015363.319881:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d613b153/0xb1a5ef690c500c22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8316 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.319904:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d613b153/0xb1a5ef690c500c22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8316 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.319920:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73829f9800, rc 0) 00000100:00100000:0.0:1786015363.319997:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+11:23933:x1872772280409216:12345-192.168.202.56@tcp:101:cat.0 Request processed in 306us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015363.320005:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 201 00000100:00080000:1.0:1786015363.320287:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015363.320996:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280409088 00000100:00100000:3.0:1786015363.321007:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280409088 00000100:00100000:3.0:1786015363.321090:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 166 00000100:00100000:3.0:1786015363.321102:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+41:23934:x1872772280409088:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1786015363.322067:0:5798:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x15:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1786015363.322199:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967837 00010000:00010000:3.0:1786015363.322259:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500c29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.322288:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500c29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.322305:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500c29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.322316:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500c29 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.322322:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500c29 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.322328:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500c29 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015363.322351:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786015363.322492:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:23934:x1872772280409088:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1389us (3919us total) trans 4294967838 rc 0/0 00000100:00100000:3.0:1786015363.322502:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 166 00000020:00080000:3.0:1786015363.322508:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1786015363.323431:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786015363.323446:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500c29 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.323458:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc000 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015363.323462:0:6606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500c29 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.323472:0:6606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500c29 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.323492:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:0.0:1786015363.323495:0:6606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786015363.323500:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500c29 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.323507:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500c29 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.323533:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015363.323548:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015363.323550:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015363.326345:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015363.326461:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280409344 00000100:00100000:3.0:1786015363.326479:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280409344 00002000:00100000:3.0:1786015363.326549:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x11:0x0] (0->4095) req@ffff8b7384bb4700 x1872772280409344/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:209/0 lens 488/0 e 0 to 0 dl 1786015374 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015363.326562:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb4700 with x1872772280409344 ext(0->4095) 00002000:00010000:3.0:1786015363.326570:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384bb4700 00000100:00100000:3.0:1786015363.326613:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:3.0:1786015363.326624:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+11:2351:x1872772280409344:12345-192.168.202.56@tcp:3:cat.0 00000100:00100000:3.0:1786015363.327032:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+11:2351:x1872772280409344:12345-192.168.202.56@tcp:3:cat.0 Request processed in 407us (702us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786015363.327042:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 64 00002000:00100000:3.0:1786015363.327049:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x11:0x0] (0->4095) req@ffff8b7384bb4700 x1872772280409344/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:209/0 lens 488/4536 e 0 to 0 dl 1786015374 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015363.327057:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb4700 with x1872772280409344 ext(0->4095) 00002000:00010000:3.0:1786015363.327061:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384bb4700 00000100:00100000:0.0:1786015363.334979:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015363.335214:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280409600 00000100:00100000:3.0:1786015363.335230:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280409600 00000100:00100000:3.0:1786015363.335331:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 167 00000100:00100000:3.0:1786015363.335345:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916b5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+78:23933:x1872772280409600:12345-192.168.202.56@tcp:35:cat.0 00000001:00080000:3.0:1786015363.335759:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967839 00000100:00100000:3.0:1786015363.335939:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916b5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+80:23933:x1872772280409600:12345-192.168.202.56@tcp:35:cat.0 Request processed in 595us (972us total) trans 4294967840 rc 0/0 00000100:00100000:3.0:1786015363.335948:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 167 00000020:00080000:3.0:1786015363.335954:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786015363.354533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015363.355873:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280409856 00000100:00100000:2.0:1786015363.355895:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280409856 00000100:00100000:2.0:1786015363.356005:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 823 00000100:00100000:2.0:1786015363.356019:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+80:23937:x1872772280409856:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015363.356060:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015363.356093:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500c30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e831d expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.356214:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500c37 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.356233:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500c37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.356248:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500c37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.356267:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.356274:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.356281:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.356961:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500c45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.356990:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500c45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.357000:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500c45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015363.357013:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 158 00010000:00010000:2.0:1786015363.357147:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500c37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.357156:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500c37 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.357163:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500c37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.357169:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015363.357174:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500c37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.357183:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500c37 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.357198:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff8b7499c59800) 00010000:00010000:2.0:1786015363.357203:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015363.357208:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500c37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.357215:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500c37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.357229:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.357244:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.357250:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.357256:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015363.357259:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.357266:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.357275:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x4f0c1d45 (ffff8b7499c59900) 00010000:00010000:2.0:1786015363.357277:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015363.357280:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c3e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.357285:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.357348:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500c30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e831d expref: 83 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.357364:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907000/0xb1a5ef690c500c45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e831d expref: 82 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015363.357372:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8b7499c59200) 00010000:00010000:2.0:1786015363.357375:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015363.357384:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907000, rc 0) 00000100:00100000:2.0:1786015363.357489:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+82:23937:x1872772280409856:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1472us (2971us total) trans 4294967841 rc 0/0 00000100:00100000:2.0:1786015363.357500:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 823 00000100:00100000:1.0:1786015363.365436:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015363.367455:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280409984 00000100:00100000:0.0:1786015363.367473:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280409984 00000100:00100000:0.0:1786015363.367557:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 824 00000100:00100000:0.0:1786015363.367567:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+82:23937:x1872772280409984:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:0.0:1786015363.367662:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500c53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.367681:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.367692:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.367724:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.367729:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500c53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.367734:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500c53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.367738:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73829f9600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015363.367753:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500c53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.367781:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500c53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.367822:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8b7499c59200) 00010000:00010000:0.0:1786015363.367824:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015363.367830:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500c53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.367837:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500c53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015363.368064:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+82:23937:x1872772280409984:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 495us (2640us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015363.368073:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 824 00000100:00100000:1.0:1786015363.372681:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015363.372848:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280410240 00000100:00100000:3.0:1786015363.372861:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280410240 00000100:00100000:3.0:1786015363.372961:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 168 00000100:00100000:3.0:1786015363.372974:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+82:23937:x1872772280410240:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:3.0:1786015363.373323:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+83:23937:x1872772280410240:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 340us (648us total) trans 4294967842 rc 0/0 00000100:00100000:3.0:1786015363.373333:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 168 00000100:00100000:1.0:1786015363.555368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015363.555904:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280410496 00000100:00100000:0.0:1786015363.555925:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280410496 00000100:00100000:0.0:1786015363.556013:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 825 00000100:00100000:0.0:1786015363.556025:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+83:23953:x1872772280410496:12345-192.168.202.56@tcp:101:diff.0 00010000:00010000:0.0:1786015363.556059:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015363.556097:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500c5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8324 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.556264:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f8200/0xb1a5ef690c500c61 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.556280:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f8200/0xb1a5ef690c500c61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.556294:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f8200/0xb1a5ef690c500c61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015363.556306:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 158 00010000:00010000:0.0:1786015363.556505:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500c5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8324 expref: 86 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.556530:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f8200/0xb1a5ef690c500c61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8324 expref: 85 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015363.556540:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8b7499c59200) 00010000:00010000:0.0:1786015363.556543:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1786015363.556547:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73829f8200, rc 0) 00000100:00100000:0.0:1786015363.556623:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+85:23953:x1872772280410496:12345-192.168.202.56@tcp:101:diff.0 Request processed in 601us (1272us total) trans 4294967843 rc 0/0 00000100:00100000:0.0:1786015363.556631:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 825 00010000:00010000:0.0:1786015363.953523:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015364.332550:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015364.332563:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015364.333003:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 20 count 2 00000040:00080000:2.0:1786015364.333015:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015364.974069:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015365.995977:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015366.208332:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015366.208387:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015366.208416:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015366.208442:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015366.208462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015366.208486:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015366.208514:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015366.208550:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280411136 00000100:00100000:2.0:1786015366.208563:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280411136 00000100:00100000:2.0:1786015366.208638:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280410752 00000100:00100000:2.0:1786015366.208642:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280410752 00000100:00100000:2.0:1786015366.208670:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 370 00000100:00100000:2.0:1786015366.208681:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:2351:x1872772280411136:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015366.208834:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:2351:x1872772280411136:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 153us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015366.208842:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 370 00000100:00100000:2.0:1786015366.208863:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 371 00000100:00100000:2.0:1786015366.208870:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+85:2351:x1872772280410752:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015366.208897:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+85:2351:x1872772280410752:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015366.208915:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 371 00000100:00100000:2.0:1786015366.208943:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280410880 00000100:00100000:2.0:1786015366.208947:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280410880 00000100:00100000:2.0:1786015366.208976:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280411392 00000100:00100000:2.0:1786015366.208979:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280411392 00000100:00100000:2.0:1786015366.208993:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280411008 00000100:00100000:2.0:1786015366.208996:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280411008 00000100:00100000:2.0:1786015366.209015:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280411264 00000100:00100000:2.0:1786015366.209017:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280411264 00000100:00100000:2.0:1786015366.209033:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 336 00000100:00100000:2.0:1786015366.209040:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+11:2351:x1872772280410880:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015366.209072:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+11:2351:x1872772280410880:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015366.209079:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 336 00000100:00100000:2.0:1786015366.209091:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 337 00000100:00100000:2.0:1786015366.209097:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280411392:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015366.209122:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280411392:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015366.209128:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 337 00000100:00100000:2.0:1786015366.209139:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 338 00000100:00100000:2.0:1786015366.209145:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+11:2351:x1872772280411008:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015366.209168:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+11:2351:x1872772280411008:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015366.209174:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 338 00000100:00100000:2.0:1786015366.209430:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 339 00000100:00100000:2.0:1786015366.209446:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2351:x1872772280411264:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015366.209474:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2351:x1872772280411264:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015366.209480:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 339 00000100:00080000:2.0:1786015366.209501:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015366.209506:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015366.209509:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015366.211403:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280410624 00000100:00100000:1.0:1786015366.211420:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280410624 00000100:00100000:1.0:1786015366.211606:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 549 00000100:00100000:1.0:1786015366.211619:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280410624:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015366.216007:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280410624:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 4371us (7670us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015366.216027:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 549 00000100:00100000:0.0:1786015366.318153:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015366.318200:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304382976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015366.318299:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015366.321139:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304382976 00000100:00100000:0.0:1786015366.321163:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304382976 00000100:00100000:0.0:1786015366.321279:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1786015366.321293:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304382976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015366.321353:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64684032 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015366.321598:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304382976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 307us (3297us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015366.321607:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1786015366.321636:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015366.321697:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304382976:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786015367.021115:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015367.853059:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304383360:0@lo:400:kworker.0 00000100:00100000:0.0:1786015367.853186:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015367.853277:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015367.853284:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304383488:0@lo:400:kworker.0 00000100:00100000:0.0:1786015367.853327:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015367.853375:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304383360 00000100:00100000:0.0:1786015367.853383:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304383360 00000100:00100000:0.0:1786015367.853465:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1786015367.853478:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304383360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015367.853548:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304383360:12345-0@lo:400:kworker.0 Request processed in 72us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015367.853556:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1786015367.853602:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304383488 00000100:00100000:0.0:1786015367.853606:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304383488 00000100:00100000:0.0:1786015367.853636:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1786015367.853643:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304383488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015367.853676:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304383488:12345-0@lo:400:kworker.0 Request processed in 34us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015367.853683:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00080000:0.0:1786015367.853712:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015367.853790:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304383488:0@lo:400:kworker.0 00000100:00100000:0.0:1786015367.853805:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304383360:0@lo:400:kworker.0 00000100:00100000:2.0:1786015367.853976:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304383104:0@lo:400:kworker.0 00000100:00100000:2.0:1786015367.854024:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015367.854065:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304383616:0@lo:400:kworker.0 00000100:00100000:2.0:1786015367.854092:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015367.854116:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786015367.854123:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304383232:0@lo:400:kworker.0 00000100:00100000:2.0:1786015367.854146:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015367.854163:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304383744:0@lo:400:kworker.0 00000100:00100000:2.0:1786015367.854189:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015367.854218:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304383616 00000100:00100000:2.0:1786015367.854222:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304383616 00000100:00100000:2.0:1786015367.854260:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304383232 00000100:00100000:2.0:1786015367.854264:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304383232 00000100:00100000:2.0:1786015367.854283:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1786015367.854290:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304383616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015367.854332:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304383616:12345-0@lo:400:kworker.0 Request processed in 43us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015367.854339:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1786015367.854352:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1786015367.854378:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304383232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015367.854410:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304383232:12345-0@lo:400:kworker.0 Request processed in 32us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015367.854416:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1786015367.854447:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304383232:0@lo:400:kworker.0 00000100:00100000:2.0:1786015367.854457:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304383616:0@lo:400:kworker.0 00000100:00100000:0.0:1786015367.854648:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304383104 00000100:00100000:0.0:1786015367.854654:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304383104 00000100:00100000:0.0:1786015367.854998:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1786015367.855008:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304383104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015367.855072:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304383104:12345-0@lo:400:kworker.0 Request processed in 66us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015367.855078:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1786015367.855120:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304383744 00000100:00100000:0.0:1786015367.855125:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304383744 00000100:00100000:0.0:1786015367.855159:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1786015367.855166:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304383744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015367.855201:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304383744:12345-0@lo:400:kworker.0 Request processed in 35us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015367.855208:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00080000:3.0:1786015367.860496:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015367.860533:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015367.860639:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304383744:0@lo:400:kworker.0 00000100:00100000:3.0:1786015367.860662:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304383104:0@lo:400:kworker.0 00010000:00010000:0.0:1786015368.051971:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015368.363964:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304383872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015368.364036:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015368.365547:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304383872 00000100:00100000:1.0:1786015368.365562:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304383872 00000100:00100000:1.0:1786015368.365627:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1786015368.365638:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304383872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015368.365678:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 61276160 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015368.365803:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304383872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (1765us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015368.365811:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1786015368.365932:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304383872:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1786015368.426565:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967340 is committed 00000001:00080000:1.0:1786015368.426584:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967339 is committed 00000001:00080000:0.0:1786015368.459862:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967843 is committed 00000001:00080000:0.0:1786015368.459939:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967832 is committed 00000001:00080000:0.0:1786015368.460176:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967836 is committed 00000020:00080000:0.0:1786015368.460185:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b7382cbb480 refcount 2 committed 0 result 0 batchid 12 00000020:00080000:0.0:1786015368.460191:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74bf8abb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b7499a01600 00000020:00080000:0.0:1786015368.460195:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74bf8ab600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74c11bc800 00000001:00080000:0.0:1786015368.460240:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967838 is committed 00000020:00080000:2.0:1786015368.460533:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 12 committed batchid 11 00000020:00080000:2.0:1786015368.460740:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 11 00000100:00100000:2.0:1786015368.553558:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015368.553787:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280411520 00000100:00100000:0.0:1786015368.553797:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280411520 00000100:00100000:0.0:1786015368.553925:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 826 00000100:00100000:0.0:1786015368.553937:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+35:23881:x1872772280411520:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1786015368.554054:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+35:23881:x1872772280411520:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 119us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015368.554062:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 826 00000100:00080000:3.0:1786015368.554614:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786015369.068086:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015370.094948:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786015370.218885:0:17957:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12c: Restore a file with stripe of 2 == 07:22:48 (1786015368) 00000100:00100000:1.0:1786015370.606964:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015370.607060:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280411648 00000100:00100000:0.0:1786015370.607105:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280411648 00000100:00100000:0.0:1786015370.607220:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 827 00000100:00100000:0.0:1786015370.607231:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+35:24568:x1872772280411648:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1786015370.607398:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+35:24568:x1872772280411648:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 168us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015370.607408:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 827 00000100:00080000:2.0:1786015370.607495:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015370.654422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015370.654651:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280411776 00000100:00100000:0.0:1786015370.654666:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280411776 00000100:00100000:0.0:1786015370.654833:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 828 00000100:00100000:0.0:1786015370.654848:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+80:24569:x1872772280411776:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015370.654892:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015370.654930:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500c6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e832b expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.655026:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500c76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.655054:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500c76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.655068:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500c76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.655346:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500c7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.655356:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500c7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.655364:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500c7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.657602:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500c76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.657629:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500c76 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.657639:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500c76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.657648:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73829f9400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015370.657655:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500c76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.657664:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500c76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.657700:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:0.0:1786015370.657704:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015370.657711:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500c76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.657718:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500c76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.657743:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500c7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.657750:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500c7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.657756:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500c7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.657829:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015370.657833:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500c7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.657839:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500c7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.657860:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c6c0408 (ffff8b748f24ab00) 00010000:00010000:0.0:1786015370.657863:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015370.657866:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500c7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.657872:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500c7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.657948:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500c6f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e832b expref: 81 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786015370.657960:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786015370.657964:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:0.0:1786015370.657968:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015370.657973:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500c6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e832b expref: 81 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.657986:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73829f9600, rc 0) 00000100:00100000:0.0:1786015370.661106:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+80:24569:x1872772280411776:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 6218us (6657us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015370.661127:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 828 00000100:00100000:1.0:1786015370.667498:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015370.667620:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280412032 00000100:00100000:2.0:1786015370.667642:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280412032 00000100:00100000:2.0:1786015370.667756:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 829 00000100:00100000:2.0:1786015370.667809:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+80:24569:x1872772280412032:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:2.0:1786015370.667896:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015370.667939:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500a70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8298 expref: 80 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.667965:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:2.0:1786015370.667971:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015370.668306:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c84 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.668330:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500a9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82a6 expref: 34 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.668340:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c84 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.668384:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500a9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82a6 expref: 34 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.668400:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500a9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82a6 expref: 34 pid: 7673 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015370.668419:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304384000:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015370.668549:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74866b5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786015370.673147:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015370.673252:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280412160 00000100:00100000:3.0:1786015370.673269:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280412160 00010000:00010000:3.0:1786015370.673338:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500a9a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82a6 expref: 35 pid: 7673 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015370.673397:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 257 00000100:00100000:3.0:1786015370.673410:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+35:2354:x1872772280412160:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015370.673442:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015370.673452:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500a9a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82a6 expref: 35 pid: 7673 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.673479:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500a9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82a6 expref: 35 pid: 7673 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.673513:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:3.0:1786015370.673522:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c84 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.673536:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c84 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.673546:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c84 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.673595:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015370.673688:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+35:2354:x1872772280412160:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 281us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015370.673697:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 257 00010000:00010000:2.0:1786015370.673962:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c500a9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e82a6 expref: 34 pid: 7673 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015370.673984:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304384000:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015370.674018:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c84 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.674030:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c84 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.674036:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c84 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.674067:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500c8b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.674087:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500c8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.674096:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500c8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015370.675631:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 512 00010000:00010000:2.0:1786015370.675653:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c84 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.675664:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c84 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.675684:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c84 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.675692:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015370.675697:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c84 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.675707:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c84 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.675726:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:2.0:1786015370.675730:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015370.675735:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c84 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.675742:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500c84 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015370.675829:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000065eff820 reply state 00000000c745cdb1 transno 4294967844 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500c8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015370.675842:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786015370.675972:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+81:24569:x1872772280412032:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 8163us (8480us total) trans 4294967844 rc 0/0 00000100:00100000:2.0:1786015370.675982:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 829 00010000:00010000:1.0:1786015370.682069:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500c8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015370.682089:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500c8b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015370.682098:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500c8b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015370.682104:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015370.682109:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500c8b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015370.682116:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500c8b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015370.682137:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c6c0408 (ffff8b7499c59400) 00010000:00010000:1.0:1786015370.682140:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015370.682145:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500c8b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015370.682151:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500c8b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015370.713367:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015370.713561:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280412288 00000100:00100000:3.0:1786015370.713575:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280412288 00000100:00100000:3.0:1786015370.713655:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 830 00000100:00100000:3.0:1786015370.713668:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+80:24570:x1872772280412288:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015370.713877:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015370.713912:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c500c92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8332 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.714001:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afde00/0xb1a5ef690c500c99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.714018:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afde00/0xb1a5ef690c500c99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.714032:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afde00/0xb1a5ef690c500c99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015370.714115:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1786015370.714119:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015370.714151:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afde00/0xb1a5ef690c500c99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.714181:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c500c92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8332 expref: 82 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.714223:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afde00/0xb1a5ef690c500c99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8332 expref: 81 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.714232:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:3.0:1786015370.714236:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015370.714239:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afde00, rc 0) 00000100:00100000:3.0:1786015370.714312:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+81:24570:x1872772280412288:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 648us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015370.714321:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 830 00000100:00100000:2.0:1786015370.718126:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015370.718422:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280412416 00000100:00100000:0.0:1786015370.718436:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280412416 00000100:00100000:0.0:1786015370.718532:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 831 00000100:00100000:0.0:1786015370.718544:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+81:24570:x1872772280412416:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015370.718576:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015370.718606:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c500ca0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8339 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.718705:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c500ca7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.718724:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c500ca7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.718737:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c500ca7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.718755:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c500cae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.718809:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c500cae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.718817:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c500cae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.719369:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c500cb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.719380:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c500cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.719413:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c500cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015370.719665:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 512 00000004:00200000:0.0:1786015370.719680:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015370.719721:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c500cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.719738:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c500ca7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.719745:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c500ca7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.719754:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c500ca7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.720031:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015370.720038:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c500ca7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.720048:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c500ca7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.720065:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:0.0:1786015370.720149:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015370.720157:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c500ca7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.720164:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c500ca7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.720199:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c500cae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.720206:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c500cae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.720211:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c500cae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.720217:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015370.720220:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c500cae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.720226:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c500cae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.720235:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c6c0408 (ffff8b748f24ab00) 00010000:00010000:0.0:1786015370.720237:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015370.720240:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c500cae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.720245:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c500cae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.720292:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c500ca0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8339 expref: 83 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.720309:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c500cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8339 expref: 82 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.720329:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:0.0:1786015370.720332:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786015370.720334:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920600, rc 0) 00000100:00100000:0.0:1786015370.720512:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+82:24570:x1872772280412416:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1967us (2398us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015370.720522:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 831 00000100:00100000:0.0:1786015370.725314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015370.725443:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280412672 00000100:00100000:2.0:1786015370.725458:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280412672 00000100:00100000:2.0:1786015370.725661:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 832 00000100:00100000:2.0:1786015370.725685:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+82:24570:x1872772280412672:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015370.725721:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015370.725753:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500cbc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8340 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.726190:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500cc3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.726210:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500cc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.726225:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500cc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.726244:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500cca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.726252:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500cca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.726281:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500cca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.728121:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500cd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.728143:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.728159:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015370.728172:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 0 00010000:00010000:2.0:1786015370.728205:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500cc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.728213:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500cc3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.728221:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500cc3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.728227:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015370.728232:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500cc3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.728240:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500cc3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.728254:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:2.0:1786015370.728258:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015370.728274:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500cc3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.728281:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500cc3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015370.728301:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005fabb49a reply state 00000000fa2bce09 transno 4294967845 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500cca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015370.728312:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786015370.728360:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500cbc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8340 expref: 85 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.728376:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8340 expref: 84 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.728384:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:2.0:1786015370.728387:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015370.728389:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907600, rc 0) 00000100:00100000:2.0:1786015370.728623:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+85:24570:x1872772280412672:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 2950us (3324us total) trans 4294967845 rc 0/0 00000100:00100000:2.0:1786015370.728634:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 832 00010000:00010000:1.0:1786015370.733349:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500cca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015370.733376:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500cca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015370.733385:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500cca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015370.733412:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015370.733418:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500cca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015370.733427:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500cca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015370.733450:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff8b7499c59f00) 00010000:00010000:1.0:1786015370.733453:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015370.733457:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500cca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015370.733543:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500cca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015370.738932:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015370.739060:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280412928 00000100:00100000:3.0:1786015370.739076:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280412928 00000100:00100000:3.0:1786015370.739157:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 833 00000100:00100000:3.0:1786015370.739168:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+84:24570:x1872772280412928:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015370.739203:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015370.739233:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c500cdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8347 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.739402:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500ce6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.739421:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500cd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8340 expref: 85 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.739431:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500ce6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.739481:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8340 expref: 85 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.739506:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500cd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8340 expref: 85 pid: 5796 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015370.739523:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304384128:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015370.739642:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7483ea69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015370.743647:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304384128:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015370.743732:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500ce6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015370.746252:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015370.746751:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280413056 00000100:00100000:2.0:1786015370.746791:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280413056 00010000:00010000:2.0:1786015370.746853:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500cd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8340 expref: 86 pid: 5796 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015370.746910:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 258 00000100:00100000:2.0:1786015370.746922:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+86:2353:x1872772280413056:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015370.746966:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015370.746976:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500cd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8340 expref: 86 pid: 5796 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.746995:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8340 expref: 86 pid: 5796 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.747023:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500cd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8340 expref: 86 pid: 5796 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.747047:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:2.0:1786015370.747053:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500ce6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.747065:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500ce6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.747073:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500ce6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.747121:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015370.747162:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500ce6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.747174:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500ce6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015370.747199:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 0 00000100:00100000:2.0:1786015370.747208:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+85:2353:x1872772280413056:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 287us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015370.747217:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 258 00000100:00100000:2.0:1786015370.747468:0:7781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cadf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7781:1872772304384256:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1786015370.747538:0:7781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015370.747589:0:7781:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74866b59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015370.747649:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304384256 00000100:00100000:3.0:1786015370.747656:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304384256 00000100:00100000:3.0:1786015370.747732:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1786015370.747743:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7781:x1872772304384256:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1786015370.747829:0:6590:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:0.0:1786015370.748881:0:7673:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x12:0x0], index 1: 0 00000004:00080000:0.0:1786015370.748912:0:7673:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x10:0x0], index 0: 0 00010000:00010000:0.0:1786015370.749326:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500ce6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.749340:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500ce6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.749349:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500ce6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.749356:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015370.749372:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500ce6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.749382:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500ce6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.749405:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:0.0:1786015370.749410:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015370.749417:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500ce6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.749424:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c500ce6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.750253:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c500cdf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8347 expref: 85 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.750273:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:0.0:1786015370.750277:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015370.750282:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c500cdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8347 expref: 85 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.750298:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd600, rc 0) 00000100:00100000:0.0:1786015370.750401:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+84:24570:x1872772280412928:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 11232us (11489us total) trans 4294967846 rc 301/301 00000100:00100000:0.0:1786015370.750413:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 833 00000100:00080000:2.0:1786015370.750999:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015370.754136:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015370.754498:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280413312 00000100:00100000:2.0:1786015370.754514:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280413312 00000100:00100000:2.0:1786015370.754617:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 169 00000100:00100000:2.0:1786015370.754630:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+84:24570:x1872772280413312:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1786015370.755171:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+85:24570:x1872772280413312:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 543us (1047us total) trans 4294967847 rc 0/0 00000100:00100000:2.0:1786015370.755181:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 169 00000100:00100000:1.0:1786015370.757360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015370.757975:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280413440 00000100:00100000:2.0:1786015370.757992:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280413440 00000100:00100000:2.0:1786015370.758098:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 834 00000100:00100000:2.0:1786015370.758111:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+85:24570:x1872772280413440:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015370.758145:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015370.758178:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500cf4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e834e expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.758258:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500cf4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e834e expref: 86 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.758281:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500cf4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e834e expref: 86 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.758307:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:2.0:1786015370.758311:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015370.758315:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906000, rc 0) 00000100:00100000:2.0:1786015370.758393:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+86:24570:x1872772280413440:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 284us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015370.758400:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 834 00000100:00100000:1.0:1786015370.762699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015370.762993:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280413696 00000100:00100000:0.0:1786015370.763009:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280413696 00000100:00100000:0.0:1786015370.763114:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 170 00000100:00100000:0.0:1786015370.763149:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+86:24570:x1872772280413696:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:0.0:1786015370.763511:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+87:24570:x1872772280413696:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 364us (826us total) trans 4294967848 rc 0/0 00000100:00100000:0.0:1786015370.763521:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 170 00000100:00100000:2.0:1786015370.812624:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7781:x1872772304384256:12345-0@lo:5:osp-pre-1-0.0 Request processed in 64869us (65071us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1786015370.812641:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1786015370.815127:0:7781:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967340 gen 2 00000004:00080000:0.0:1786015370.815144:0:7781:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967340 committed transno 4294967340 00000100:00100000:0.0:1786015370.815186:0:7781:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8b74b8cadf80 x1872772304384256/t4294967341(4294967341) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786015386 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786015370.815203:0:7781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cadf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7781:1872772304384256:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1786015370.815224:0:7781:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x12:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1786015370.847320:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015370.847440:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280413824 00000100:00100000:2.0:1786015370.847451:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280413824 00000100:00100000:2.0:1786015370.847534:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 835 00000100:00100000:2.0:1786015370.847547:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+87:24576:x1872772280413824:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:2.0:1786015370.847589:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015370.847622:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500cfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8355 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.847749:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500d02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.847815:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500d02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.847831:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500d02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015370.847917:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 512 00000004:00200000:2.0:1786015370.847922:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015370.847947:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500d02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.847975:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c500cfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8355 expref: 89 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.847995:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500d02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8355 expref: 88 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.848025:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:2.0:1786015370.848028:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015370.848032:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907e00, rc 0) 00000100:00100000:2.0:1786015370.848118:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+88:24576:x1872772280413824:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 574us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015370.848125:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 835 00000100:00100000:0.0:1786015370.863875:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015370.864580:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280413952 00000100:00100000:3.0:1786015370.864601:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280413952 00000100:00100000:3.0:1786015370.864709:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 836 00000100:00100000:3.0:1786015370.864721:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+88:24577:x1872772280413952:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015370.864745:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015370.864808:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500d09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e835c expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.864899:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d10 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.864915:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.864935:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.864954:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.864961:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.864968:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.866910:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c500d1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.866930:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c500d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.866943:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c500d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015370.866997:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 0 00000004:00200000:3.0:1786015370.867003:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015370.867028:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c500d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.867040:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c500d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.867049:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.867206:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d10 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.867216:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.867221:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015370.867226:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.867233:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d10 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.867247:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:3.0:1786015370.867250:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015370.867256:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.867262:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.867280:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.867287:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.867293:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.867298:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015370.867308:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.867315:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.867323:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff8b74a04b5200) 00010000:00010000:3.0:1786015370.867325:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015370.867328:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.867334:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.867839:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500d09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e835c expref: 90 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.867862:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c500d1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e835c expref: 89 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.867871:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:3.0:1786015370.867873:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015370.867876:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc600, rc 0) 00000100:00100000:3.0:1786015370.868469:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+89:24577:x1872772280413952:12345-192.168.202.56@tcp:101:rm.0 Request processed in 3746us (4616us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015370.868480:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 836 00000100:00100000:1.0:1786015370.872475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015370.872538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015370.872639:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280414080 00000100:00100000:2.0:1786015370.872653:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280414080 00000100:00100000:2.0:1786015370.872797:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280414208 00000100:00100000:2.0:1786015370.872802:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280414208 00000100:00100000:2.0:1786015370.872836:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 203 00000100:00100000:2.0:1786015370.872860:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+11:2354:x1872772280414080:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015370.872889:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015370.872920:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500d25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8363 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015370.872958:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786015370.872986:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=606s v=(0 0) 00010000:00010000:2.0:1786015370.872990:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015370.873000:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500d25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8363 expref: 12 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.873020:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500d25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8363 expref: 12 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.873057:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907600, rc 0) 00000100:00100000:1.0:1786015370.873190:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 204 00000100:00100000:1.0:1786015370.873200:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+11:2354:x1872772280414208:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:1.0:1786015370.873210:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015370.873223:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500d2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e836a expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015370.873239:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786015370.873247:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=606s v=(0 0) 00010000:00010000:1.0:1786015370.873255:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015370.873260:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500d2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e836a expref: 12 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015370.873272:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500d2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e836a expref: 12 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015370.873278:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2178000, rc 0) 00000100:00100000:1.0:1786015370.873340:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280414208:12345-192.168.202.56@tcp:101:rm.0 Request processed in 143us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015370.873346:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 204 00000100:00080000:3.0:1786015370.873573:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786015370.873580:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015370.873853:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280414080:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1005us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015370.873858:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 203 00000100:00100000:0.0:1786015370.877725:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015370.878002:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280414464 00000100:00100000:2.0:1786015370.878017:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280414464 00000100:00100000:2.0:1786015370.878261:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 837 00000100:00100000:2.0:1786015370.878275:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916a2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+89:24577:x1872772280414464:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:2.0:1786015370.878363:0:12526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1786015370.878411:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c500d1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e835c expref: 89 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.878442:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500cf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e834e expref: 88 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.878456:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:2.0:1786015370.878481:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c500d02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8355 expref: 87 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.878490:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:2.0:1786015370.878494:0:12526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015370.878528:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500d33 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.878545:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500d33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.878580:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500d33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.878601:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500d3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.878609:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500d3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.878616:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500d3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.878871:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500d41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.878881:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500d41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.878889:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500d41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786015370.879726:0:12526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].10, 64 off8904 00000004:00080000:2.0:1786015370.879741:0:12526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 606130978709ns, next at 607130975658ns, rc = 0 00000040:00080000:2.0:1786015370.879859:0:12526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8664 00000004:00080000:2.0:1786015370.879867:0:12526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 606131105496ns, next at 607131104324ns, rc = 0 00010000:00010000:2.0:1786015370.879954:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.879968:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.879992:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.880002:0:12526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d48 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.880008:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d48 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.880015:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.880038:0:12526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786015370.880063:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500d41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.880069:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500d41 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.880076:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500d41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.880083:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015370.880088:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500d41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.880097:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500d41 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.880107:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:2.0:1786015370.880110:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786015370.880123:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500d41 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.880130:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500d41 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.880152:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500d33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.880159:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500d33 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.880164:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500d33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.880170:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015370.880173:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500d33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.880180:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500d33 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.880188:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:2.0:1786015370.880190:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015370.880193:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500d33 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.880199:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c500d33 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015370.880210:0:12526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000582b9a5a reply state 00000000dc9fb182 transno 4294967849 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500d3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015370.880232:0:12526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786015370.880346:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916a2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+88:24577:x1872772280414464:12345-192.168.202.56@tcp:36:rm.0 Request processed in 2070us (2634us total) trans 4294967849 rc 0/0 00000100:00100000:2.0:1786015370.880356:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 837 00010000:00010000:1.0:1786015370.882348:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786015370.882366:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015370.882379:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906800 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015370.882384:0:6606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015370.882395:0:6606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015370.882414:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:1.0:1786015370.882417:0:6606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786015370.882423:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d48 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015370.882430:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015370.882484:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015370.882487:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015370.882489:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015370.894290:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500d3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.894336:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500d3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.894344:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500d3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.894351:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015370.894357:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500d3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.894365:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500d3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.894389:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff8b7499c59a00) 00010000:00010000:3.0:1786015370.894393:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015370.894399:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500d3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.894405:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500d3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015370.896080:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015370.896219:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280414720 00000100:00100000:3.0:1786015370.896234:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280414720 00000100:00100000:3.0:1786015370.896310:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 838 00000100:00100000:3.0:1786015370.896322:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+87:24578:x1872772280414720:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:3.0:1786015370.896361:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015370.896392:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500d4f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8371 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.896616:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d56 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.896635:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.896649:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.896666:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.896684:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.896690:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786015370.897404:0:5796:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x13:0x0], index 1: 0 00010000:00010000:3.0:1786015370.897628:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c500d64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.897641:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c500d64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.897651:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c500d64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.897711:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.897731:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d56 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.897738:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d56 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.897745:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015370.897749:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d56 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.897757:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d56 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.897804:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:3.0:1786015370.897808:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015370.897814:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d56 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.897820:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c500d56 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015370.897839:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006e4b86d5 reply state 00000000c2a0ef88 transno 4294967850 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015370.897850:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786015370.897894:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c500d4f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8371 expref: 90 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.897910:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c500d64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8371 expref: 89 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015370.897932:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b74a04b5b00) 00010000:00010000:3.0:1786015370.897934:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015370.897937:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afda00, rc 0) 00000100:00100000:3.0:1786015370.898031:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+90:24578:x1872772280414720:12345-192.168.202.56@tcp:101:dd.0 Request processed in 1710us (1964us total) trans 4294967850 rc 0/0 00000100:00100000:3.0:1786015370.898040:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 838 00010000:00010000:0.0:1786015370.903196:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.903221:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.903230:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.903236:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015370.903241:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.903250:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.903293:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff8b74a04b5200) 00010000:00010000:0.0:1786015370.903296:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015370.903302:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015370.903310:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c500d5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015370.911901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015370.912338:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280414848 00000100:00100000:2.0:1786015370.912351:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280414848 00000100:00100000:2.0:1786015370.912421:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 205 00000100:00100000:2.0:1786015370.912434:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+12:24578:x1872772280414848:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:2.0:1786015370.912463:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015370.912495:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075b2724f/0xb1a5ef690c500d72 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8378 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015370.912547:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786015370.912580:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=606s v=(0 0) 00010000:00010000:2.0:1786015370.912586:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015370.912599:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075b2724f/0xb1a5ef690c500d72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8378 expref: 13 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.912619:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075b2724f/0xb1a5ef690c500d72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8378 expref: 13 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015370.912634:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906400, rc 0) 00000100:00100000:2.0:1786015370.912736:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+13:24578:x1872772280414848:12345-192.168.202.56@tcp:101:dd.0 Request processed in 303us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015370.912745:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 205 00000100:00100000:1.0:1786015370.938078:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015370.938224:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280414976 00000100:00100000:3.0:1786015370.938237:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280414976 00002000:00100000:3.0:1786015370.938312:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff8b7384bb7100 x1872772280414976/t0(0) o4->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:216/0 lens 488/0 e 0 to 0 dl 1786015381 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015370.938325:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb7100 with x1872772280414976 ext(0->1048575) 00002000:00010000:3.0:1786015370.938333:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384bb7100 00000100:00100000:3.0:1786015370.938376:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 65 00000100:00100000:3.0:1786015370.938388:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+13:2352:x1872772280414976:12345-192.168.202.56@tcp:4:dd.0 00000100:00100000:3.0:1786015370.971263:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+15:2352:x1872772280414976:12345-192.168.202.56@tcp:4:dd.0 Request processed in 32858us (33181us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1786015370.971283:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 65 00002000:00100000:3.0:1786015370.971301:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff8b7384bb7100 x1872772280414976/t4294967342(0) o4->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:216/0 lens 488/448 e 0 to 0 dl 1786015381 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015370.971313:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb7100 with x1872772280414976 ext(0->1048575) 00002000:00010000:3.0:1786015370.971322:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384bb7100 00000100:00100000:1.0:1786015370.990381:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015370.990525:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280415104 00000100:00100000:2.0:1786015370.990552:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280415104 00002000:00100000:2.0:1786015370.990627:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (1048576->2097151) req@ffff8b7384bb4000 x1872772280415104/t0(0) o4->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:216/0 lens 488/0 e 0 to 0 dl 1786015381 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015370.990639:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb4000 with x1872772280415104 ext(1048576->2097151) 00002000:00010000:2.0:1786015370.990647:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384bb4000 00000100:00100000:2.0:1786015370.990699:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 66 00000100:00100000:2.0:1786015370.990710:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41677fca-39fb-471c-b582-96bce6540a36+15:2354:x1872772280415104:12345-192.168.202.56@tcp:4:dd.0 00000100:00100000:1.0:1786015371.021917:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015371.023967:0:6598:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1786015371.023994:0:6598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1786015371.032045:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280415232 00000100:00100000:3.0:1786015371.032066:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280415232 00002000:00100000:3.0:1786015371.032149:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x13:0x0] (2097152->3145727) req@ffff8b7384bb4a80 x1872772280415232/t0(0) o4->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:217/0 lens 488/0 e 0 to 0 dl 1786015382 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015371.032162:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb4a80 with x1872772280415232 ext(2097152->3145727) 00002000:00010000:3.0:1786015371.032170:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384bb4a80 00000100:00100000:2.0:1786015371.037016:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280415104:12345-192.168.202.56@tcp:4:dd.0 Request processed in 46289us (46632us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1786015371.037035:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 66 00002000:00100000:2.0:1786015371.037054:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (1048576->2097151) req@ffff8b7384bb4000 x1872772280415104/t4294967343(0) o4->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:216/0 lens 488/448 e 0 to 0 dl 1786015381 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015371.037067:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb4000 with x1872772280415104 ext(1048576->2097151) 00002000:00010000:2.0:1786015371.037076:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384bb4000 00000100:00100000:2.0:1786015371.037121:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 67 00000100:00100000:2.0:1786015371.037136:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280415232:12345-192.168.202.56@tcp:4:dd.0 00000100:00100000:1.0:1786015371.065741:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015371.072148:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280415360 00000100:00100000:3.0:1786015371.072172:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280415360 00002000:00100000:2.0:1786015371.072390:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x13:0x0] (3145728->4194303) req@ffff8b7384bb6d80 x1872772280415360/t0(0) o4->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:217/0 lens 488/0 e 0 to 0 dl 1786015382 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015371.072404:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb6d80 with x1872772280415360 ext(3145728->4194303) 00002000:00010000:2.0:1786015371.072413:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384bb6d80 00000100:00100000:2.0:1786015371.072453:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:2.0:1786015371.072465:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+19:2353:x1872772280415360:12345-192.168.202.56@tcp:4:dd.0 00000100:00100000:0.0:1786015371.087507:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015371.087573:0:17969:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1786015371.087588:0:17969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1786015371.089646:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015371.089713:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280415744 00000100:00100000:3.0:1786015371.089729:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280415744 00000100:00100000:3.0:1786015371.089866:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 171 00000100:00100000:3.0:1786015371.089880:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+89:24578:x1872772280415744:12345-192.168.202.56@tcp:35:dd.0 00000100:00100000:3.0:1786015371.090398:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+90:24578:x1872772280415744:12345-192.168.202.56@tcp:35:dd.0 Request processed in 520us (765us total) trans 4294967851 rc 0/0 00000100:00100000:3.0:1786015371.090407:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 171 00000100:00100000:1.0:1786015371.093220:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41677fca-39fb-471c-b582-96bce6540a36+21:2351:x1872772280415232:12345-192.168.202.56@tcp:4:dd.0 Request processed in 56074us (71303us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1786015371.093239:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 67 00002000:00100000:1.0:1786015371.093260:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (2097152->3145727) req@ffff8b7384bb4a80 x1872772280415232/t4294967344(0) o4->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:217/0 lens 488/448 e 0 to 0 dl 1786015382 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015371.093272:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb4a80 with x1872772280415232 ext(2097152->3145727) 00002000:00010000:1.0:1786015371.093282:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384bb4a80 00000100:00100000:1.0:1786015371.093325:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280415488 00000100:00100000:1.0:1786015371.093335:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280415488 00002000:00100000:1.0:1786015371.093376:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (4194304->5242879) req@ffff8b7381f9c000 x1872772280415488/t0(0) o4->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:217/0 lens 488/0 e 0 to 0 dl 1786015382 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015371.093384:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381f9c000 with x1872772280415488 ext(4194304->5242879) 00002000:00010000:1.0:1786015371.093387:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7381f9c000 00000100:00100000:1.0:1786015371.093424:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:1.0:1786015371.093434:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41677fca-39fb-471c-b582-96bce6540a36+21:2353:x1872772280415488:12345-192.168.202.56@tcp:4:dd.0 00010000:00010000:0.0:1786015371.116192:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015371.124553:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+23:2353:x1872772280415360:12345-192.168.202.56@tcp:4:dd.0 Request processed in 52072us (58810us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1786015371.124571:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 68 00002000:00100000:2.0:1786015371.124591:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x13:0x0] (3145728->4194303) req@ffff8b7384bb6d80 x1872772280415360/t4294967345(0) o4->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:217/0 lens 488/448 e 0 to 0 dl 1786015382 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015371.124602:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb6d80 with x1872772280415360 ext(3145728->4194303) 00002000:00010000:2.0:1786015371.124613:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384bb6d80 00000100:00100000:2.0:1786015371.148468:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41677fca-39fb-471c-b582-96bce6540a36+23:2353:x1872772280415488:12345-192.168.202.56@tcp:4:dd.0 Request processed in 55016us (60958us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1786015371.148489:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 69 00002000:00100000:2.0:1786015371.148508:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (4194304->5242879) req@ffff8b7381f9c000 x1872772280415488/t4294967346(0) o4->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:217/0 lens 488/448 e 0 to 0 dl 1786015382 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015371.148520:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381f9c000 with x1872772280415488 ext(4194304->5242879) 00002000:00010000:2.0:1786015371.148529:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7381f9c000 00000100:00100000:1.0:1786015371.161877:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015371.161997:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280416000 00000100:00100000:2.0:1786015371.162015:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280416000 00000100:00100000:2.0:1786015371.162102:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 839 00000100:00100000:2.0:1786015371.162112:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+90:24581:x1872772280416000:12345-192.168.202.56@tcp:101:md5sum.0 00010000:00010000:2.0:1786015371.162141:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015371.162164:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500d79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e837f expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.162275:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500d80 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.162308:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500d80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.162321:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500d80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015371.162335:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00010000:00010000:2.0:1786015371.162479:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500d79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e837f expref: 93 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.162505:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500d80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e837f expref: 92 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.162515:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b74a04b5b00) 00010000:00010000:2.0:1786015371.162518:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1786015371.162522:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906e00, rc 0) 00000100:00100000:2.0:1786015371.162594:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+92:24581:x1872772280416000:12345-192.168.202.56@tcp:101:md5sum.0 Request processed in 482us (744us total) trans 4294967852 rc 0/0 00000100:00100000:2.0:1786015371.162603:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 839 00000100:00100000:3.0:1786015371.201583:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015371.201946:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280416128 00000100:00100000:2.0:1786015371.201965:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280416128 00000100:00100000:2.0:1786015371.202049:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 840 00000100:00100000:2.0:1786015371.202062:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+92:24582:x1872772280416128:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015371.202090:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015371.202120:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500d8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8386 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.202228:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.202241:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.202253:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015371.202310:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 512 00000004:00200000:2.0:1786015371.202313:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015371.202455:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.202480:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500d8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8386 expref: 94 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.202499:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8386 expref: 93 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.202507:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:2.0:1786015371.202509:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015371.202513:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906800, rc 0) 00000100:00100000:2.0:1786015371.202589:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+93:24582:x1872772280416128:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 531us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015371.202597:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 840 00000100:00100000:0.0:1786015371.207887:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015371.208090:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280416384 00000100:00100000:2.0:1786015371.208106:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280416384 00000100:00100000:2.0:1786015371.208208:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 841 00000100:00100000:2.0:1786015371.208219:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+93:24582:x1872772280416384:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:2.0:1786015371.208598:0:12526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].20, 136 off10912 00000100:00100000:2.0:1786015371.208728:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+93:24582:x1872772280416384:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 510us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015371.208738:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 841 00000100:00100000:2.0:1786015371.326480:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015371.326513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015371.326628:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015371.326657:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280416512 00000100:00100000:2.0:1786015371.326680:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280416512 00000100:00100000:2.0:1786015371.326790:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 551 00000100:00100000:2.0:1786015371.326804:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280416512:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015371.328164:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280416512:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 1353us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015371.328180:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 551 00000100:00100000:2.0:1786015371.328301:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015371.328466:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015371.332574:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280416640 00000100:00100000:3.0:1786015371.332596:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280416640 00000100:00100000:3.0:1786015371.332688:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280416896 00000100:00100000:3.0:1786015371.332691:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280416896 00000100:00100000:3.0:1786015371.332743:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 342 00000100:00100000:3.0:1786015371.332965:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280416640:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015371.333086:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280416640:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 332us (6620us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015371.333095:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 342 00000100:00100000:3.0:1786015371.333118:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 343 00000100:00100000:3.0:1786015371.333140:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280416896:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015371.333169:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280416896:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (6656us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015371.333175:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 343 00000100:00080000:1.0:1786015371.333183:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015371.333381:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280416768 00000100:00100000:1.0:1786015371.333387:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280416768 00000100:00100000:1.0:1786015371.333436:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 375 00000100:00100000:1.0:1786015371.333445:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+34:2354:x1872772280416768:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015371.333484:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+34:2354:x1872772280416768:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 41us (5185us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015371.333491:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 375 00000100:00100000:1.0:1786015371.338649:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280417024 00000100:00100000:1.0:1786015371.338682:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280417024 00000100:00100000:1.0:1786015371.338969:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 344 00000100:00100000:1.0:1786015371.338983:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280417024:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015371.339115:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280417024:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 135us (10648us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015371.339124:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 344 00000100:00080000:3.0:1786015371.339426:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015371.437042:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015371.437078:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304384384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015371.437179:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015371.437608:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304384384 00000100:00100000:0.0:1786015371.437620:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304384384 00000100:00100000:0.0:1786015371.437707:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1786015371.437717:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304384384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015371.437798:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64684032 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015371.437861:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304384384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015371.437870:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1786015371.437933:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304384384:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786015371.439071:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1786015371.500343:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015371.500360:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015371.500409:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 21 count 3 00000040:00080000:2.0:1786015371.500420:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015371.502210:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8caca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304384512:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786015371.504109:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0175180 going to sleep for 11 seconds 00000100:00100000:2.0:1786015371.510491:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8caca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304384512:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015371.510688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015371.511237:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280417152 00000100:00100000:3.0:1786015371.511249:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280417152 00000100:00100000:3.0:1786015371.511362:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 842 00000100:00100000:3.0:1786015371.511375:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+34:24592:x1872772280417152:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015371.511419:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x38:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015371.511570:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+34:24592:x1872772280417152:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 197us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015371.511580:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 842 00000100:00100000:1.0:1786015371.515107:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015371.524709:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280417408 00000100:00100000:2.0:1786015371.524782:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280417408 00000100:00100000:2.0:1786015371.524891:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 843 00000100:00100000:2.0:1786015371.524903:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+34:24592:x1872772280417408:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015371.524937:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015371.524971:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500d9c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e838d expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.525113:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500da3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.525131:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500da3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.525146:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500da3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015371.525161:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00010000:00010000:2.0:1786015371.525340:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c500d9c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e838d expref: 37 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.525364:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500da3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e838d expref: 36 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.525373:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b74a04b5b00) 00010000:00010000:2.0:1786015371.525376:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015371.525380:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906000, rc 0) 00000100:00100000:2.0:1786015371.525468:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+36:24592:x1872772280417408:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 567us (10378us total) trans 4294967853 rc 0/0 00000100:00100000:2.0:1786015371.525477:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 843 00000100:00100000:2.0:1786015371.531887:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015371.532277:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280417536 00000100:00100000:3.0:1786015371.532292:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280417536 00000100:00100000:3.0:1786015371.532371:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 206 00000100:00100000:3.0:1786015371.532383:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280417536:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015371.532456:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005d547258/0xb1a5ef690c500db1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015371.532488:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075b2724f/0xb1a5ef690c500d72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8378 expref: 22 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015371.532498:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015371.532502:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015371.532507:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d547258/0xb1a5ef690c500db1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015371.532586:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075b2724f/0xb1a5ef690c500d72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8378 expref: 22 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015371.532605:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075b2724f/0xb1a5ef690c500d72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8378 expref: 22 pid: 6590 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015371.532622:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304384640:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015371.532757:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7483ea6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786015371.545683:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015371.545825:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280417664 00000100:00100000:0.0:1786015371.545851:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280417664 00010000:00010000:0.0:1786015371.545916:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075b2724f/0xb1a5ef690c500d72 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8378 expref: 23 pid: 6590 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015371.545964:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 259 00000100:00100000:0.0:1786015371.545976:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74865a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+23:2354:x1872772280417664:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015371.545998:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786015371.546027:0:5782:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:0.0:1786015371.546031:0:5782:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb mtime from disk: 0 -> 1786015371 00002000:00010000:0.0:1786015371.546034:0:5782:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb ctime from disk: 0 -> 1786015371 00010000:00010000:0.0:1786015371.546042:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075b2724f/0xb1a5ef690c500d72 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8378 expref: 23 pid: 6590 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015371.546060:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075b2724f/0xb1a5ef690c500d72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8378 expref: 23 pid: 6590 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015371.546097:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015371.546102:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015371.546111:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d547258/0xb1a5ef690c500db1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015371.546124:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d547258/0xb1a5ef690c500db1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015371.546150:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015371.546221:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74865a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+23:2354:x1872772280417664:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 247us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015371.546238:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 259 00010000:00010000:1.0:1786015371.547180:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075b2724f/0xb1a5ef690c500d72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8378 expref: 22 pid: 6590 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015371.547208:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304384640:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015371.547239:0:11384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d547258/0xb1a5ef690c500db1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.547251:0:11384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d547258/0xb1a5ef690c500db1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.547275:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d547258/0xb1a5ef690c500db1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.547317:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005d547258/0xb1a5ef690c500db1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.547326:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d547258/0xb1a5ef690c500db1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.547334:0:11384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d547258/0xb1a5ef690c500db1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.547341:0:11384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc800 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015371.547345:0:11384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d547258/0xb1a5ef690c500db1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.547354:0:11384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d547258/0xb1a5ef690c500db1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.547371:0:11384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d547258/0xb1a5ef690c500db1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.547379:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d547258/0xb1a5ef690c500db1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015371.547478:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280417536:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 15096us (15605us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015371.547489:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 206 00000100:00100000:0.0:1786015371.551364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015371.551485:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280417920 00000100:00100000:3.0:1786015371.551500:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280417920 00000100:00100000:3.0:1786015371.551584:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 844 00000100:00100000:3.0:1786015371.551596:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+36:24592:x1872772280417920:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786015371.551801:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+36:24592:x1872772280417920:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 207us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015371.551811:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 844 00000100:00100000:2.0:1786015371.557177:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015371.557559:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280418048 00000100:00100000:1.0:1786015371.557575:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280418048 00000100:00100000:1.0:1786015371.557674:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 207 00000100:00100000:1.0:1786015371.557690:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280418048:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015371.557723:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015371.557755:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500db8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8394 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015371.557860:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 5242880, mtime: 0x6a746e8b, atime: 0x0, ctime: 0x6a746e8b, blocks: 0x1 00010000:00010000:1.0:1786015371.557893:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=606s v=(0 0) 00010000:00010000:1.0:1786015371.557899:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015371.557912:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500db8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8394 expref: 10 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.557935:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500db8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8394 expref: 10 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.557954:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2179600, rc 0) 00000100:00100000:1.0:1786015371.558037:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280418048:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 352us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015371.558046:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 207 00000100:00100000:1.0:1786015371.561460:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015371.570525:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280418304 00000100:00100000:2.0:1786015371.570552:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280418304 00000100:00100000:2.0:1786015371.570660:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 845 00000100:00100000:2.0:1786015371.570684:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+36:24592:x1872772280418304:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015371.570903:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+36:24592:x1872772280418304:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 222us (9458us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015371.570912:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 845 00000100:00100000:3.0:1786015371.594483:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015371.594589:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280418432 00000100:00100000:1.0:1786015371.594605:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280418432 00002000:00100000:1.0:1786015371.594683:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff8b74bf4bd180 x1872772280418432/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:217/0 lens 488/0 e 0 to 0 dl 1786015382 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015371.594697:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74bf4bd180 with x1872772280418432 ext(0->1048575) 00002000:00010000:1.0:1786015371.594705:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74bf4bd180 00000100:00100000:1.0:1786015371.594754:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00100000:1.0:1786015371.594797:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280418432:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1786015371.657949:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280418432:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 63135us (63463us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786015371.657967:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 70 00002000:00100000:1.0:1786015371.657987:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff8b74bf4bd180 x1872772280418432/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:217/0 lens 488/440 e 0 to 0 dl 1786015382 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015371.658000:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74bf4bd180 with x1872772280418432 ext(0->1048575) 00002000:00010000:1.0:1786015371.658009:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74bf4bd180 00000100:00100000:1.0:1786015371.681524:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015371.681639:0:17970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280418560 00000100:00100000:3.0:1786015371.681654:0:17970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280418560 00002000:00100000:3.0:1786015371.681802:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x13:0x0] (1048576->2097151) req@ffff8b7384bb5180 x1872772280418560/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:217/0 lens 488/0 e 0 to 0 dl 1786015382 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015371.681814:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb5180 with x1872772280418560 ext(1048576->2097151) 00002000:00010000:3.0:1786015371.681823:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384bb5180 00000100:00100000:3.0:1786015371.681867:0:17970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 71 00000100:00100000:3.0:1786015371.681878:0:17970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280418560:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1786015371.719959:0:17970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280418560:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 38067us (38435us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786015371.719979:0:17970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 71 00002000:00100000:3.0:1786015371.719996:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x13:0x0] (1048576->2097151) req@ffff8b7384bb5180 x1872772280418560/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:217/0 lens 488/440 e 0 to 0 dl 1786015382 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015371.720007:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb5180 with x1872772280418560 ext(1048576->2097151) 00002000:00010000:3.0:1786015371.720017:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384bb5180 00000100:00100000:1.0:1786015371.766362:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015371.766397:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015371.766430:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280418688 00000100:00100000:1.0:1786015371.766443:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280418688 00002000:00100000:1.0:1786015371.766504:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (2097152->3145727) req@ffff8b7384bb4380 x1872772280418688/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:217/0 lens 488/0 e 0 to 0 dl 1786015382 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015371.766518:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb4380 with x1872772280418688 ext(2097152->3145727) 00002000:00010000:1.0:1786015371.766525:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384bb4380 00000100:00100000:1.0:1786015371.766563:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280418816 00000100:00100000:1.0:1786015371.766567:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280418816 00002000:00100000:1.0:1786015371.766583:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (3145728->4194303) req@ffff8b7384bb7480 x1872772280418816/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:217/0 lens 488/0 e 0 to 0 dl 1786015382 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015371.766592:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb7480 with x1872772280418816 ext(3145728->4194303) 00002000:00010000:1.0:1786015371.766596:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384bb7480 00000100:00100000:1.0:1786015371.766617:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 72 00000100:00100000:1.0:1786015371.766627:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280418688:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1786015371.767286:0:17969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 73 00000100:00100000:0.0:1786015371.767302:0:17969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2352:x1872772280418816:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1786015371.809414:0:17969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2352:x1872772280418816:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 42096us (42993us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786015371.809435:0:17969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 73 00002000:00100000:1.0:1786015371.809454:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x13:0x0] (3145728->4194303) req@ffff8b7384bb7480 x1872772280418816/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:217/0 lens 488/440 e 0 to 0 dl 1786015382 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015371.809465:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb7480 with x1872772280418816 ext(3145728->4194303) 00002000:00010000:1.0:1786015371.809475:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384bb7480 00000100:00100000:1.0:1786015371.829641:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2352:x1872772280418688:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 62997us (63276us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786015371.829667:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 72 00002000:00100000:1.0:1786015371.829686:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (2097152->3145727) req@ffff8b7384bb4380 x1872772280418688/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:217/0 lens 488/440 e 0 to 0 dl 1786015382 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015371.829699:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb4380 with x1872772280418688 ext(2097152->3145727) 00002000:00010000:1.0:1786015371.829709:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384bb4380 00000100:00100000:3.0:1786015371.854982:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015371.855099:0:17970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280418944 00000100:00100000:1.0:1786015371.855131:0:17970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280418944 00002000:00100000:1.0:1786015371.855201:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x13:0x0] (4194304->5242879) req@ffff8b74bf4bea00 x1872772280418944/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:217/0 lens 488/0 e 0 to 0 dl 1786015382 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015371.855213:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74bf4bea00 with x1872772280418944 ext(4194304->5242879) 00002000:00010000:1.0:1786015371.855222:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74bf4bea00 00000100:00100000:1.0:1786015371.855264:0:17970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 74 00000100:00100000:1.0:1786015371.855275:0:17970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280418944:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1786015371.876961:0:17970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280418944:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 21669us (22101us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786015371.876981:0:17970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 74 00002000:00100000:1.0:1786015371.876998:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x13:0x0] (4194304->5242879) req@ffff8b74bf4bea00 x1872772280418944/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:217/0 lens 488/440 e 0 to 0 dl 1786015382 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015371.877010:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74bf4bea00 with x1872772280418944 ext(4194304->5242879) 00002000:00010000:1.0:1786015371.877019:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74bf4bea00 00000100:00100000:2.0:1786015371.899689:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015371.900917:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280419072 00000100:00100000:2.0:1786015371.900936:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280419072 00000100:00100000:2.0:1786015371.901035:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 846 00000100:00100000:2.0:1786015371.901047:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+36:24592:x1872772280419072:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015371.901077:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015371.901105:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c500dbf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e839b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.901153:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c500dc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.901170:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c500dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.901186:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c500dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.901321:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c500dbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e839b expref: 38 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.901352:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c500dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e839b expref: 37 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015371.901362:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b74a04b5b00) 00010000:00010000:2.0:1786015371.901365:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015371.901368:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47800, rc 0) 00000100:00100000:2.0:1786015371.901459:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+37:24592:x1872772280419072:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 414us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015371.901468:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 846 00000100:00100000:2.0:1786015371.920563:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015371.920795:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280419200 00000100:00100000:1.0:1786015371.920810:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280419200 00000100:00100000:1.0:1786015371.921970:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 847 00000100:00100000:1.0:1786015371.921988:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+37:24592:x1872772280419200:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786015371.922038:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x38:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786015371.922198:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+37:24592:x1872772280419200:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 216us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015371.922206:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 847 00000100:00100000:1.0:1786015371.925401:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015371.925447:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280419328 00000100:00100000:1.0:1786015371.925481:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280419328 00000100:00100000:1.0:1786015371.925555:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 208 00000100:00100000:1.0:1786015371.925566:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280419328:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015371.925633:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c500dcd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.925657:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786015371.925672:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015371.927167:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c500dcd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.927210:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c500dcd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.927263:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c500dcd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.927275:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c500dcd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.927285:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c500dcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.927294:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920a00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015371.927300:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c500dcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.927326:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c500dcd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.927347:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c500dcd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015371.927356:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c500dcd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015371.927478:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280419328:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 1908us (2086us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015371.927488:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 208 00000100:00100000:1.0:1786015371.930360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015371.934101:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280419584 00000100:00100000:0.0:1786015371.934126:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280419584 00000100:00100000:0.0:1786015371.934996:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 848 00000100:00100000:0.0:1786015371.935013:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+37:24592:x1872772280419584:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786015371.935134:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32800/0xb1a5ef690c500dd4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015371.935156:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c500dc6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e839b expref: 37 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015371.935167:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32800/0xb1a5ef690c500dd4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015371.935220:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c500dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e839b expref: 37 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015371.935238:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c500dc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e839b expref: 37 pid: 5796 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015371.935257:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304384768:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015371.935400:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015371.940088:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015371.940135:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280419712 00000100:00100000:3.0:1786015371.940148:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280419712 00010000:00010000:3.0:1786015371.940223:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c500dc6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e839b expref: 38 pid: 5796 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015371.940272:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 260 00000100:00100000:3.0:1786015371.940284:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+38:2354:x1872772280419712:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015371.940304:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015371.940313:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c500dc6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e839b expref: 38 pid: 5796 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015371.940329:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c500dc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e839b expref: 38 pid: 5796 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015371.940362:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b74a04b5b00) 00010000:00010000:3.0:1786015371.940370:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32800/0xb1a5ef690c500dd4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015371.940391:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32800/0xb1a5ef690c500dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015371.940401:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32800/0xb1a5ef690c500dd4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015371.940428:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015371.940505:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+38:2354:x1872772280419712:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 222us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015371.940513:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 260 00010000:00010000:0.0:1786015371.940865:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c500dc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e839b expref: 37 pid: 5796 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015371.940892:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304384768:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015371.940920:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32800/0xb1a5ef690c500dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015371.940930:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32800/0xb1a5ef690c500dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015371.940935:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32800/0xb1a5ef690c500dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015371.941195:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32800/0xb1a5ef690c500dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015371.941203:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32800/0xb1a5ef690c500dd4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015371.941210:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32800/0xb1a5ef690c500dd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015371.941217:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384d32800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015371.941222:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32800/0xb1a5ef690c500dd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015371.941231:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32800/0xb1a5ef690c500dd4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015371.941243:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b74a04b5b00) 00010000:00010000:0.0:1786015371.941246:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015371.941250:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32800/0xb1a5ef690c500dd4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015371.941262:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32800/0xb1a5ef690c500dd4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015371.941431:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+37:24592:x1872772280419584:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 6422us (11087us total) trans 4294967854 rc 0/0 00000100:00100000:0.0:1786015371.941441:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 848 00000040:00080000:2.0:1786015371.946405:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015371.946420:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015371.946954:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1786015371.946967:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015371.949986:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015371.950144:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280419968 00000100:00100000:0.0:1786015371.950159:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280419968 00000100:00100000:0.0:1786015371.950257:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 172 00000100:00100000:0.0:1786015371.950271:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+37:24592:x1872772280419968:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786015371.950605:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+38:24592:x1872772280419968:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 336us (633us total) trans 4294967855 rc 0/0 00000100:00100000:0.0:1786015371.950614:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 172 00010000:00010000:1.0:1786015372.141984:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015372.254393:0:18009:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015372.254408:0:18009:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015372.254464:0:18009:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 21 count 3 00000040:00080000:3.0:1786015372.254471:0:18009:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015372.331944:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015372.332266:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280420096 00000100:00100000:2.0:1786015372.332283:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280420096 00000100:00100000:2.0:1786015372.332380:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 209 00000100:00100000:2.0:1786015372.332395:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+22:2353:x1872772280420096:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015372.332423:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015372.332453:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cad7951b/0xb1a5ef690c500ddb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e83a2 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015372.332490:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015372.332495:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015372.332507:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cad7951b/0xb1a5ef690c500ddb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83a2 expref: 23 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015372.332549:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cad7951b/0xb1a5ef690c500ddb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83a2 expref: 23 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015372.332568:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46000, rc 0) 00000100:00100000:2.0:1786015372.332676:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+23:2353:x1872772280420096:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 286us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015372.332685:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 209 00000100:00080000:1.0:1786015372.333246:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015372.345102:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015372.345195:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280420352 00000100:00100000:1.0:1786015372.345211:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280420352 00000100:00100000:1.0:1786015372.345321:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 173 00000100:00100000:1.0:1786015372.345335:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916b5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+93:24593:x1872772280420352:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:1.0:1786015372.345710:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916b5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+94:24593:x1872772280420352:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 378us (622us total) trans 4294967856 rc 0/0 00000100:00100000:1.0:1786015372.345720:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 173 00000100:00080000:0.0:1786015372.346343:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015372.349189:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015372.349312:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280420608 00000100:00100000:3.0:1786015372.349326:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280420608 00000100:00100000:3.0:1786015372.349409:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 849 00000100:00100000:3.0:1786015372.349423:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+94:24593:x1872772280420608:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015372.349463:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015372.349468:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786015372.349512:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c500d80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e837f expref: 94 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.349541:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b74a04b5b00) 00010000:00010000:3.0:1786015372.349548:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015372.349568:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c500de2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e83a9 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.349797:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c500de9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.349816:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c500de9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.349830:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c500de9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015372.349913:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00010000:00010000:3.0:1786015372.350112:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c500de2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83a9 expref: 96 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.350131:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c500de9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83a9 expref: 95 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.350139:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b74a04b5b00) 00010000:00010000:3.0:1786015372.350142:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786015372.350145:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbca00, rc 0) 00000100:00100000:3.0:1786015372.350242:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+95:24593:x1872772280420608:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 821us (1069us total) trans 4294967857 rc 0/0 00000100:00100000:3.0:1786015372.350252:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 849 00000100:00100000:0.0:1786015372.359991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015372.360045:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280420736 00000100:00100000:0.0:1786015372.360058:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280420736 00000100:00100000:0.0:1786015372.360131:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 210 00000100:00100000:0.0:1786015372.360145:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+23:2353:x1872772280420736:12345-192.168.202.56@tcp:1:lfs.0 00010000:00010000:0.0:1786015372.360209:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a2aaa13/0xb1a5ef690c500df7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.360239:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500db8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8394 expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.360265:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cad7951b/0xb1a5ef690c500ddb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83a2 expref: 23 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.360274:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015372.360280:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015372.360286:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a2aaa13/0xb1a5ef690c500df7 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.360337:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cad7951b/0xb1a5ef690c500ddb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83a2 expref: 23 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.360355:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cad7951b/0xb1a5ef690c500ddb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83a2 expref: 23 pid: 11384 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015372.360376:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304384896:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015372.360498:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500db8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8394 expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.360507:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500db8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8394 expref: 9 pid: 6590 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015372.360517:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304385024:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015372.360540:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d2240 going to sleep for 11 seconds 00000100:00100000:3.0:1786015372.374391:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304384896:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015372.374419:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304385024:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015372.374458:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001a2aaa13/0xb1a5ef690c500df7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015372.376356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015372.376646:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280420864 00000100:00100000:3.0:1786015372.376675:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280420864 00010000:00010000:3.0:1786015372.376733:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cad7951b/0xb1a5ef690c500ddb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83a2 expref: 24 pid: 11384 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015372.376824:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 261 00000100:00100000:3.0:1786015372.376845:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+24:2354:x1872772280420864:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015372.376868:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015372.376905:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cad7951b/0xb1a5ef690c500ddb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83a2 expref: 24 pid: 11384 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.376924:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cad7951b/0xb1a5ef690c500ddb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83a2 expref: 24 pid: 11384 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.376956:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cad7951b/0xb1a5ef690c500ddb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83a2 expref: 24 pid: 11384 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.376982:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015372.377059:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+23:2354:x1872772280420864:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 225us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015372.377068:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 261 00000100:00100000:3.0:1786015372.388032:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015372.388397:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280420992 00000100:00100000:1.0:1786015372.388429:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280420992 00010000:00010000:1.0:1786015372.388485:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500db8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8394 expref: 10 pid: 6590 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015372.388542:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 262 00000100:00100000:1.0:1786015372.388554:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280420992:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015372.388574:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015372.388607:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500db8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8394 expref: 10 pid: 6590 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015372.388623:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500db8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8394 expref: 10 pid: 6590 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015372.388651:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adc0c384/0xb1a5ef690c500db8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8394 expref: 10 pid: 6590 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015372.388695:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015372.388701:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015372.388709:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a2aaa13/0xb1a5ef690c500df7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015372.388721:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a2aaa13/0xb1a5ef690c500df7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015372.388811:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015372.388889:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280420992:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 337us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015372.388905:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 262 00010000:00010000:3.0:1786015372.389553:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001a2aaa13/0xb1a5ef690c500df7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.389580:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a2aaa13/0xb1a5ef690c500df7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.389617:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a2aaa13/0xb1a5ef690c500df7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.389627:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a2aaa13/0xb1a5ef690c500df7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.389635:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a2aaa13/0xb1a5ef690c500df7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.389642:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384d32800 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015372.389646:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a2aaa13/0xb1a5ef690c500df7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.389666:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a2aaa13/0xb1a5ef690c500df7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.389695:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a2aaa13/0xb1a5ef690c500df7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.389703:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a2aaa13/0xb1a5ef690c500df7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015372.389832:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+22:2353:x1872772280420736:12345-192.168.202.56@tcp:1:lfs.0 Request processed in 29688us (29851us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015372.389853:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 210 00000100:00100000:3.0:1786015372.403544:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015372.407427:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280421248 00000100:00100000:1.0:1786015372.407451:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280421248 00000100:00100000:1.0:1786015372.407555:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 174 00000100:00100000:1.0:1786015372.407570:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+95:24593:x1872772280421248:12345-192.168.202.56@tcp:35:lfs.0 00000004:00010000:1.0:1786015372.407690:0:5798:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x38:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c500de9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83a9 expref: 95 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786015372.408057:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967858 00000001:00080000:1.0:1786015372.408936:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967859 00010000:00010000:1.0:1786015372.409027:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500dfe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015372.409052:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c500d64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8371 expref: 98 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015372.409062:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500da3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e838d expref: 37 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015372.409070:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500dfe lrc: 5/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015372.409123:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500da3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e838d expref: 37 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015372.409143:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500da3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e838d expref: 37 pid: 12526 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015372.409174:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304385152:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015372.409311:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c500d64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8371 expref: 98 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015372.409320:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c500d64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8371 expref: 98 pid: 5796 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015372.409329:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304385280:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015372.409354:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015372.415600:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015372.415711:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015372.417894:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280421376 00000100:00100000:0.0:1786015372.417914:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280421376 00010000:00010000:0.0:1786015372.418002:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500da3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e838d expref: 38 pid: 12526 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015372.418054:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280421504 00000100:00100000:0.0:1786015372.418058:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280421504 00010000:00010000:0.0:1786015372.418078:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c500d64 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8371 expref: 99 pid: 5796 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015372.418105:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 263 00000100:00100000:0.0:1786015372.418117:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+38:2354:x1872772280421376:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015372.418138:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015372.418146:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500da3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e838d expref: 38 pid: 12526 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.418163:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500da3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e838d expref: 38 pid: 12526 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.418196:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b74a04b5b00) 00010000:00010000:0.0:1786015372.418202:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500dfe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.418214:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500dfe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.418221:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015372.418310:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+38:2354:x1872772280421376:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 193us (2725us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015372.418333:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 263 00000100:00100000:0.0:1786015372.418357:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 264 00000100:00100000:0.0:1786015372.418365:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+99:2354:x1872772280421504:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015372.418374:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015372.418380:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c500d64 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8371 expref: 99 pid: 5796 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.418390:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c500d64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8371 expref: 99 pid: 5796 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.418403:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b74a04b5b00) 00010000:00010000:0.0:1786015372.418407:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500dfe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.418417:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500dfe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.418426:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500dfe lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.418448:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015372.418468:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+99:2354:x1872772280421504:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 104us (2757us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015372.418474:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 264 00000100:00080000:1.0:1786015372.419554:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786015372.421443:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c500da3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e838d expref: 37 pid: 12526 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015372.421477:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304385152:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015372.421497:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c500d64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8371 expref: 98 pid: 5796 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015372.421508:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304385280:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015372.421540:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500dfe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.421551:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500dfe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.421557:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500dfe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786015372.423030:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967860 00000001:00080000:3.0:1786015372.423405:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967861 00000100:00100000:3.0:1786015372.423583:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304385408:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786015372.423700:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015372.423811:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7487d690c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015372.428885:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304385408 00000100:00100000:0.0:1786015372.428909:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304385408 00000100:00100000:0.0:1786015372.429021:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1786015372.429035:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5798:x1872772304385408:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786015372.429231:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5798:x1872772304385408:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 199us (5531us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015372.429239:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1786015372.429324:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304385408:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1786015372.430100:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967862 00000100:00100000:0.0:1786015372.430224:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304385536:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786015372.430295:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015372.430348:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304385536 00000100:00100000:0.0:1786015372.430354:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304385536 00000100:00100000:0.0:1786015372.430396:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1786015372.430405:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5798:x1872772304385536:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786015372.430615:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5798:x1872772304385536:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 211us (318us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1786015372.430624:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1786015372.430670:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d2900 going to sleep for 11 seconds 00000100:00100000:0.0:1786015372.430698:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304385536:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:2.0:1786015372.431029:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1786015372.431113:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967863 00010000:00010000:0.0:1786015372.431152:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500dfe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.431166:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500dfe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.431175:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500dfe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.431182:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015372.431198:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500dfe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.431206:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500dfe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.431238:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b74a04b5b00) 00010000:00010000:0.0:1786015372.431241:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1786015372.431247:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500dfe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015372.431253:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c500dfe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786015372.431500:0:5798:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x39:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1786015372.431590:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].11, 64 off8968 00000004:00080000:0.0:1786015372.431604:0:5798:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 607682841762ns, next at 608682839047ns, rc = 0 00000001:00080000:0.0:1786015372.431611:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967864 00010000:00010000:0.0:1786015372.431647:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b74a04b5b00) 00010000:00010000:0.0:1786015372.431650:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786015372.431670:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c500de9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83a9 expref: 102 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015372.432114:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+101:24593:x1872772280421248:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 24545us (28581us total) trans 4294967865 rc 0/0 00000100:00100000:0.0:1786015372.432124:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 174 00000020:00080000:0.0:1786015372.432130:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:2.0:1786015372.459057:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015372.459345:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280421760 00000100:00100000:3.0:1786015372.459363:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280421760 00000100:00100000:3.0:1786015372.459445:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 850 00000100:00100000:3.0:1786015372.459458:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+101:24596:x1872772280421760:12345-192.168.202.56@tcp:101:md5sum.0 00010000:00010000:3.0:1786015372.459499:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015372.459533:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500e05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e83b0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.459691:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e0c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.459712:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.459728:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.459746:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.459754:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.459785:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.460233:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c500e1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.460244:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c500e1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.460274:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c500e1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015372.460290:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00010000:00010000:3.0:1786015372.460450:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.460459:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e0c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.460465:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.460472:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015372.460478:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.460486:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.460502:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:3.0:1786015372.460505:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015372.460511:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.460517:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.460534:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.460549:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.460555:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.460559:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015372.460562:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.460568:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.460576:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff8b74a04b5400) 00010000:00010000:3.0:1786015372.460578:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015372.460581:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.460587:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.460675:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500e05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83b0 expref: 104 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.462457:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c500e1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83b0 expref: 103 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.462471:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:3.0:1786015372.462474:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015372.462499:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc400, rc 0) 00000100:00100000:3.0:1786015372.462613:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+103:24596:x1872772280421760:12345-192.168.202.56@tcp:101:md5sum.0 Request processed in 3155us (3572us total) trans 4294967866 rc 0/0 00000100:00100000:3.0:1786015372.462624:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 850 00000100:00100000:2.0:1786015372.467095:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015372.467203:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280422016 00000100:00100000:3.0:1786015372.467218:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280422016 00000100:00100000:3.0:1786015372.467324:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:3.0:1786015372.467338:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+103:24596:x1872772280422016:12345-192.168.202.56@tcp:103:md5sum.0 00010000:00010000:3.0:1786015372.467365:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015372.467404:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c500e1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83b0 expref: 103 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015372.467432:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:3.0:1786015372.467447:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015372.467529:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+102:24596:x1872772280422016:12345-192.168.202.56@tcp:103:md5sum.0 Request processed in 194us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015372.467537:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:2.0:1786015372.473343:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015372.473433:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280422144 00000100:00100000:1.0:1786015372.473448:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280422144 00000100:00100000:1.0:1786015372.473529:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 851 00000100:00100000:1.0:1786015372.473541:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+102:24596:x1872772280422144:12345-192.168.202.56@tcp:58:md5sum.0 00010000:00010000:1.0:1786015372.473704:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c500e28 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015372.473725:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c500e28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015372.473741:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c500e28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786015372.474048:0:7673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].21, 136 off11048 00000100:00100000:1.0:1786015372.474179:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+102:24596:x1872772280422144:12345-192.168.202.56@tcp:58:md5sum.0 Request processed in 639us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015372.474190:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 851 00000100:00100000:2.0:1786015372.477117:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015372.477201:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280422272 00000100:00100000:1.0:1786015372.477215:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280422272 00000100:00100000:1.0:1786015372.477290:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 852 00000100:00100000:1.0:1786015372.477303:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+102:24596:x1872772280422272:12345-192.168.202.56@tcp:101:md5sum.0 00010000:00010000:1.0:1786015372.477334:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015372.477365:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c500e2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e83b7 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015372.477449:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c500e28 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015372.477462:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c500e2f lrc: 4/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83b7 expref: 103 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015372.477486:0:12526:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c500e28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015372.477501:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c500e2f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83b7 expref: 103 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015372.477517:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b7483ee6f00) 00010000:00010000:1.0:1786015372.477521:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015372.477525:0:12526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c500e2f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83b7 expref: 103 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015372.477533:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921600, rc 0) 00000100:00100000:1.0:1786015372.477643:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+103:24596:x1872772280422272:12345-192.168.202.56@tcp:101:md5sum.0 Request processed in 343us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015372.477650:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 852 00000040:00080000:0.0:1786015372.972992:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015372.973007:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015372.973076:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 22 count 4 00000040:00080000:0.0:1786015372.973105:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015372.973361:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304385664:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786015372.973501:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7483ea6240 going to sleep for 11 seconds 00000100:00100000:3.0:1786015372.974984:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304385792:0@lo:400:kworker.0 00000100:00100000:3.0:1786015372.975067:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015372.975089:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304386176:0@lo:400:kworker.0 00000100:00100000:0.0:1786015372.975265:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304386048:0@lo:400:kworker.0 00000100:00100000:2.0:1786015372.975270:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304385920:0@lo:400:kworker.0 00000100:00100000:3.0:1786015372.975356:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304386304:0@lo:400:kworker.0 00000100:00100000:1.0:1786015372.980058:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015372.980183:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304386176 00000100:00100000:1.0:1786015372.980195:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304386176 00000100:00100000:1.0:1786015372.980394:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1786015372.980411:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304386176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015372.980501:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304386176:12345-0@lo:400:kworker.0 Request processed in 95us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015372.980509:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1786015372.980575:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304386176:0@lo:400:kworker.0 00000100:00100000:0.0:1786015372.982459:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015372.982614:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304386048 00000100:00100000:0.0:1786015372.982625:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304386048 00000100:00100000:0.0:1786015372.982724:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1786015372.982735:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304386048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015372.982981:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304386048:12345-0@lo:400:kworker.0 Request processed in 248us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015372.982991:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1786015372.983020:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304385792 00000100:00100000:0.0:1786015372.983035:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304385792 00000100:00100000:0.0:1786015372.983067:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:0.0:1786015372.983074:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304385792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015372.983113:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304385792:12345-0@lo:400:kworker.0 Request processed in 40us (8047us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015372.983120:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:0.0:1786015372.983210:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304386048:0@lo:400:kworker.0 00000100:00080000:0.0:1786015372.983993:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015372.985360:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015372.985464:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304385664:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786015372.985720:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280422400 00000100:00100000:3.0:1786015372.986033:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015372.986090:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304385792:0@lo:400:kworker.0 00000100:00100000:3.0:1786015372.986320:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304386304 00000100:00100000:3.0:1786015372.986328:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304386304 00000100:00100000:2.0:1786015372.986701:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015372.986733:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304385920 00000100:00100000:2.0:1786015372.986737:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304385920 00000100:00100000:3.0:1786015372.987277:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1786015372.987686:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280422400 00000100:00080000:1.0:1786015372.988013:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015372.988398:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1786015372.988410:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304385920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015372.988507:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304385920:12345-0@lo:400:kworker.0 Request processed in 100us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015372.988516:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1786015372.988589:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304385920:0@lo:400:kworker.0 00000100:00100000:2.0:1786015372.988604:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304386432:0@lo:400:kworker.0 00000100:00100000:2.0:1786015372.988685:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015372.988723:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304386432 00000100:00100000:2.0:1786015372.988729:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304386432 00000100:00100000:2.0:1786015372.988780:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1786015372.988787:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1872772304386432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015372.988833:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1872772304386432:12345-0@lo:400:kworker.0 Request processed in 47us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015372.988840:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1786015372.988870:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304386432:0@lo:400:kworker.0 00000100:00100000:3.0:1786015372.992341:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304386304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015372.992564:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304386304:12345-0@lo:400:kworker.0 Request processed in 5258us (6517us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015372.992578:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1786015372.992689:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304386304:0@lo:400:kworker.0 00000100:00100000:0.0:1786015373.001257:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 853 00000100:00100000:0.0:1786015373.001301:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+37:24597:x1872772280422400:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015373.001363:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x38:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015373.001537:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+37:24597:x1872772280422400:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 244us (16188us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015373.001547:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 853 00000100:00100000:2.0:1786015373.006018:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015373.006165:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280422528 00000100:00100000:0.0:1786015373.006179:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280422528 00000100:00100000:0.0:1786015373.006269:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 854 00000100:00100000:0.0:1786015373.006282:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+37:24597:x1872772280422528:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1786015373.006389:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32000/0xb1a5ef690c500e36 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006414:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32000/0xb1a5ef690c500e36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006431:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32000/0xb1a5ef690c500e36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006450:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e3d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006459:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006467:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006497:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500e44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006529:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006537:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015373.006595:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00000004:00200000:0.0:1786015373.006601:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015373.006621:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006635:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32000/0xb1a5ef690c500e36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006642:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32000/0xb1a5ef690c500e36 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006661:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32000/0xb1a5ef690c500e36 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006669:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384d32000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015373.006674:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32000/0xb1a5ef690c500e36 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006684:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32000/0xb1a5ef690c500e36 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006699:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:0.0:1786015373.006703:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015373.006709:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32000/0xb1a5ef690c500e36 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006728:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32000/0xb1a5ef690c500e36 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006744:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006751:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e3d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006757:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006787:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384d32200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015373.006791:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006799:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e3d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006808:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb1925f2 (ffff8b748f24ad00) 00010000:00010000:0.0:1786015373.006811:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015373.006814:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e3d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006820:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e3d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006843:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006851:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500e44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006864:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500e44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006869:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384d32c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015373.006872:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500e44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006879:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500e44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006887:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b7483ee6f00) 00010000:00010000:0.0:1786015373.006889:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015373.006892:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500e44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.006898:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500e44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015373.007018:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+37:24597:x1872772280422528:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 737us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015373.009630:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 854 00000100:00100000:2.0:1786015373.012635:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.013127:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280422784 00000100:00100000:3.0:1786015373.013142:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280422784 00000100:00100000:3.0:1786015373.013237:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 855 00000100:00100000:3.0:1786015373.013251:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+37:24597:x1872772280422784:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015373.013286:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015373.013320:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500e4b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e83be expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.013484:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.013504:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.013519:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015373.013534:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00010000:00010000:3.0:1786015373.013699:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.013708:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.013715:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.013743:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015373.013748:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.013756:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.014128:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b7483ee6f00) 00010000:00010000:3.0:1786015373.014133:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015373.014140:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.014147:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.014210:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500e4b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83be expref: 39 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.014222:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:3.0:1786015373.014224:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786015373.014228:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500e4b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83be expref: 39 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.014436:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbdc00, rc 0) 00000100:00100000:3.0:1786015373.014535:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+38:24597:x1872772280422784:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1287us (1917us total) trans 4294967867 rc 301/301 00000100:00100000:3.0:1786015373.014546:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 855 00000100:00100000:0.0:1786015373.020372:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.020679:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280422912 00000100:00100000:3.0:1786015373.020713:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280422912 00000100:00100000:3.0:1786015373.020802:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 856 00000100:00100000:3.0:1786015373.020814:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+38:24597:x1872772280422912:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015373.020982:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x38:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015373.022037:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+38:24597:x1872772280422912:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 1212us (1679us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015373.022053:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 856 00000100:00100000:2.0:1786015373.033059:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015373.033404:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280423040 00000100:00100000:0.0:1786015373.033419:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280423040 00000100:00100000:0.0:1786015373.033500:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 857 00000100:00100000:0.0:1786015373.033512:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+38:24597:x1872772280423040:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015373.033542:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015373.033572:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500e60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e83c5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.033708:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.033731:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.033746:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015373.033910:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1786015373.033917:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015373.033953:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.033989:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500e60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83c5 expref: 40 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.034014:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83c5 expref: 39 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.034026:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:0.0:1786015373.034030:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015373.034034:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384d32200, rc 0) 00000100:00100000:0.0:1786015373.034127:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+39:24597:x1872772280423040:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 615us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015373.034135:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 857 00000100:00100000:2.0:1786015373.038130:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.042528:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280423168 00000100:00100000:3.0:1786015373.042561:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280423168 00000100:00100000:3.0:1786015373.042672:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 858 00000100:00100000:3.0:1786015373.042685:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+39:24597:x1872772280423168:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015373.042718:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015373.042748:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500e6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e83cc expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.042892:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e75 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.042909:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.042923:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.042940:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.042948:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.042979:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.043133:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c500e83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.043143:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c500e83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.043150:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c500e83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015373.043193:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 512 00000004:00200000:3.0:1786015373.043198:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015373.043239:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c500e83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.043255:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.043261:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e75 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.043268:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.043275:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015373.043281:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.043290:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e75 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.043317:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:3.0:1786015373.043320:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015373.043326:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.043333:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.043787:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.043797:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e7c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.043803:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.043809:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015373.043813:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.044018:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e7c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.044030:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c6c0408 (ffff8b74a04b5100) 00010000:00010000:3.0:1786015373.044032:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015373.044036:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e7c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.044042:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.044112:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500e6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83cc expref: 41 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.044129:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c500e83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83cc expref: 40 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.044137:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:3.0:1786015373.044139:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786015373.044142:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbda00, rc 0) 00000100:00100000:3.0:1786015373.044539:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+40:24597:x1872772280423168:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1852us (6421us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015373.044563:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 858 00000100:00100000:2.0:1786015373.058034:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.058141:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280423424 00000100:00100000:3.0:1786015373.058157:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280423424 00000100:00100000:3.0:1786015373.058251:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 859 00000100:00100000:3.0:1786015373.058264:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+40:24597:x1872772280423424:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015373.058298:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015373.058329:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500e8a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e83d3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.062931:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.062962:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.062978:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015373.063029:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x16:0x0]: returning size 0 00010000:00010000:3.0:1786015373.063846:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500e8a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83d3 expref: 43 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.063873:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83d3 expref: 42 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.063883:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:3.0:1786015373.063886:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015373.063891:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbce00, rc 0) 00000100:00100000:3.0:1786015373.064149:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+42:24597:x1872772280423424:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 5887us (6128us total) trans 4294967868 rc 0/0 00000100:00100000:3.0:1786015373.064159:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 859 00000100:00100000:2.0:1786015373.070392:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.070508:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280423680 00000100:00100000:3.0:1786015373.070518:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280423680 00000100:00100000:3.0:1786015373.070930:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 860 00000100:00100000:3.0:1786015373.070943:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+42:24597:x1872772280423680:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786015373.071376:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015373.071412:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500e91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83d3 expref: 42 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.071433:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:3.0:1786015373.071445:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015373.071545:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e9f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.071580:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8386 expref: 102 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.071589:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e9f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.071625:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8386 expref: 102 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.071640:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8386 expref: 102 pid: 5796 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015373.071671:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304386560:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015373.072489:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7491f64480 going to sleep for 11 seconds 00000100:00100000:2.0:1786015373.079800:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015373.079921:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280423808 00000100:00100000:0.0:1786015373.079932:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280423808 00010000:00010000:0.0:1786015373.080008:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d95 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8386 expref: 103 pid: 5796 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015373.080064:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 265 00000100:00100000:0.0:1786015373.080075:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74865a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+103:2353:x1872772280423808:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015373.080090:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015373.080097:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d95 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8386 expref: 103 pid: 5796 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.080110:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8386 expref: 103 pid: 5796 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.080134:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:0.0:1786015373.080140:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e9f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.080149:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.080156:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e9f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.080176:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015373.080238:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74865a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+103:2353:x1872772280423808:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 165us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015373.080246:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 265 00010000:00010000:3.0:1786015373.081263:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c500d95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8386 expref: 102 pid: 5796 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015373.081286:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304386560:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015373.081309:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.081319:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.081325:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.081352:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500ea6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0xbea57f3e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.081379:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500ea6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xbea57f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.081388:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500ea6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xbea57f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.081487:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.081495:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e9f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.081500:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e9f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.081506:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015373.081511:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e9f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.081519:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e9f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.081528:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:3.0:1786015373.081532:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015373.081536:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e9f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.081541:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd000/0xb1a5ef690c500e9f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.081550:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500ea6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xbea57f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.081563:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500ea6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xbea57f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.081569:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500ea6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xbea57f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.081574:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbdc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015373.081578:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500ea6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xbea57f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.081584:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500ea6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xbea57f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.081592:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0xbea57f3e (ffff8b74a04b5400) 00010000:00010000:3.0:1786015373.081595:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015373.081598:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500ea6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xbea57f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.081604:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500ea6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xbea57f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015373.081718:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+41:24597:x1872772280423680:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 10777us (11985us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786015373.081727:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 860 00000100:00100000:2.0:1786015373.089622:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.089725:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280423936 00000100:00100000:3.0:1786015373.089735:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280423936 00000100:00100000:3.0:1786015373.089825:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 861 00000100:00100000:3.0:1786015373.089845:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+41:24597:x1872772280423936:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015373.089868:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015373.089912:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500ead lrc: 2/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e83da expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.089954:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c500eb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.089967:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c500eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.089979:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c500eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.090413:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500ead lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83da expref: 43 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.090433:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c500eb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83da expref: 42 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.090442:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:3.0:1786015373.090445:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786015373.090448:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc400, rc 0) 00000100:00100000:3.0:1786015373.090940:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+42:24597:x1872772280423936:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1103us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015373.090949:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 861 00000100:00100000:3.0:1786015373.114721:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015373.115659:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280424192 00000100:00100000:1.0:1786015373.115674:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280424192 00000100:00100000:1.0:1786015373.115753:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 862 00000100:00100000:1.0:1786015373.115810:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+42:24597:x1872772280424192:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786015373.115924:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c500ebb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.115941:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c500ebb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.115955:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c500ebb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786015373.116333:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009f4b24d3 reply state 000000004dbf3332 transno 4294967869 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c500ebb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015373.116362:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786015373.118353:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:24597:x1872772280424192:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 2530us (3627us total) trans 4294967869 rc 0/0 00000100:00100000:1.0:1786015373.118369:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 862 00000100:00100000:2.0:1786015373.124447:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015373.124664:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280424320 00000100:00100000:0.0:1786015373.124674:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280424320 00000100:00100000:0.0:1786015373.124735:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 863 00000100:00100000:0.0:1786015373.124797:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+44:24597:x1872772280424320:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015373.124823:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015373.124855:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500ec2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e83e1 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.124919:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500ec2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83e1 expref: 45 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.124935:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500ec2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83e1 expref: 45 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.124951:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:0.0:1786015373.124953:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015373.124957:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384d32c00, rc 0) 00000100:00100000:0.0:1786015373.125028:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:24597:x1872772280424320:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 264us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015373.125035:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 863 00010000:00010000:3.0:1786015373.125323:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c500ebb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.125332:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c500ebb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.125352:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c500ebb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.125359:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015373.125364:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c500ebb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.125371:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c500ebb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.125385:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:3.0:1786015373.125387:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786015373.125392:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c500ebb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.125398:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c500ebb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015373.130365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015373.130845:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280424448 00000100:00100000:2.0:1786015373.130861:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280424448 00000100:00100000:2.0:1786015373.130939:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 175 00000100:00100000:2.0:1786015373.130950:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:24597:x1872772280424448:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1786015373.131446:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:24597:x1872772280424448:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 Request processed in 497us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015373.131466:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 175 00000100:00100000:1.0:1786015373.144367:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015373.144802:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280424704 00000100:00100000:0.0:1786015373.144813:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280424704 00000100:00100000:0.0:1786015373.145063:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 176 00000100:00100000:0.0:1786015373.145076:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+44:24597:x1872772280424704:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786015373.145339:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:24597:x1872772280424704:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 266us (983us total) trans 4294967870 rc 0/0 00000100:00100000:0.0:1786015373.145347:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 176 00000100:00100000:0.0:1786015373.156185:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.156795:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280424960 00000100:00100000:3.0:1786015373.156807:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280424960 00000100:00100000:3.0:1786015373.156885:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 864 00000100:00100000:3.0:1786015373.156896:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:24597:x1872772280424960:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786015373.157027:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:24597:x1872772280424960:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 132us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015373.157035:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 864 00000100:00100000:3.0:1786015373.163412:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015373.163799:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280425216 00000100:00100000:1.0:1786015373.163810:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280425216 00000100:00100000:1.0:1786015373.163892:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 865 00000100:00100000:1.0:1786015373.163903:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+45:24597:x1872772280425216:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015373.163929:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015373.163958:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c500ec9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e83e8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.164479:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015373.164577:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c500ed0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.164594:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500ec2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83e1 expref: 46 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.164603:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c500ed0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.164640:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500ec2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83e1 expref: 46 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.164665:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500ec2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83e1 expref: 46 pid: 5795 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015373.164692:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304386688:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015373.167548:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb240 going to sleep for 11 seconds 00000100:00100000:3.0:1786015373.176219:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304386688:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015373.176262:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c500ed0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015373.195312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015373.196112:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280425344 00000100:00100000:0.0:1786015373.196145:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280425344 00010000:00010000:0.0:1786015373.196196:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500ec2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83e1 expref: 47 pid: 5795 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015373.196245:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 266 00000100:00100000:0.0:1786015373.196256:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2354:x1872772280425344:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015373.196273:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015373.196280:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500ec2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83e1 expref: 47 pid: 5795 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.196295:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500ec2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83e1 expref: 47 pid: 5795 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.196321:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32c00/0xb1a5ef690c500ec2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83e1 expref: 47 pid: 5795 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.196339:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:0.0:1786015373.196344:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c500ed0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.196354:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c500ed0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.196362:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c500ed0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.196402:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015373.196469:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+46:2354:x1872772280425344:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 215us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015373.196487:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 266 00010000:00010000:1.0:1786015373.198309:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c500ed0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.198325:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c500ed0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015373.198350:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x16:0x0]: returning size 0 00000004:00080000:1.0:1786015373.198566:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x11:0x0], index 0: 0 00010000:00010000:1.0:1786015373.199299:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c500ed0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.199313:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c500ed0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.199321:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c500ed0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.199329:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015373.199334:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c500ed0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.199341:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c500ed0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.199359:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:1.0:1786015373.199362:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015373.199368:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c500ed0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.199389:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c500ed0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.199454:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c500ec9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83e8 expref: 46 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.199464:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:1.0:1786015373.199467:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786015373.199471:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c500ec9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83e8 expref: 46 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.199481:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920c00, rc 0) 00000100:00100000:1.0:1786015373.199563:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+45:24597:x1872772280425216:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 35662us (36164us total) trans 4294967871 rc 301/301 00000100:00100000:1.0:1786015373.199573:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 865 00000100:00100000:3.0:1786015373.213321:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015373.213440:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280425600 00000100:00100000:0.0:1786015373.213451:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280425600 00000100:00100000:0.0:1786015373.213526:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 177 00000100:00100000:0.0:1786015373.213538:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:24597:x1872772280425600:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786015373.215199:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+46:24597:x1872772280425600:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1657us (1883us total) trans 4294967872 rc 0/0 00000100:00100000:3.0:1786015373.215211:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 177 00000100:00100000:3.0:1786015373.219185:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015373.219299:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280425728 00000100:00100000:2.0:1786015373.219326:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280425728 00000100:00100000:2.0:1786015373.219427:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 866 00000100:00100000:2.0:1786015373.219440:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+46:24597:x1872772280425728:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015373.219469:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015373.219494:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47200/0xb1a5ef690c500ede lrc: 2/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e83ef expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.219571:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c500ee5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.220196:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c500ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.220216:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c500ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015373.220258:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x16:0x0]: returning size 0 00000004:00200000:2.0:1786015373.220262:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015373.220285:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c500ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.220317:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47200/0xb1a5ef690c500ede lrc: 0/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83ef expref: 48 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.220337:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c500ee5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83ef expref: 47 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.220346:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:2.0:1786015373.220350:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786015373.220354:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47600, rc 0) 00000100:00100000:2.0:1786015373.220482:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+47:24597:x1872772280425728:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1044us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015373.220490:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 866 00000100:00100000:2.0:1786015373.226394:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.228072:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280425856 00000100:00100000:3.0:1786015373.228090:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280425856 00000100:00100000:3.0:1786015373.228222:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 211 00000100:00100000:3.0:1786015373.228234:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280425856:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015373.228258:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015373.228280:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e1205ff/0xb1a5ef690c500eec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e83f6 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015373.228308:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786015373.228330:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1786015373.228335:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015373.228345:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e1205ff/0xb1a5ef690c500eec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83f6 expref: 9 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.228363:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e1205ff/0xb1a5ef690c500eec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83f6 expref: 9 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.228400:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc800, rc 0) 00000100:00100000:3.0:1786015373.228472:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280425856:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 241us (2090us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015373.228480:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 211 00000100:00100000:0.0:1786015373.234396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.234597:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280426112 00000100:00100000:3.0:1786015373.234607:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280426112 00000100:00100000:3.0:1786015373.234717:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 867 00000100:00100000:3.0:1786015373.234728:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+47:24597:x1872772280426112:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786015373.234905:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+47:24597:x1872772280426112:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 178us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015373.234913:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 867 00000100:00080000:2.0:1786015373.234971:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015373.255244:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015373.255341:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280426240 00000100:00100000:1.0:1786015373.255352:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280426240 00000100:00100000:1.0:1786015373.255476:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 212 00000100:00100000:1.0:1786015373.255488:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:24597:x1872772280426240:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015373.255508:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015373.255529:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c500ef3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e83fd expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.255564:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e1205ff/0xb1a5ef690c500eec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83f6 expref: 10 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.255593:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015373.255599:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015373.255606:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c500ef3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83fd expref: 10 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.255661:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e1205ff/0xb1a5ef690c500eec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83f6 expref: 10 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.255675:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e1205ff/0xb1a5ef690c500eec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83f6 expref: 10 pid: 6592 timeout: 708 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015373.255690:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304386816:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015373.255818:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb240 going to sleep for 11 seconds 00000100:00100000:1.0:1786015373.262896:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304386816:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015373.262940:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c500ef3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83fd expref: 10 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.262963:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920c00, rc 0) 00000100:00100000:1.0:1786015373.263047:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:24597:x1872772280426240:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 7561us (7812us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015373.263057:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 212 00000100:00100000:0.0:1786015373.267376:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015373.267525:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280426368 00000100:00100000:1.0:1786015373.267537:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280426368 00010000:00010000:1.0:1786015373.267578:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e1205ff/0xb1a5ef690c500eec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83f6 expref: 10 pid: 6592 timeout: 708 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015373.267627:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 267 00000100:00100000:1.0:1786015373.267634:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280426368:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015373.267662:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015373.268059:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e1205ff/0xb1a5ef690c500eec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83f6 expref: 10 pid: 6592 timeout: 708 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.268076:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e1205ff/0xb1a5ef690c500eec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83f6 expref: 10 pid: 6592 timeout: 708 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.268101:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e1205ff/0xb1a5ef690c500eec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83f6 expref: 10 pid: 6592 timeout: 708 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.268124:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015373.268129:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015373.268138:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c500ef3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83fd expref: 9 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.268149:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c500ef3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83fd expref: 9 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.268267:0:6607:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c500ef3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83fd expref: 9 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015373.268283:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381940000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304386944:192.168.202.56@tcp:105: 00000100:00100000:0.0:1786015373.268475:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7483ea6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786015373.272901:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381940000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304386944:192.168.202.56@tcp:105: 00010000:00010000:3.0:1786015373.272932:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015373.272999:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280426368:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 5363us (5644us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015373.273012:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 267 00000100:00100000:2.0:1786015373.293733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015373.293883:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280426496 00000100:00100000:0.0:1786015373.293894:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280426496 00002000:00100000:0.0:1786015373.293958:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (0->1048575) req@ffff8b738299e680 x1872772280426496/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:219/0 lens 488/0 e 0 to 0 dl 1786015384 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015373.293972:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b738299e680 with x1872772280426496 ext(0->1048575) 00002000:00010000:0.0:1786015373.293980:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b738299e680 00000100:00100000:0.0:1786015373.294020:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 75 00000100:00100000:0.0:1786015373.294031:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280426496:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1786015373.331208:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280426496:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 37165us (37474us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1786015373.331225:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 75 00002000:00100000:0.0:1786015373.331256:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (0->1048575) req@ffff8b738299e680 x1872772280426496/t4294967333(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:219/0 lens 488/448 e 0 to 0 dl 1786015384 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015373.331266:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b738299e680 with x1872772280426496 ext(0->1048575) 00002000:00010000:0.0:1786015373.331272:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b738299e680 00000100:00100000:3.0:1786015373.331432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015373.331497:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280426624 00000100:00100000:1.0:1786015373.331508:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280426624 00002000:00100000:1.0:1786015373.331546:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1048576->2097151) req@ffff8b74bf4bdf80 x1872772280426624/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:219/0 lens 488/0 e 0 to 0 dl 1786015384 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015373.331566:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74bf4bdf80 with x1872772280426624 ext(1048576->2097151) 00002000:00010000:1.0:1786015373.331570:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74bf4bdf80 00000100:00100000:1.0:1786015373.332596:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 76 00000100:00100000:1.0:1786015373.332614:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280426624:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1786015373.353221:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280426624:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 20598us (21774us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1786015373.353238:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 76 00002000:00100000:3.0:1786015373.353254:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1048576->2097151) req@ffff8b74bf4bdf80 x1872772280426624/t4294967334(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:219/0 lens 488/448 e 0 to 0 dl 1786015384 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015373.353266:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74bf4bdf80 with x1872772280426624 ext(1048576->2097151) 00002000:00010000:3.0:1786015373.353288:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74bf4bdf80 00000100:00100000:3.0:1786015373.365353:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015373.365493:0:17970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280426752 00000100:00100000:1.0:1786015373.365505:0:17970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280426752 00002000:00100000:1.0:1786015373.365559:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x11:0x0] (2097152->3145727) req@ffff8b74bf4bf800 x1872772280426752/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:219/0 lens 488/0 e 0 to 0 dl 1786015384 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015373.365570:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74bf4bf800 with x1872772280426752 ext(2097152->3145727) 00002000:00010000:1.0:1786015373.365576:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74bf4bf800 00000100:00100000:1.0:1786015373.365619:0:17970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 77 00000100:00100000:1.0:1786015373.365629:0:17970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2352:x1872772280426752:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1786015373.382713:0:17970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2352:x1872772280426752:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 17073us (17358us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1786015373.382728:0:17970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 77 00002000:00100000:1.0:1786015373.382919:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x11:0x0] (2097152->3145727) req@ffff8b74bf4bf800 x1872772280426752/t4294967335(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:219/0 lens 488/448 e 0 to 0 dl 1786015384 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015373.382930:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74bf4bf800 with x1872772280426752 ext(2097152->3145727) 00002000:00010000:1.0:1786015373.382936:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74bf4bf800 00000100:00100000:0.0:1786015373.410036:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015373.410291:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280426880 00000100:00100000:2.0:1786015373.410303:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280426880 00002000:00100000:2.0:1786015373.410356:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (3145728->4194303) req@ffff8b7381942a00 x1872772280426880/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:219/0 lens 488/0 e 0 to 0 dl 1786015384 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015373.410368:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381942a00 with x1872772280426880 ext(3145728->4194303) 00002000:00010000:2.0:1786015373.410376:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7381942a00 00000100:00100000:2.0:1786015373.410414:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:2.0:1786015373.410424:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2354:x1872772280426880:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1786015373.428092:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+17:2354:x1872772280426880:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 17657us (18056us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1786015373.428106:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 78 00002000:00100000:2.0:1786015373.428120:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (3145728->4194303) req@ffff8b7381942a00 x1872772280426880/t4294967336(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:219/0 lens 488/448 e 0 to 0 dl 1786015384 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015373.428132:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381942a00 with x1872772280426880 ext(3145728->4194303) 00002000:00010000:2.0:1786015373.428139:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7381942a00 00000100:00100000:0.0:1786015373.445493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.445616:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280427008 00000100:00100000:3.0:1786015373.445629:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280427008 00002000:00100000:3.0:1786015373.445696:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (4194304->5242879) req@ffff8b7381942d80 x1872772280427008/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:219/0 lens 488/0 e 0 to 0 dl 1786015384 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015373.445709:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381942d80 with x1872772280427008 ext(4194304->5242879) 00002000:00010000:3.0:1786015373.445716:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7381942d80 00000100:00100000:3.0:1786015373.446072:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00100000:3.0:1786015373.446084:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+17:2351:x1872772280427008:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1786015373.462409:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+19:2351:x1872772280427008:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 16316us (16913us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1786015373.462424:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 79 00002000:00100000:2.0:1786015373.462446:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (4194304->5242879) req@ffff8b7381942d80 x1872772280427008/t4294967337(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:219/0 lens 488/448 e 0 to 0 dl 1786015384 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015373.462455:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381942d80 with x1872772280427008 ext(4194304->5242879) 00002000:00010000:2.0:1786015373.462463:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7381942d80 00000100:00100000:1.0:1786015373.468080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.472038:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280427136 00000100:00100000:3.0:1786015373.472057:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280427136 00000100:00100000:3.0:1786015373.472141:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 868 00000100:00100000:3.0:1786015373.472153:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+47:24597:x1872772280427136:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000004:00080000:2.0:1786015373.486093:0:7781:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 608737328962ns, next at 609737326653ns, rc = 0 00000100:00100000:2.0:1786015373.486117:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786015373.486139:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304387072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015373.486215:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015373.486287:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304387072 00000100:00100000:2.0:1786015373.486296:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304387072 00000100:00100000:2.0:1786015373.486347:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1786015373.486356:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1872772304387072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015373.486400:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 78184448 pending 8519680 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015373.486451:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1872772304387072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015373.486459:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1786015373.486508:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304387072:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1786015373.565450:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967870 is committed 00000001:00080000:2.0:1786015373.565489:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967865 is committed 00000004:00080000:2.0:1786015373.565493:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00000020:00080000:2.0:1786015373.565528:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b74b89d2240 refcount 2 committed 0 result 0 batchid 13 00000020:00080000:2.0:1786015373.565532:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b7490f6c100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b74b89d20c0 00000020:00080000:2.0:1786015373.565535:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b7490f6cd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74b8cc3c00 00000001:00080000:2.0:1786015373.565570:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967871 is committed 00000004:00080000:2.0:1786015373.565612:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:2.0:1786015373.565635:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 13 committed 00000020:00080000:2.0:1786015373.565658:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 12 batchid updated 00000001:00080000:2.0:1786015373.565669:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967872 is committed 00000001:00080000:2.0:1786015373.565679:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967866 is committed 00000020:00080000:2.0:1786015373.566215:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 13 committed batchid 12 00000020:00080000:2.0:1786015373.566360:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12 00000100:00100000:2.0:1786015373.566438:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304387200:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786015373.566478:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304387328:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786015373.566509:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015373.566543:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304387328 00000100:00100000:2.0:1786015373.566550:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304387328 00000100:00100000:3.0:1786015373.566577:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786015373.566583:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304387456:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786015373.566604:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015373.566631:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304387456 00000100:00100000:3.0:1786015373.566634:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304387456 00000100:00100000:3.0:1786015373.566747:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1786015373.566756:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304387456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1786015373.566802:0:6592:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:19 count 1 00002000:00010000:3.0:1786015373.566837:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 5242880, mtime: 0x6a746e8b, atime: 0x0, ctime: 0x6a746e8b, blocks: 0x2807 00010000:00010000:3.0:1786015373.566854:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c500efa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.566873:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1786015373.566878:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015373.566885:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c500efa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.566901:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c500efa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.566912:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c500efa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.566920:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c500efa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.566937:0:6592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786015373.567092:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+38:24597:x1872772280427136:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 94938us (99021us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015373.567126:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 868 00000100:00100000:2.0:1786015373.567308:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1786015373.567317:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304387328:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786015373.567330:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3312:x1872772304387456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 575us (724us total) trans 4294967348 rc 0/0 00002000:00080000:2.0:1786015373.567331:0:6591:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:16 count 1 00000100:00100000:3.0:1786015373.567337:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00010000:00010000:2.0:1786015373.567349:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ca44aba/0xb1a5ef690c500f01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.567363:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500d2c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e836a expref: 11 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.567370:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1786015373.567374:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015373.567377:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ca44aba/0xb1a5ef690c500f01 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786015373.567378:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b738394bb80/2, rc 0, transno 4294967348 00000100:00100000:3.0:1786015373.567383:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304387456:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1786015373.567402:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500d2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e836a expref: 11 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.567417:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500d2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e836a expref: 11 pid: 6592 timeout: 708 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015373.567437:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383949180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304387584:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015373.567481:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74aee18e40 going to sleep for 11 seconds 00000100:00080000:2.0:1786015373.567494:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015373.568748:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015373.569131:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304387200 00000100:00100000:1.0:1786015373.569141:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304387200 00000100:00100000:1.0:1786015373.569206:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1786015373.569214:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3315:x1872772304387200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786015373.569239:0:14547:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:18 count 1 00010000:00010000:1.0:1786015373.569263:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006703c5f5/0xb1a5ef690c500f08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.569287:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500d25 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8363 expref: 21 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.569295:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1786015373.569300:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015373.569304:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006703c5f5/0xb1a5ef690c500f08 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.569334:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500d25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8363 expref: 21 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.569346:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500d25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8363 expref: 21 pid: 6591 timeout: 708 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015373.569359:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304387712:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015373.569433:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbbe40 going to sleep for 11 seconds 00010000:00010000:1.0:1786015373.569447:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786015373.569456:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c500efa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.569466:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc000 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015373.569476:0:6606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c500efa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.569485:0:6606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c500efa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.569503:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c500efa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.569510:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c500efa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.569527:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015373.569529:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015373.569530:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015373.573754:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015373.573856:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280427264 00000100:00100000:1.0:1786015373.573870:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280427264 00010000:00010000:1.0:1786015373.573961:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500d2c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e836a expref: 12 pid: 6592 timeout: 708 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015373.574014:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 268 00000100:00100000:1.0:1786015373.574026:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280427264:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015373.574050:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015373.574059:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500d2c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e836a expref: 12 pid: 6592 timeout: 708 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.574099:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500d2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e836a expref: 12 pid: 6592 timeout: 708 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015373.574170:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383949180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304387584:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015373.581470:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000ca44aba/0xb1a5ef690c500f01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.581572:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a74a0e6d/0xb1a5ef690c500d2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e836a expref: 12 pid: 6592 timeout: 708 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.581606:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015373.581611:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015373.581619:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000ca44aba/0xb1a5ef690c500f01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.581632:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ca44aba/0xb1a5ef690c500f01 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.581830:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015373.581941:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+11:2353:x1872772280427264:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 7914us (8200us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015373.582192:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 268 00000100:00080000:1.0:1786015373.582252:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015373.583588:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.584152:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280427392 00000100:00100000:3.0:1786015373.584167:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280427392 00000100:00100000:3.0:1786015373.584230:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 216 00000100:00100000:3.0:1786015373.584253:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+19:2353:x1872772280427392:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1786015373.588017:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000ca44aba/0xb1a5ef690c500f01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.588051:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ca44aba/0xb1a5ef690c500f01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.588070:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ca44aba/0xb1a5ef690c500f01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.588079:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ca44aba/0xb1a5ef690c500f01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.588124:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786015373.588536:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786015373.588555:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ca44aba/0xb1a5ef690c500f01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.588569:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47000 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015373.588586:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ca44aba/0xb1a5ef690c500f01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.588598:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ca44aba/0xb1a5ef690c500f01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.588622:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ca44aba/0xb1a5ef690c500f01 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.588630:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ca44aba/0xb1a5ef690c500f01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.588699:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015373.588704:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015373.588710:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015373.591678:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304387712:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015373.591721:0:14547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006703c5f5/0xb1a5ef690c500f08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015373.592787:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304387328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25463us (26269us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1786015373.592804:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000004:00080000:3.0:1786015373.592903:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b7383949500/2, rc 0, transno 4294967338 00000100:00100000:3.0:1786015373.592912:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304387328:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1786015373.603038:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.604505:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280427520 00000100:00100000:3.0:1786015373.604522:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280427520 00010000:00010000:3.0:1786015373.605333:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500d25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8363 expref: 22 pid: 6591 timeout: 708 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015373.605455:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 269 00000100:00100000:3.0:1786015373.605714:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+22:2354:x1872772280427520:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015373.605745:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015373.605754:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500d25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8363 expref: 22 pid: 6591 timeout: 708 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.605785:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500d25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8363 expref: 22 pid: 6591 timeout: 708 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.605813:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c500d25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8363 expref: 22 pid: 6591 timeout: 708 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.605835:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015373.605840:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015373.605847:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006703c5f5/0xb1a5ef690c500f08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.605858:0:17038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006703c5f5/0xb1a5ef690c500f08 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.605995:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015373.606072:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+21:2354:x1872772280427520:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 607us (3040us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015373.606081:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 269 00010000:00010000:0.0:1786015373.608030:0:14547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006703c5f5/0xb1a5ef690c500f08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.608052:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006703c5f5/0xb1a5ef690c500f08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.608066:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006703c5f5/0xb1a5ef690c500f08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.608075:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006703c5f5/0xb1a5ef690c500f08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.608097:0:14547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786015373.609287:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3315:x1872772304387200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 40067us (40534us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1786015373.609302:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000004:00080000:0.0:1786015373.609375:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b7383949c00/2, rc 0, transno 4294967349 00000100:00100000:0.0:1786015373.609382:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304387200:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1786015373.609670:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786015373.609692:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006703c5f5/0xb1a5ef690c500f08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.609704:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015373.609708:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006703c5f5/0xb1a5ef690c500f08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.609718:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006703c5f5/0xb1a5ef690c500f08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.609739:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006703c5f5/0xb1a5ef690c500f08 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.609747:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006703c5f5/0xb1a5ef690c500f08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.609810:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015373.609812:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015373.609814:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786015373.641667:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967347 is committed 00000001:00080000:1.0:1786015373.641706:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967344 is committed 00000001:00080000:1.0:1786015373.641717:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967346 is committed 00000100:00100000:2.0:1786015373.666208:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+19:2353:x1872772280427392:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 81945us (82618us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015373.666222:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 216 00000001:00080000:2.0:1786015373.666261:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967333 is committed 00000001:00080000:2.0:1786015373.666277:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967335 is committed 00000001:00080000:2.0:1786015373.666288:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967337 is committed 00000100:00100000:0.0:1786015373.670314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015373.670613:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280427776 00000100:00100000:2.0:1786015373.670624:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280427776 00000100:00100000:2.0:1786015373.670706:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 869 00000100:00100000:2.0:1786015373.670716:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+38:24597:x1872772280427776:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786015373.671098:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015373.671126:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c500ee5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83ef expref: 38 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.671145:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:2.0:1786015373.671151:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015373.671185:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c500f0f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.671211:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c500f0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.671222:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c500f0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015373.671401:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e60b49da reply state 00000000853500ef transno 4294967873 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c500f0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015373.671412:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786015373.671563:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+39:24597:x1872772280427776:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 848us (1262us total) trans 4294967873 rc 0/0 00000100:00100000:2.0:1786015373.671572:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 869 00000100:00100000:2.0:1786015373.677088:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.677194:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280427904 00000100:00100000:3.0:1786015373.677206:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280427904 00000100:00100000:3.0:1786015373.677259:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 870 00000100:00100000:3.0:1786015373.677271:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+39:24597:x1872772280427904:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015373.677312:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015373.677336:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8404 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.677402:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8404 expref: 40 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.677418:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8404 expref: 40 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.677440:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:3.0:1786015373.677443:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015373.677447:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbde00, rc 0) 00000100:00100000:3.0:1786015373.677554:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+40:24597:x1872772280427904:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 285us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015373.677562:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 870 00010000:00010000:0.0:1786015373.677666:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c500f0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.677685:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c500f0f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.677692:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c500f0f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.677699:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015373.677703:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c500f0f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.677713:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c500f0f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.677728:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:0.0:1786015373.677740:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015373.677744:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c500f0f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.677750:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c500f0f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015373.681717:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.682183:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280428032 00000100:00100000:3.0:1786015373.682197:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280428032 00000100:00100000:2.0:1786015373.682371:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 217 00000100:00100000:2.0:1786015373.682382:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280428032:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1786015373.682631:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:2.0:1786015373.682635:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb mtime from disk: 0 -> 1786015371 00002000:00010000:2.0:1786015373.682670:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb atime from disk: 0 -> 1786015371 00002000:00010000:2.0:1786015373.682672:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb ctime from disk: 0 -> 1786015371 00002000:00010000:2.0:1786015373.682674:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 1 -> 10247 00000100:00100000:2.0:1786015373.683131:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280428032:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 749us (1494us total) trans 4294967339 rc 0/0 00000100:00100000:2.0:1786015373.683140:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 217 00000100:00100000:2.0:1786015373.692148:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.692246:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280428288 00000100:00100000:3.0:1786015373.692257:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280428288 00000100:00100000:3.0:1786015373.692319:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 871 00000100:00100000:3.0:1786015373.692331:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+39:24597:x1872772280428288:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1786015373.692413:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c500f1d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.692433:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c500eb4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83da expref: 39 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.692462:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c500f1d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.692499:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c500eb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83da expref: 39 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.692513:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c500eb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83da expref: 39 pid: 12526 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015373.692528:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9af480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304387840:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015373.692623:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7493008c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015373.697382:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9af480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304387840:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015373.697423:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c500f1d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015373.699274:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015373.699678:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280428416 00000100:00100000:0.0:1786015373.699699:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280428416 00010000:00010000:0.0:1786015373.699747:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c500eb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83da expref: 40 pid: 12526 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015373.699804:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 270 00000100:00100000:0.0:1786015373.699832:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+40:2353:x1872772280428416:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015373.699860:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015373.699869:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c500eb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83da expref: 40 pid: 12526 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.699883:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c500eb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83da expref: 40 pid: 12526 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.699906:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c500eb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83da expref: 40 pid: 12526 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.699923:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:0.0:1786015373.699928:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c500f1d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.699939:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c500f1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.699947:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c500f1d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015373.699983:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015373.700046:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+39:2353:x1872772280428416:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 233us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015373.700054:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 270 00010000:00010000:3.0:1786015373.700235:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c500f1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.700244:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c500f1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.700280:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c500f1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.700287:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c500f1d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.700294:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c500f1d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.700300:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015373.700304:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c500f1d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.700319:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c500f1d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.700329:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:3.0:1786015373.700331:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1786015373.700335:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c500f1d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.700341:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c500f1d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015373.700384:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+38:24597:x1872772280428288:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 8056us (8245us total) trans 0 rc -22/-22 00000100:00100000:3.0:1786015373.700393:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 871 00000100:00100000:3.0:1786015373.706253:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015373.707282:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280428544 00000100:00100000:2.0:1786015373.707296:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280428544 00000100:00100000:2.0:1786015373.707413:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 218 00000100:00100000:2.0:1786015373.707423:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2352:x1872772280428544:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786015373.707476:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000681cdb75/0xb1a5ef690c500f24 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.707498:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c500ef3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83fd expref: 10 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.707507:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015373.707512:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786015373.707516:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000681cdb75/0xb1a5ef690c500f24 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.707559:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c500ef3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83fd expref: 10 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.707576:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c500ef3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83fd expref: 10 pid: 11384 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015373.707591:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304387968:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015373.707708:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74aee18b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786015373.714479:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304387968:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015373.714508:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000681cdb75/0xb1a5ef690c500f24 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015373.731172:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015373.731497:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280428672 00000100:00100000:1.0:1786015373.731509:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280428672 00010000:00010000:1.0:1786015373.731567:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c500ef3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83fd expref: 11 pid: 11384 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015373.731615:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 271 00000100:00100000:1.0:1786015373.731624:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280428672:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015373.731639:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015373.731672:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c500ef3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83fd expref: 11 pid: 11384 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.731687:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c500ef3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83fd expref: 11 pid: 11384 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.731710:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c500ef3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83fd expref: 11 pid: 11384 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.731728:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015373.731744:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015373.731751:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000681cdb75/0xb1a5ef690c500f24 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.731804:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000681cdb75/0xb1a5ef690c500f24 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015373.731851:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015373.731917:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280428672:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 293us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015373.731926:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 271 00010000:00010000:3.0:1786015373.732402:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000681cdb75/0xb1a5ef690c500f24 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.732413:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000681cdb75/0xb1a5ef690c500f24 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.732442:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000681cdb75/0xb1a5ef690c500f24 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.732458:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000681cdb75/0xb1a5ef690c500f24 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.732466:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000681cdb75/0xb1a5ef690c500f24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.732474:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015373.732478:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000681cdb75/0xb1a5ef690c500f24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.732488:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000681cdb75/0xb1a5ef690c500f24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.732501:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000681cdb75/0xb1a5ef690c500f24 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.732508:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000681cdb75/0xb1a5ef690c500f24 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015373.732578:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280428544:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 25155us (26334us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015373.732586:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 218 00000100:00100000:3.0:1786015373.737942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015373.738152:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280428928 00000100:00100000:2.0:1786015373.738162:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280428928 00000100:00100000:2.0:1786015373.738227:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 872 00000100:00100000:2.0:1786015373.738237:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+38:24597:x1872772280428928:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1786015373.738357:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c500f2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.738376:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c500f2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.738389:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c500f2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.738966:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c500f32 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.738982:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f16 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8404 expref: 39 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.738991:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c500f32 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.739032:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8404 expref: 39 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.739047:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f16 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8404 expref: 39 pid: 7673 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015373.739062:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304388096:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015373.739160:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74aee18e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786015373.743470:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304388096:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015373.743500:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c500f32 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015373.747317:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.747945:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280429056 00000100:00100000:3.0:1786015373.747956:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280429056 00010000:00010000:3.0:1786015373.748010:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f16 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8404 expref: 40 pid: 7673 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015373.748054:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 272 00000100:00100000:3.0:1786015373.748064:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74865aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+40:2351:x1872772280429056:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015373.748080:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015373.748087:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f16 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8404 expref: 40 pid: 7673 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.748099:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8404 expref: 40 pid: 7673 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.748122:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8404 expref: 40 pid: 7673 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.748138:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:3.0:1786015373.748144:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c500f32 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.748153:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c500f32 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.748161:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c500f32 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.748195:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015373.748251:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74865aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+39:2351:x1872772280429056:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 188us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015373.748260:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 272 00010000:00010000:2.0:1786015373.749412:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c500f32 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.749424:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c500f32 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786015373.749695:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967874 00000001:00080000:2.0:1786015373.750060:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967875 00000001:00080000:2.0:1786015373.750101:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967876 00000100:00100000:2.0:1786015373.750182:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383949880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304388224:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786015373.750245:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015373.750336:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015373.753368:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304388224 00000100:00100000:0.0:1786015373.753382:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304388224 00000100:00100000:0.0:1786015373.753455:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1786015373.753465:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5796:x1872772304388224:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1786015373.753593:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5796:x1872772304388224:12345-0@lo:1000:mdt00_002.0 Request processed in 130us (3347us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015373.753600:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1786015373.753749:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383949880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304388224:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1786015373.754367:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967877 00000100:00100000:3.0:1786015373.754447:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304388352:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1786015373.754494:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015373.754542:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c13189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015373.755469:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304388352 00000100:00100000:0.0:1786015373.755480:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304388352 00000100:00100000:0.0:1786015373.755523:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786015373.755533:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5796:x1872772304388352:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1786015373.756091:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5796:x1872772304388352:12345-0@lo:1000:mdt00_002.0 Request processed in 558us (1594us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1786015373.756100:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1786015373.757408:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304388352:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1786015373.757588:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967878 00010000:00010000:3.0:1786015373.757639:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c500f32 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.757661:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c500f32 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.757669:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c500f32 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.757675:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015373.757689:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c500f32 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.757697:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c500f32 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.757714:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:3.0:1786015373.757717:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015373.757721:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c500f32 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.757734:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c500f32 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.757914:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c500e28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.757922:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c500e28 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.757928:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c500e28 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.757932:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015373.757935:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c500e28 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.757940:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c500e28 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.757948:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b7483ee6f00) 00010000:00010000:3.0:1786015373.757951:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015373.757958:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c500e2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83b7 expref: 81 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.757970:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c500e2f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83b7 expref: 81 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.757978:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c500e2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83b7 expref: 81 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.758015:0:5796:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c500e2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83b7 expref: 81 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015373.758043:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304388480:192.168.202.56@tcp:105: 00000100:00100000:3.0:1786015373.758143:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c13189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015373.766793:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.767086:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304388480:192.168.202.56@tcp:105: 00010000:00010000:3.0:1786015373.767112:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c500e28 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.767122:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c500e28 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.767156:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f39 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.767169:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.767180:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.767190:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.767196:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f39 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.767202:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.767207:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015373.767210:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.767233:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f39 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.767246:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b7483ee6f00) 00010000:00010000:3.0:1786015373.767249:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015373.767253:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f39 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.767257:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c500f39 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.767266:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c500f2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.767271:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c500f2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.767276:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c500f2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.767281:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015373.767284:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c500f2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.767289:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c500f2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.767295:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b7483ee6f00) 00010000:00010000:3.0:1786015373.767298:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786015373.767300:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c500f2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.767315:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c500f2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015373.767721:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+43:24597:x1872772280428928:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 29483us (29789us total) trans 4294967879 rc 0/0 00000100:00100000:3.0:1786015373.767731:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 872 00000020:00080000:3.0:1786015373.767738:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:0.0:1786015373.768182:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015373.768188:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015373.768683:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1786015373.768693:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015373.770180:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280429184 00000100:00100000:1.0:1786015373.770196:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280429184 00000100:00100000:1.0:1786015373.770296:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 178 00000100:00100000:1.0:1786015373.770305:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916b6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+82:24596:x1872772280429184:12345-192.168.202.56@tcp:49:md5sum.0 00000100:00100000:1.0:1786015373.770450:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916b6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+82:24596:x1872772280429184:12345-192.168.202.56@tcp:49:md5sum.0 Request processed in 145us (3692us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015373.770458:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 178 00000100:00100000:2.0:1786015373.776579:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.776693:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280429440 00000100:00100000:3.0:1786015373.776704:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280429440 00000100:00100000:3.0:1786015373.776805:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 179 00000100:00100000:3.0:1786015373.777205:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+43:24597:x1872772280429440:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1786015373.778274:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x16:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1786015373.778409:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967880 00010000:00010000:3.0:1786015373.778464:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c500f40 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.778483:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c500f40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.778495:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c500f40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.778504:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c500f40 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.778510:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c500f40 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.778517:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c500f40 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.778560:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786015373.778678:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+45:24597:x1872772280429440:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1852us (2104us total) trans 4294967881 rc 0/0 00000100:00100000:3.0:1786015373.778689:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 179 00000020:00080000:3.0:1786015373.778694:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786015373.778987:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786015373.778995:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c500f40 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.779004:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc000 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015373.779007:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c500f40 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.779016:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c500f40 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.779029:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:2.0:1786015373.779033:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786015373.779037:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c500f40 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.779043:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c500f40 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015373.779064:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015373.779066:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015373.779068:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015373.782465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015373.782578:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280429568 00000100:00100000:3.0:1786015373.782588:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280429568 00000100:00100000:3.0:1786015373.782700:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 219 00000100:00100000:3.0:1786015373.782711:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+11:24596:x1872772280429568:12345-192.168.202.56@tcp:101:md5sum.0 00010000:00010000:3.0:1786015373.782731:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015373.782798:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f23b128/0xb1a5ef690c500f47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e840b expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015373.783047:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 5242880, mtime: 0x6a746e8b, atime: 0x6a746e8b, ctime: 0x6a746e8b, blocks: 0x2807 00010000:00010000:3.0:1786015373.783077:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=609s v=(0 0) 00010000:00010000:3.0:1786015373.783082:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015373.783094:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f23b128/0xb1a5ef690c500f47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e840b expref: 12 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.783114:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f23b128/0xb1a5ef690c500f47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e840b expref: 12 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015373.783129:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc200, rc 0) 00000100:00100000:3.0:1786015373.783193:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+12:24596:x1872772280429568:12345-192.168.202.56@tcp:101:md5sum.0 Request processed in 483us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015373.783212:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 219 00000100:00100000:2.0:1786015373.788319:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015373.788406:0:17970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280429696 00000100:00100000:1.0:1786015373.788416:0:17970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280429696 00002000:00100000:1.0:1786015373.788472:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x11:0x0] (0->32767) req@ffff8b7383948000 x1872772280429696/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:219/0 lens 488/0 e 0 to 0 dl 1786015384 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015373.788482:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7383948000 with x1872772280429696 ext(0->32767) 00002000:00010000:1.0:1786015373.788488:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7383948000 00000100:00100000:1.0:1786015373.788526:0:17970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 80 00000100:00100000:1.0:1786015373.788535:0:17970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280429696:12345-192.168.202.56@tcp:3:md5sum.0 00000100:00100000:1.0:1786015373.795593:0:17970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280429696:12345-192.168.202.56@tcp:3:md5sum.0 Request processed in 7044us (7269us total) trans 0 rc 32768/32768 00000100:00100000:1.0:1786015373.795609:0:17970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 80 00002000:00100000:1.0:1786015373.795623:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x11:0x0] (0->32767) req@ffff8b7383948000 x1872772280429696/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:219/0 lens 488/440 e 0 to 0 dl 1786015384 ref 1 fl Complete:/600/0 rc 32768/32768 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015373.795634:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7383948000 with x1872772280429696 ext(0->32767) 00002000:00010000:1.0:1786015373.795650:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7383948000 00000100:00100000:0.0:1786015373.806162:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015373.806265:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280429824 00000100:00100000:2.0:1786015373.806276:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280429824 00002000:00100000:2.0:1786015373.806326:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (32768->1048575) req@ffff8b7381940380 x1872772280429824/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:219/0 lens 488/0 e 0 to 0 dl 1786015384 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015373.806336:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381940380 with x1872772280429824 ext(32768->1048575) 00002000:00010000:2.0:1786015373.806343:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7381940380 00000100:00100000:2.0:1786015373.806378:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 81 00000100:00100000:2.0:1786015373.806388:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280429824:12345-192.168.202.56@tcp:3:md5sum.0 00000100:00100000:3.0:1786015373.828148:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280429824:12345-192.168.202.56@tcp:3:md5sum.0 Request processed in 21748us (21984us total) trans 0 rc 1015808/1015808 00000100:00100000:3.0:1786015373.828164:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 81 00002000:00100000:3.0:1786015373.828177:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (32768->1048575) req@ffff8b7381940380 x1872772280429824/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:219/0 lens 488/440 e 0 to 0 dl 1786015384 ref 1 fl Complete:/600/0 rc 1015808/1015808 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015373.828188:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381940380 with x1872772280429824 ext(32768->1048575) 00002000:00010000:3.0:1786015373.828195:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7381940380 00000100:00100000:2.0:1786015373.851222:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015373.851261:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015373.851291:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015373.851322:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015373.851411:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280429952 00000100:00100000:0.0:1786015373.851422:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280429952 00002000:00100000:0.0:1786015373.851473:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1048576->2097151) req@ffff8b7383949f80 x1872772280429952/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:219/0 lens 488/0 e 0 to 0 dl 1786015384 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015373.851485:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7383949f80 with x1872772280429952 ext(1048576->2097151) 00002000:00010000:0.0:1786015373.851490:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7383949f80 00000100:00100000:0.0:1786015373.851522:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280430208 00000100:00100000:0.0:1786015373.851540:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280430208 00002000:00100000:0.0:1786015373.851560:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (3145728->4194303) req@ffff8b7383948e00 x1872772280430208/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:219/0 lens 488/0 e 0 to 0 dl 1786015384 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015373.851568:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7383948e00 with x1872772280430208 ext(3145728->4194303) 00002000:00010000:0.0:1786015373.851572:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7383948e00 00000100:00100000:0.0:1786015373.851580:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280430080 00000100:00100000:0.0:1786015373.851582:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280430080 00002000:00100000:0.0:1786015373.851596:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (2097152->3145727) req@ffff8b7383948700 x1872772280430080/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:219/0 lens 488/0 e 0 to 0 dl 1786015384 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015373.851605:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7383948700 with x1872772280430080 ext(2097152->3145727) 00002000:00010000:0.0:1786015373.851607:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7383948700 00000100:00100000:0.0:1786015373.851615:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280430336 00000100:00100000:0.0:1786015373.851617:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280430336 00002000:00100000:0.0:1786015373.851630:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (4194304->5242879) req@ffff8b738394a680 x1872772280430336/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:219/0 lens 488/0 e 0 to 0 dl 1786015384 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015373.851637:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b738394a680 with x1872772280430336 ext(4194304->5242879) 00002000:00010000:0.0:1786015373.851649:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b738394a680 00000100:00100000:0.0:1786015373.851662:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 82 00000100:00100000:0.0:1786015373.851671:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41677fca-39fb-471c-b582-96bce6540a36+15:2353:x1872772280429952:12345-192.168.202.56@tcp:3:md5sum.0 00000100:00100000:0.0:1786015373.852536:0:17969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 83 00000100:00100000:0.0:1786015373.852547:0:17969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280430208:12345-192.168.202.56@tcp:3:md5sum.0 00000100:00100000:1.0:1786015373.854253:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 84 00000100:00100000:1.0:1786015373.854273:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280430080:12345-192.168.202.56@tcp:3:md5sum.0 00000100:00100000:2.0:1786015373.890951:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280429952:12345-192.168.202.56@tcp:3:md5sum.0 Request processed in 39270us (39729us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1786015373.890965:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 82 00002000:00100000:2.0:1786015373.890979:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1048576->2097151) req@ffff8b7383949f80 x1872772280429952/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:219/0 lens 488/440 e 0 to 0 dl 1786015384 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015373.890990:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7383949f80 with x1872772280429952 ext(1048576->2097151) 00002000:00010000:2.0:1786015373.890997:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7383949f80 00000100:00100000:2.0:1786015373.891030:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 85 00000100:00100000:2.0:1786015373.891042:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280430336:12345-192.168.202.56@tcp:3:md5sum.0 00000100:00100000:0.0:1786015373.934578:0:17969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280430208:12345-192.168.202.56@tcp:3:md5sum.0 Request processed in 82021us (83304us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786015373.934591:0:17969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 83 00002000:00100000:0.0:1786015373.934617:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (3145728->4194303) req@ffff8b7383948e00 x1872772280430208/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:219/0 lens 488/440 e 0 to 0 dl 1786015384 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015373.934627:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7383948e00 with x1872772280430208 ext(3145728->4194303) 00002000:00010000:0.0:1786015373.934651:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7383948e00 00000100:00100000:1.0:1786015373.961254:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41677fca-39fb-471c-b582-96bce6540a36+14:2353:x1872772280430080:12345-192.168.202.56@tcp:3:md5sum.0 Request processed in 106979us (109951us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1786015373.961269:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 84 00002000:00100000:1.0:1786015373.961283:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (2097152->3145727) req@ffff8b7383948700 x1872772280430080/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:219/0 lens 488/440 e 0 to 0 dl 1786015384 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015373.961295:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7383948700 with x1872772280430080 ext(2097152->3145727) 00002000:00010000:1.0:1786015373.961302:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7383948700 00000100:00100000:0.0:1786015373.961495:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280430336:12345-192.168.202.56@tcp:3:md5sum.0 Request processed in 70456us (110171us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1786015373.961503:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 85 00002000:00100000:0.0:1786015373.961509:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (4194304->5242879) req@ffff8b738394a680 x1872772280430336/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:219/0 lens 488/440 e 0 to 0 dl 1786015384 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015373.961518:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b738394a680 with x1872772280430336 ext(4194304->5242879) 00002000:00010000:0.0:1786015373.961521:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b738394a680 00000100:00100000:1.0:1786015373.991565:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015373.992268:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280430592 00000100:00100000:2.0:1786015373.992281:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280430592 00000100:00100000:2.0:1786015373.992359:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 180 00000100:00100000:2.0:1786015373.992387:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+82:24596:x1872772280430592:12345-192.168.202.56@tcp:35:md5sum.0 00000100:00100000:2.0:1786015373.992657:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+83:24596:x1872772280430592:12345-192.168.202.56@tcp:35:md5sum.0 Request processed in 273us (1103us total) trans 4294967882 rc 0/0 00000100:00100000:2.0:1786015373.992664:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 180 00010000:00010000:1.0:1786015374.191807:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015374.829134:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015374.829144:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015374.829537:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 22 count 3 00000040:00080000:0.0:1786015374.829544:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015375.213964:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015376.238781:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015376.460601:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015376.460658:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015376.460695:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015376.460739:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015376.460756:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015376.460813:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015376.460879:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015376.460908:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280430976 00000100:00100000:3.0:1786015376.460918:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280430976 00000100:00100000:3.0:1786015376.460973:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280431104 00000100:00100000:3.0:1786015376.460976:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280431104 00000100:00100000:3.0:1786015376.460991:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280431360 00000100:00100000:3.0:1786015376.460994:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280431360 00000100:00100000:3.0:1786015376.461007:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280431488 00000100:00100000:3.0:1786015376.461009:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280431488 00000100:00100000:3.0:1786015376.461026:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 347 00000100:00100000:3.0:1786015376.461036:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280430976:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015376.461285:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280430976:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 249us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015376.461309:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 347 00000100:00100000:0.0:1786015376.461351:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 348 00000100:00100000:0.0:1786015376.461378:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+11:2351:x1872772280431104:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015376.461449:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280430848 00000100:00100000:0.0:1786015376.461458:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+11:2351:x1872772280431104:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 89us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015376.461459:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280430848 00000100:00100000:2.0:1786015376.461534:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280430720 00000100:00100000:2.0:1786015376.461540:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280430720 00000100:00100000:2.0:1786015376.461571:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 553 00000100:00100000:2.0:1786015376.461579:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280430720:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015376.461627:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280430720:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 39us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015376.461635:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 553 00000100:00100000:1.0:1786015376.462376:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280431232 00000100:00100000:1.0:1786015376.462383:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280431232 00000100:00100000:1.0:1786015376.462412:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 379 00000100:00100000:1.0:1786015376.462419:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+83:2351:x1872772280430848:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015376.462461:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+83:2351:x1872772280430848:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 43us (1804us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015376.462468:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 379 00000100:00100000:1.0:1786015376.462480:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 380 00000100:00100000:1.0:1786015376.462485:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:2352:x1872772280431232:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015376.462506:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:2352:x1872772280431232:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (1749us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015376.462512:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 380 00000100:00100000:3.0:1786015376.463250:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 349 00000100:00100000:3.0:1786015376.463265:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280431360:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015376.463305:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280431360:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 47us (2492us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015376.463312:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 349 00000100:00100000:3.0:1786015376.463331:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 350 00000100:00100000:3.0:1786015376.463337:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280431488:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015376.463357:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280431488:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (2478us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015376.463362:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 350 00000100:00080000:3.0:1786015376.469305:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015376.469316:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015376.469319:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015376.471402:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 348 00000100:00100000:1.0:1786015376.556092:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786015376.556133:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304388608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015376.556208:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015376.556411:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304388608 00000100:00100000:3.0:1786015376.556419:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304388608 00000100:00100000:3.0:1786015376.556481:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1786015376.556490:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1872772304388608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015376.556532:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 73203712 pending 0 free 3852468224 avail 3850371072 00000100:00080000:2.0:1786015376.556589:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015376.556590:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1872772304388608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015376.556601:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1786015376.556686:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304388608:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786015377.260013:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015378.093119:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304388864:0@lo:400:kworker.0 00000100:00100000:2.0:1786015378.093220:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015378.093292:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304389376:0@lo:400:kworker.0 00000100:00100000:2.0:1786015378.093324:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015378.093360:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786015378.093366:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304388992:0@lo:400:kworker.0 00000100:00100000:2.0:1786015378.093390:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015378.093433:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304389376 00000100:00100000:2.0:1786015378.093441:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304389376 00000100:00100000:2.0:1786015378.093516:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1786015378.093526:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304389376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015378.093591:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304389376:12345-0@lo:400:kworker.0 Request processed in 66us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015378.093619:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00080000:2.0:1786015378.093644:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015378.093680:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967347 gen 2 00000004:00080000:2.0:1786015378.093702:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967347 committed transno 4294967347 00000100:00100000:2.0:1786015378.093727:0:3312:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8b738394bb80 x1872772304387456/t4294967348(4294967348) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786015389 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786015378.093741:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304389376:0@lo:400:kworker.0 00000100:00100000:0.0:1786015378.093974:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304389120:0@lo:400:kworker.0 00000100:00100000:0.0:1786015378.094024:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015378.094050:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786015378.094057:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304388736:0@lo:400:kworker.0 00000100:00100000:0.0:1786015378.094100:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015378.094124:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304389248:0@lo:400:kworker.0 00000100:00100000:0.0:1786015378.094148:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015378.094179:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304389120 00000100:00100000:0.0:1786015378.094183:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304389120 00000100:00100000:0.0:1786015378.094223:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1786015378.094232:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1872772304389120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015378.094274:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1872772304389120:12345-0@lo:400:kworker.0 Request processed in 45us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015378.094281:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1786015378.094304:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304388736 00000100:00100000:0.0:1786015378.094307:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304388736 00000100:00100000:0.0:1786015378.094338:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1786015378.094344:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304388736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015378.094374:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304388736:12345-0@lo:400:kworker.0 Request processed in 31us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015378.094380:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00080000:0.0:1786015378.094407:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015378.094429:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304388736:0@lo:400:kworker.0 00000100:00100000:0.0:1786015378.094442:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304389120:0@lo:400:kworker.0 00000100:00100000:1.0:1786015378.094660:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304388864 00000100:00100000:1.0:1786015378.094665:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304388864 00000100:00100000:1.0:1786015378.094702:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304388992 00000100:00100000:1.0:1786015378.094705:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304388992 00000100:00100000:1.0:1786015378.094739:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304389248 00000100:00100000:1.0:1786015378.094742:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304389248 00000100:00100000:1.0:1786015378.094780:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00080000:0.0:1786015378.094920:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015378.094968:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304388864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015378.095101:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304388864:12345-0@lo:400:kworker.0 Request processed in 135us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015378.095155:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304388864:0@lo:400:kworker.0 00000100:00100000:2.0:1786015378.095197:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1786015378.095210:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304388992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015378.095260:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304388992:12345-0@lo:400:kworker.0 Request processed in 53us (1868us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015378.095267:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1786015378.095288:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1786015378.095294:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304389248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015378.095327:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304389248:12345-0@lo:400:kworker.0 Request processed in 34us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015378.095332:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1786015378.096918:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304388992:0@lo:400:kworker.0 00000100:00100000:0.0:1786015378.096986:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304389248:0@lo:400:kworker.0 00000100:00100000:1.0:1786015378.102214:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00010000:00010000:3.0:1786015378.287970:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015378.604818:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304389504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015378.604905:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015378.604993:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304389504 00000100:00100000:2.0:1786015378.605002:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304389504 00000100:00100000:2.0:1786015378.605063:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1786015378.605074:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1872772304389504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015378.605119:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 69664768 pending 0 free 3852468224 avail 3850371072 00000100:00100000:2.0:1786015378.605174:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1872772304389504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015378.605198:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1786015378.605250:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304389504:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1786015378.691744:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967340 is committed 00000001:00080000:2.0:1786015378.691814:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967339 is committed 00000001:00080000:2.0:1786015378.694652:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967882 is committed 00000001:00080000:2.0:1786015378.694668:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967877 is committed 00000020:00080000:2.0:1786015378.694686:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 13 batchid updated 00000004:00080000:2.0:1786015378.694702:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 15 committed 00000001:00080000:2.0:1786015378.694732:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967881 is committed 00000020:00080000:2.0:1786015378.694748:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b74aee18b40 refcount 2 committed 0 result 0 batchid 14 00000020:00080000:2.0:1786015378.694754:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74aa87f100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b7493008c00 00000020:00080000:2.0:1786015378.694757:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74aa87fe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74af060c00 00000020:00080000:2.0:1786015378.695006:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 14 committed batchid 13 00000020:00080000:2.0:1786015378.695252:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 13 00000001:00080000:2.0:1786015378.699653:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967349 is committed 00010000:00010000:0.0:1786015379.308103:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015380.335889:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015380.339078:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015380.339165:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280431616 00000100:00100000:3.0:1786015380.339196:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280431616 00000100:00100000:3.0:1786015380.339292:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 873 00000100:00100000:3.0:1786015380.339305:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+82:25015:x1872772280431616:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015380.339337:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015380.339370:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c500f4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8412 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.339470:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c500f55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.339490:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c500f55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.339505:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c500f55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015380.340181:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 7680 00000004:00200000:3.0:1786015380.340190:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015380.340292:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c500f55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.340339:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c500f4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8412 expref: 84 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.340364:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c500f55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8412 expref: 83 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.340375:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:3.0:1786015380.340379:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015380.340383:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc800, rc 0) 00000100:00100000:3.0:1786015380.340487:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+83:25015:x1872772280431616:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1185us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015380.340496:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 873 00000100:00080000:0.0:1786015380.343720:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015380.356897:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015380.357561:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280431872 00000100:00100000:2.0:1786015380.357649:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280431872 00000100:00100000:2.0:1786015380.357911:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 874 00000100:00100000:2.0:1786015380.357925:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+83:25015:x1872772280431872:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015380.357955:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015380.357984:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500f5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8419 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015380.358326:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 7680 00010000:00010000:2.0:1786015380.358569:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500f5c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8419 expref: 85 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015380.359060:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:2.0:1786015380.359064:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786015380.359072:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500f5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8419 expref: 85 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015380.359087:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73829f9400, rc 0) 00000100:00100000:2.0:1786015380.359183:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+84:25015:x1872772280431872:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1260us (2299us total) trans 4294967883 rc 301/301 00000100:00100000:2.0:1786015380.359193:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 874 00000100:00100000:3.0:1786015380.371036:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015380.371174:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280432000 00000100:00100000:0.0:1786015380.371189:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280432000 00000100:00100000:0.0:1786015380.371285:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 181 00000100:00100000:0.0:1786015380.371297:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+84:25015:x1872772280432000:12345-192.168.202.56@tcp:37:rm.0 00000100:00100000:3.0:1786015380.378239:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+84:25015:x1872772280432000:12345-192.168.202.56@tcp:37:rm.0 Request processed in 6928us (7204us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015380.378257:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 181 00000100:00100000:3.0:1786015380.382514:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015380.382735:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280432256 00000100:00100000:0.0:1786015380.382749:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280432256 00000100:00100000:0.0:1786015380.382999:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 182 00000100:00100000:0.0:1786015380.383010:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+84:25015:x1872772280432256:12345-192.168.202.56@tcp:35:rm.0 00000100:00100000:0.0:1786015380.383705:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+85:25015:x1872772280432256:12345-192.168.202.56@tcp:35:rm.0 Request processed in 692us (1202us total) trans 4294967884 rc 0/0 00000100:00100000:0.0:1786015380.383716:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 182 00000100:00100000:1.0:1786015380.388322:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015380.388412:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280432512 00000100:00100000:3.0:1786015380.388426:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280432512 00000100:00100000:3.0:1786015380.388498:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 875 00000100:00100000:3.0:1786015380.388510:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+85:25015:x1872772280432512:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015380.388545:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015380.388590:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500f6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8420 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.388975:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500f71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.388994:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500f71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.389008:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500f71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015380.389021:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 7680 00010000:00010000:3.0:1786015380.389222:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c500f6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8420 expref: 88 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.389254:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500f71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8420 expref: 87 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.389264:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:3.0:1786015380.389267:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786015380.389272:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbce00, rc 0) 00000100:00100000:3.0:1786015380.390502:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+87:25015:x1872772280432512:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1979us (2184us total) trans 4294967885 rc 0/0 00000100:00100000:3.0:1786015380.390518:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 875 00000100:00100000:3.0:1786015380.399895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015380.399961:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280432640 00000100:00100000:2.0:1786015380.399973:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280432640 00000100:00100000:2.0:1786015380.400049:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 876 00000100:00100000:2.0:1786015380.400074:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+87:25015:x1872772280432640:12345-192.168.202.56@tcp:41:rm.0 00000004:00000024:2.0:1786015380.400163:0:5796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 14680064 pending 0 free 7704936448 avail 7696547840 00000100:00100000:2.0:1786015380.400257:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+87:25015:x1872772280432640:12345-192.168.202.56@tcp:41:rm.0 Request processed in 186us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015380.400266:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 876 00000100:00100000:3.0:1786015380.405250:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015380.405338:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280432768 00000100:00100000:0.0:1786015380.405353:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280432768 00000100:00100000:0.0:1786015380.405453:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 877 00000100:00100000:0.0:1786015380.405465:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+87:25015:x1872772280432768:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:0.0:1786015380.405497:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015380.405526:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c500f7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8427 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.405636:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500f86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.405656:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500f86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.405698:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500f86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.405717:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500f8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.405724:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500f8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.405731:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500f8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.406489:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c500f94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.406501:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c500f94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.406510:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c500f94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015380.406563:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00000004:00200000:0.0:1786015380.406646:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015380.406750:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c500f94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.406863:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c500f94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.406874:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500f86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.406893:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500f86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.406900:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500f86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.406907:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015380.406912:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500f86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.406922:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500f86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.406939:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:0.0:1786015380.406943:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015380.406950:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500f86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.406957:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c500f86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.406975:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500f8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.407208:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500f8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.407215:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500f8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.407221:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015380.407231:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500f8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.407238:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500f8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.407247:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff8b748f24a000) 00010000:00010000:0.0:1786015380.407250:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015380.407253:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500f8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.407259:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500f8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.407313:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c500f7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8427 expref: 89 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.407328:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c500f94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8427 expref: 88 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.407336:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b7483ee6f00) 00010000:00010000:0.0:1786015380.407338:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015380.407340:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd800, rc 0) 00000100:00100000:0.0:1786015380.407447:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+88:25015:x1872772280432768:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1983us (2208us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015380.407456:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 877 00000100:00100000:1.0:1786015380.431705:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015380.434101:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280433024 00000100:00100000:0.0:1786015380.434123:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280433024 00000100:00100000:0.0:1786015380.434221:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 878 00000100:00100000:0.0:1786015380.434233:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+88:25015:x1872772280433024:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:0.0:1786015380.434336:0:7673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1786015380.434374:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c500f94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8427 expref: 88 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.434402:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c500e2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83b7 expref: 87 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.434414:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b7483ee6f00) 00010000:00010000:0.0:1786015380.434433:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c500f55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8412 expref: 86 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.434443:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:0.0:1786015380.434446:0:7673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015380.434478:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500f9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.434494:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500f9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.434505:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500f9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.434522:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c500fa2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.434528:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c500fa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.434534:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c500fa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.437379:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c500fa9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.437408:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c500fa9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.437425:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c500fa9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786015380.444919:0:7673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 64 off8728 00000004:00080000:0.0:1786015380.444946:0:7673:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 615696183842ns, next at 616696178842ns, rc = 0 00010000:00010000:0.0:1786015380.445071:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500fb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445093:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445109:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445120:0:7673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500fb0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445127:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500fb0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445134:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500fb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445159:0:7673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786015380.445192:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786015380.445213:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500fb0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445220:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd400 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015380.445225:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500fb0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445233:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500fb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445247:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015380.445251:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786015380.445257:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500fb0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445264:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c500fb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445280:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015380.445283:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015380.445285:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015380.445304:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c500fa9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445311:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c500fa9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445317:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c500fa9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445322:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015380.445326:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c500fa9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445337:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c500fa9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445345:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015380.445348:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786015380.445351:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c500fa9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445357:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c500fa9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445384:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500f9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445390:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500f9b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445396:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500f9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445401:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015380.445404:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500f9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445410:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500f9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445417:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:0.0:1786015380.445420:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015380.445423:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500f9b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.445437:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c500f9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015380.445448:0:7673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dd5182ce reply state 000000001def7159 transno 4294967886 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c500fa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015380.445459:0:7673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015380.445590:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+87:25015:x1872772280433024:12345-192.168.202.56@tcp:36:rm.0 Request processed in 11340us (13882us total) trans 4294967886 rc 0/0 00000100:00100000:0.0:1786015380.445602:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 878 00010000:00010000:3.0:1786015380.450785:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c500fa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.450811:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c500fa2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.450821:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c500fa2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.450828:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015380.450834:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c500fa2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.450843:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c500fa2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.450865:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff8b748f24a700) 00010000:00010000:3.0:1786015380.450881:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015380.450888:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c500fa2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.450895:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc800/0xb1a5ef690c500fa2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015380.487380:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015380.487497:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280433280 00000100:00100000:1.0:1786015380.487509:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280433280 00000100:00100000:1.0:1786015380.487613:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 183 00000100:00100000:1.0:1786015380.487625:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+86:25015:x1872772280433280:12345-192.168.202.56@tcp:35:rm.0 00000100:00100000:1.0:1786015380.488071:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+87:25015:x1872772280433280:12345-192.168.202.56@tcp:35:rm.0 Request processed in 447us (705us total) trans 4294967887 rc 0/0 00000100:00100000:1.0:1786015380.488081:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 183 00000100:00100000:3.0:1786015380.499804:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015380.502684:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280433536 00000100:00100000:2.0:1786015380.502707:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280433536 00000100:00100000:2.0:1786015380.502838:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 879 00000100:00100000:2.0:1786015380.502853:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+87:25015:x1872772280433536:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:2.0:1786015380.502943:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1786015380.502986:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c500f71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8420 expref: 87 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015380.503045:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c500cb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8339 expref: 86 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015380.503057:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:2.0:1786015380.503069:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afde00/0xb1a5ef690c500c99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8332 expref: 85 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015380.503078:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:2.0:1786015380.503083:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015380.503113:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500fb7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015380.503126:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83c5 expref: 35 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015380.503136:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500fb7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015380.503185:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83c5 expref: 35 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015380.503202:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83c5 expref: 35 pid: 5796 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015380.503220:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee1c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304389632:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015380.503372:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482d78b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786015380.515755:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015380.515886:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee1c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304389632:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015380.515907:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280433664 00000100:00100000:3.0:1786015380.515917:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280433664 00010000:00010000:2.0:1786015380.515943:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500fb7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.515987:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83c5 expref: 36 pid: 5796 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015380.516026:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 273 00000100:00100000:3.0:1786015380.516037:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+36:2353:x1872772280433664:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015380.516058:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015380.516066:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83c5 expref: 36 pid: 5796 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.516080:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83c5 expref: 36 pid: 5796 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.516109:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384d32200/0xb1a5ef690c500e67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83c5 expref: 36 pid: 5796 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.516127:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:3.0:1786015380.516133:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500fb7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.516155:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500fb7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.516163:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500fb7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.516196:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015380.516241:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500fb7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015380.516249:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500fb7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015380.516266:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+35:2353:x1872772280433664:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 231us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015380.516275:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 273 00010000:00010000:2.0:1786015380.516291:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500fbe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015380.516303:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500fbe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015380.516310:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500fbe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786015380.516795:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786015380.516911:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500fc5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015380.516926:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c500e83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83cc expref: 34 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015380.516933:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500fc5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015380.516970:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c500e83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83cc expref: 34 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015380.516985:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c500e83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83cc expref: 34 pid: 12526 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015380.517011:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee1c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304389760:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015380.517114:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482d78b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786015380.520213:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015380.520307:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280433792 00000100:00100000:3.0:1786015380.520320:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280433792 00010000:00010000:3.0:1786015380.520380:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c500e83 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83cc expref: 35 pid: 12526 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015380.520434:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 274 00000100:00100000:3.0:1786015380.520445:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+35:2351:x1872772280433792:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015380.520465:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015380.520474:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c500e83 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83cc expref: 35 pid: 12526 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.520490:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c500e83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83cc expref: 35 pid: 12526 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.520523:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:3.0:1786015380.520530:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500fc5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.520567:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500fc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.520588:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500fc5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015380.520616:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015380.520710:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+35:2351:x1872772280433792:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 265us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015380.520718:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 274 00010000:00010000:2.0:1786015380.522034:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c500e83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e83cc expref: 34 pid: 12526 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015380.522062:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee1c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304389760:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015380.522095:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500fc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015380.522106:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500fc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015380.522113:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500fc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015380.523316:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 7680 00010000:00010000:0.0:1786015380.523349:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500fc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.523360:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500fc5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.523369:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500fc5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.523376:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015380.523381:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500fc5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.523390:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500fc5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.523427:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:0.0:1786015380.523431:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786015380.523438:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500fc5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.523445:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c500fc5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.523483:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500fb7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.523490:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500fb7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.523496:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500fb7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.523501:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73829f9400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015380.523504:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500fb7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.523511:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500fb7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.523518:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:0.0:1786015380.523521:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015380.523524:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500fb7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015380.523530:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c500fb7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015380.523554:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d8f7e0e3 reply state 00000000910f0433 transno 4294967888 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500fbe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015380.523564:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015380.523884:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+86:25015:x1872772280433536:12345-192.168.202.56@tcp:36:rm.0 Request processed in 21030us (24134us total) trans 4294967888 rc 0/0 00000100:00100000:0.0:1786015380.523895:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 879 00010000:00010000:1.0:1786015380.536890:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500fbe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015380.536917:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500fbe lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015380.536955:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500fbe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015380.536963:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73829f9600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015380.536969:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500fbe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015380.536979:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500fbe lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015380.537004:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c6c0408 (ffff8b7499c59100) 00010000:00010000:1.0:1786015380.537007:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015380.537013:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500fbe lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015380.537019:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c500fbe lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015380.611689:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015380.614038:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280433920 00000100:00100000:0.0:1786015380.615038:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280433920 00000100:00100000:1.0:1786015380.615527:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 880 00000100:00100000:1.0:1786015380.615544:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+34:24568:x1872772280433920:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1786015380.615734:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+34:24568:x1872772280433920:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 192us (4062us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015380.615743:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 880 00010000:00010000:0.0:1786015381.359983:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015381.579095:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015381.579147:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015381.579177:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015381.579209:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015381.579233:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015381.579254:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015381.579281:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015381.579317:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280434560 00000100:00100000:3.0:1786015381.579330:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280434560 00000100:00100000:3.0:1786015381.579393:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280434176 00000100:00100000:3.0:1786015381.579397:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280434176 00000100:00100000:3.0:1786015381.579424:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 384 00000100:00100000:3.0:1786015381.579436:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+34:2354:x1872772280434560:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015381.579538:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+34:2354:x1872772280434560:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 103us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015381.579546:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 384 00000100:00100000:3.0:1786015381.579587:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 385 00000100:00100000:3.0:1786015381.579608:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+85:2354:x1872772280434176:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015381.579645:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+85:2354:x1872772280434176:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015381.579651:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 385 00000100:00100000:3.0:1786015381.579674:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280434304 00000100:00100000:3.0:1786015381.579678:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280434304 00000100:00100000:3.0:1786015381.579718:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280434816 00000100:00100000:3.0:1786015381.579721:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280434816 00000100:00100000:3.0:1786015381.579735:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280434432 00000100:00100000:3.0:1786015381.579737:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280434432 00000100:00100000:3.0:1786015381.579749:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280434688 00000100:00100000:3.0:1786015381.579751:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280434688 00000100:00100000:3.0:1786015381.579796:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 353 00000100:00100000:3.0:1786015381.579803:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280434304:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015381.579831:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280434304:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015381.579837:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 353 00000100:00100000:3.0:1786015381.579850:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 354 00000100:00100000:3.0:1786015381.579855:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280434816:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015381.579881:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280434816:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015381.579886:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 354 00000100:00100000:3.0:1786015381.579897:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 355 00000100:00100000:3.0:1786015381.579903:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+11:2354:x1872772280434432:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015381.579925:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+11:2354:x1872772280434432:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015381.579938:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 355 00000100:00100000:3.0:1786015381.579952:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 356 00000100:00100000:3.0:1786015381.579958:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280434688:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015381.579983:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280434688:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015381.579990:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 356 00000100:00080000:3.0:1786015381.580214:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015381.580219:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015381.580547:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280434048 00000100:00100000:1.0:1786015381.580554:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280434048 00000100:00100000:1.0:1786015381.580640:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 555 00000100:00100000:1.0:1786015381.580647:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280434048:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015381.580703:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280434048:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 56us (1623us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015381.580710:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 555 00000100:00100000:2.0:1786015381.681092:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304389888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015381.681215:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015381.681352:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304389888 00000100:00100000:3.0:1786015381.681363:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304389888 00000100:00100000:3.0:1786015381.681455:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1786015381.681468:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304389888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015381.681526:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 73203712 pending 0 free 3852468224 avail 3850371072 00000004:00080000:0.0:1786015381.683101:0:6699:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 616934337177ns, next at 617934333588ns, rc = 0 00000100:00100000:3.0:1786015381.687945:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304389888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6453us (6703us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015381.687971:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:3.0:1786015381.688041:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015381.691860:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967340 gen 2 00000004:00080000:2.0:1786015381.691873:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b7383949500, transno 4294967338 00000004:00080000:2.0:1786015381.691896:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967340 committed transno 4294967340 00000100:00100000:2.0:1786015381.691942:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304389888:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1786015382.024278:0:18211:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12d: Restore of a non archived, non released file must work ========================================================== 07:23:01 (1786015381) 00000100:00100000:3.0:1786015382.300938:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015382.300999:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280434944 00000100:00100000:3.0:1786015382.301013:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280434944 00000100:00100000:3.0:1786015382.301087:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 881 00000100:00100000:3.0:1786015382.301098:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+34:25199:x1872772280434944:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015382.301128:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015382.301160:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c500fcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e842e expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.301272:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c500fd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.301290:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c500fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.301306:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c500fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015382.301394:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1786015382.301399:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015382.301431:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c500fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.301461:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c500fcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e842e expref: 36 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.301479:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c500fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e842e expref: 35 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.301489:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5900) 00010000:00010000:3.0:1786015382.301492:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015382.301496:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd200, rc 0) 00000100:00100000:3.0:1786015382.301586:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+35:25199:x1872772280434944:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 489us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015382.301595:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 881 00000100:00080000:3.0:1786015382.301622:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015382.314842:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015382.314925:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280435072 00000100:00100000:2.0:1786015382.314938:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280435072 00000100:00100000:2.0:1786015382.315015:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 882 00000100:00100000:2.0:1786015382.315027:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+85:25199:x1872772280435072:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015382.315072:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015382.315098:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c500fda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8435 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.315182:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c500fe1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.315200:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c500fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.315215:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c500fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015382.315297:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1786015382.315302:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015382.315334:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c500fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.315360:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c500fda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8435 expref: 87 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.315379:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c500fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8435 expref: 86 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.315389:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5900) 00010000:00010000:2.0:1786015382.315392:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015382.315396:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2179200, rc 0) 00000100:00100000:2.0:1786015382.315471:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+86:25199:x1872772280435072:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 446us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015382.315487:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 882 00000100:00080000:2.0:1786015382.315517:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015382.343698:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015382.344517:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280435200 00000100:00100000:3.0:1786015382.344552:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280435200 00000100:00100000:3.0:1786015382.344650:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 883 00000100:00100000:3.0:1786015382.344663:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+35:25200:x1872772280435200:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1786015382.344831:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+35:25200:x1872772280435200:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 170us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015382.344838:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 883 00000100:00100000:3.0:1786015382.347574:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015382.349324:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280435328 00000100:00100000:1.0:1786015382.349347:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280435328 00000100:00100000:1.0:1786015382.349436:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 884 00000100:00100000:1.0:1786015382.349448:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+86:25201:x1872772280435328:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015382.349480:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015382.349513:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c500fe8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e843c expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349617:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c500fef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349635:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c500fef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349649:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c500fef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349666:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c500ff6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349674:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c500ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349680:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c500ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349820:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c500fef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349828:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c500fef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349834:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c500fef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349840:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015382.349845:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c500fef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349854:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c500fef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349869:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5900) 00010000:00010000:1.0:1786015382.349873:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015382.349878:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c500fef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349885:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c500fef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349896:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c500ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349901:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c500ff6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349906:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c500ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349918:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015382.349921:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c500ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349926:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c500ff6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349934:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0a77ca6 (ffff8b7483ee6200) 00010000:00010000:1.0:1786015382.349937:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015382.349940:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c500ff6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349946:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c500ff6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349984:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c500fe8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e843c expref: 87 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.349995:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5900) 00010000:00010000:1.0:1786015382.349998:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015382.350001:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c500fe8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e843c expref: 87 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.350010:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46c00, rc 0) 00000100:00100000:1.0:1786015382.350105:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+86:25201:x1872772280435328:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 659us (2561us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015382.350114:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 884 00000100:00100000:2.0:1786015382.362321:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015382.362659:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280435584 00000100:00100000:3.0:1786015382.362674:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280435584 00000100:00100000:3.0:1786015382.362802:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 885 00000100:00100000:3.0:1786015382.362815:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+86:25201:x1872772280435584:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:3.0:1786015382.362895:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015382.362934:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c500fe1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8435 expref: 86 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.362962:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5900) 00010000:00010000:3.0:1786015382.362968:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015382.363092:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c500ffd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.363110:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c500fd3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e842e expref: 34 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.363119:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c500ffd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.363168:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c500fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e842e expref: 34 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.363214:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c500fd3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e842e expref: 34 pid: 5795 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015382.363232:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304390016:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015382.363342:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54e180 going to sleep for 11 seconds 00000100:00100000:2.0:1786015382.367000:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304390016:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015382.367042:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c500ffd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015382.368419:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015382.368507:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280435712 00000100:00100000:1.0:1786015382.368536:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280435712 00010000:00010000:1.0:1786015382.368600:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c500fd3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e842e expref: 35 pid: 5795 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015382.368736:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 275 00000100:00100000:1.0:1786015382.368751:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+35:2352:x1872772280435712:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015382.368823:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015382.368833:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c500fd3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e842e expref: 35 pid: 5795 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.368849:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c500fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e842e expref: 35 pid: 5795 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.368877:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c500fd3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e842e expref: 35 pid: 5795 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.368896:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5900) 00010000:00010000:1.0:1786015382.368902:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c500ffd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.368913:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c500ffd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.368922:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c500ffd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.368956:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015382.369032:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+34:2352:x1872772280435712:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 284us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015382.369054:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 275 00010000:00010000:0.0:1786015382.369219:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c500ffd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015382.369227:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c500ffd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015382.369254:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501004 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015382.369265:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501004 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015382.369273:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501004 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015382.370228:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3a:0x0]: returning size 512 00010000:00010000:0.0:1786015382.370247:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c500ffd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015382.370269:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c500ffd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015382.370276:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c500ffd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015382.370281:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015382.370285:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c500ffd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015382.370291:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c500ffd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015382.370302:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b74a04b5900) 00010000:00010000:0.0:1786015382.370304:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015382.370307:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c500ffd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015382.370311:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c500ffd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015382.370329:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fd4ade9b reply state 000000006927a4d8 transno 4294967889 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501004 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015382.370336:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015382.370411:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+87:25201:x1872772280435584:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 7598us (8105us total) trans 4294967889 rc 0/0 00000100:00100000:0.0:1786015382.370417:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 885 00010000:00010000:2.0:1786015382.377626:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501004 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.377655:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501004 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.377665:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501004 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.377672:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015382.377679:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501004 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.377688:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501004 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.377715:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0a77ca6 (ffff8b748f24a000) 00010000:00010000:2.0:1786015382.377719:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015382.377725:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501004 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.377732:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501004 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015382.380975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015382.381071:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280435840 00000100:00100000:1.0:1786015382.381086:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280435840 00000100:00100000:1.0:1786015382.381175:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 886 00000100:00100000:1.0:1786015382.381188:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+86:25202:x1872772280435840:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1786015382.381222:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015382.381224:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015382.381254:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c50100b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8443 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.381339:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501012 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.381356:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.381367:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015382.381450:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1786015382.381455:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015382.381488:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.381516:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c50100b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8443 expref: 88 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.381536:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501012 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8443 expref: 87 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.381581:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6200) 00010000:00010000:1.0:1786015382.381585:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015382.381590:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47000, rc 0) 00000100:00100000:1.0:1786015382.381667:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+87:25202:x1872772280435840:12345-192.168.202.56@tcp:101:bash.0 Request processed in 481us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015382.381675:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 886 00000100:00100000:1.0:1786015382.386053:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015382.386219:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280435968 00000100:00100000:2.0:1786015382.386232:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280435968 00000100:00100000:2.0:1786015382.386349:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 887 00000100:00100000:2.0:1786015382.386362:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+87:25202:x1872772280435968:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1786015382.386391:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015382.386418:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c501019 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e844a expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.386508:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501020 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.386526:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501020 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.386539:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501020 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.386556:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501027 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.386574:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.386581:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.386731:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c50102e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.386815:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c50102e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.386823:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c50102e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015382.386868:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3a:0x0]: returning size 512 00000004:00200000:2.0:1786015382.386873:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015382.386902:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c50102e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.386916:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501020 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.386923:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501020 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.386930:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501020 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.386936:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2179200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015382.386940:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501020 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.386947:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501020 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.386960:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6200) 00010000:00010000:2.0:1786015382.386964:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015382.386968:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501020 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.386986:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501020 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.386999:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.387006:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501027 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.387012:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501027 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.387016:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015382.387019:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501027 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.387025:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501027 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.387031:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0a77ca6 (ffff8b7499c59f00) 00010000:00010000:2.0:1786015382.387033:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015382.387035:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501027 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.387040:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501027 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.387074:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c501019 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e844a expref: 89 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.387098:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179600/0xb1a5ef690c50102e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e844a expref: 88 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.387106:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8b7499c59400) 00010000:00010000:2.0:1786015382.387108:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786015382.387110:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2179600, rc 0) 00000100:00100000:2.0:1786015382.387529:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+88:25202:x1872772280435968:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1169us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015382.387536:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 887 00000100:00100000:0.0:1786015382.389973:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015382.390059:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280436096 00000100:00100000:2.0:1786015382.390071:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280436096 00000100:00100000:2.0:1786015382.390138:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 888 00000100:00100000:2.0:1786015382.390149:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+88:25202:x1872772280436096:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1786015382.390180:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015382.390211:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501035 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8451 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390294:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50103c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390308:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50103c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390319:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50103c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390330:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501043 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390340:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390345:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390427:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50103c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390432:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50103c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390437:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50103c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390441:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015382.390444:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50103c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390450:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50103c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390460:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8b7499c59400) 00010000:00010000:2.0:1786015382.390462:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015382.390466:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50103c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390470:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50103c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390479:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390487:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501043 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390491:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501043 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390493:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bec00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015382.390495:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501043 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390498:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501043 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390502:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff8b7499c59900) 00010000:00010000:2.0:1786015382.390504:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015382.390505:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501043 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390508:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501043 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390539:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501035 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8451 expref: 89 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390546:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8b7499c59400) 00010000:00010000:2.0:1786015382.390547:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015382.390550:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501035 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8451 expref: 89 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.390581:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2178000, rc 0) 00000100:00100000:2.0:1786015382.390861:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+88:25202:x1872772280436096:12345-192.168.202.56@tcp:101:bash.0 Request processed in 711us (901us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015382.390870:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 888 00000100:00100000:1.0:1786015382.399425:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015382.399589:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280436224 00000100:00100000:3.0:1786015382.399603:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280436224 00000100:00100000:3.0:1786015382.399728:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 889 00000100:00100000:3.0:1786015382.399741:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+34:25203:x1872772280436224:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015382.399825:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015382.399855:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c50104a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8458 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.399951:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501051 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.399970:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501051 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.399984:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501051 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015382.400067:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1786015382.400071:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015382.400104:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501051 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.400145:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c50104a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8458 expref: 36 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.400191:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501051 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8458 expref: 35 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.400200:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6200) 00010000:00010000:3.0:1786015382.400203:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015382.400207:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc000, rc 0) 00000100:00100000:3.0:1786015382.400282:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+35:25203:x1872772280436224:12345-192.168.202.56@tcp:101:rm.0 Request processed in 544us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015382.400290:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 889 00000100:00100000:0.0:1786015382.402532:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015382.402638:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280436352 00000100:00100000:2.0:1786015382.402651:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280436352 00000100:00100000:2.0:1786015382.402721:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 890 00000100:00100000:2.0:1786015382.402732:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+35:25203:x1872772280436352:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015382.402858:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015382.402887:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501058 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e845f expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.402967:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50105f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.402980:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50105f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.402991:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50105f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.403002:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501066 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.403007:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501066 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.403011:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501066 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.403637:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50106d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.403888:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50106d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.403901:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50106d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015382.403948:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3a:0x0]: returning size 512 00000004:00200000:2.0:1786015382.403952:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015382.403984:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50106d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.403997:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50105f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.404003:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50105f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.404009:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50105f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.404015:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015382.404019:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50105f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.404028:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50105f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.404042:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6200) 00010000:00010000:2.0:1786015382.404058:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015382.404064:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50105f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.404070:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50105f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.404086:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501066 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.404091:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501066 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.404096:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501066 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.404101:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015382.404104:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501066 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.404110:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501066 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.404116:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0a77ca6 (ffff8b7499c59900) 00010000:00010000:2.0:1786015382.404118:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015382.404121:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501066 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.404127:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501066 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.404182:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501058 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e845f expref: 37 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.404211:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be200/0xb1a5ef690c50106d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e845f expref: 36 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.404220:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8b7499c59400) 00010000:00010000:2.0:1786015382.404222:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786015382.404225:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813be200, rc 0) 00000100:00100000:2.0:1786015382.404390:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+36:25203:x1872772280436352:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1658us (1868us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015382.404401:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 890 00000100:00100000:0.0:1786015382.407696:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015382.407798:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280436480 00000100:00100000:2.0:1786015382.407812:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280436480 00000100:00100000:2.0:1786015382.407901:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 891 00000100:00100000:2.0:1786015382.407916:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+36:25203:x1872772280436480:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015382.407949:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015382.407984:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501074 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8466 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408079:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50107b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408097:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50107b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408111:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50107b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408129:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501082 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408157:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501082 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408164:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501082 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408252:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50107b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408260:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50107b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408267:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50107b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408273:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015382.408278:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50107b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408286:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50107b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408301:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8b7499c59400) 00010000:00010000:2.0:1786015382.408304:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015382.408310:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50107b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408316:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50107b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408336:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501082 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408349:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501082 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408356:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501082 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408361:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015382.408365:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501082 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408371:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501082 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408380:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff8b7499c59f00) 00010000:00010000:2.0:1786015382.408383:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015382.408386:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501082 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408392:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c501082 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408438:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501074 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8466 expref: 37 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408450:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8b7499c59400) 00010000:00010000:2.0:1786015382.408452:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015382.408456:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501074 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8466 expref: 37 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.408480:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2178000, rc 0) 00000100:00100000:2.0:1786015382.408601:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+36:25203:x1872772280436480:12345-192.168.202.56@tcp:101:rm.0 Request processed in 688us (917us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015382.408610:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 891 00000100:00100000:1.0:1786015382.412602:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015382.413671:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280436608 00000100:00100000:3.0:1786015382.413697:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280436608 00000100:00100000:3.0:1786015382.414071:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 892 00000100:00100000:3.0:1786015382.414084:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+36:25203:x1872772280436608:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015382.414113:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015382.414142:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501089 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e846d expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414237:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501090 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414256:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501090 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414270:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501090 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414287:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501097 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414319:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414327:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414420:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501090 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414428:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501090 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414435:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501090 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414442:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015382.414447:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501090 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414456:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501090 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414470:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8b7499c59400) 00010000:00010000:3.0:1786015382.414474:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015382.414480:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501090 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414486:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501090 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414499:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414511:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501097 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414517:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501097 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414522:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015382.414525:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501097 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414531:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501097 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414538:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff8b74a04b5f00) 00010000:00010000:3.0:1786015382.414541:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015382.414543:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501097 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414549:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501097 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414605:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501089 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e846d expref: 37 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414617:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8b7499c59400) 00010000:00010000:3.0:1786015382.414619:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015382.414623:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501089 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e846d expref: 37 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.414657:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbde00, rc 0) 00000100:00100000:3.0:1786015382.414974:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+36:25203:x1872772280436608:12345-192.168.202.56@tcp:101:rm.0 Request processed in 890us (2385us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015382.414984:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 892 00000100:00100000:0.0:1786015382.428365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015382.428448:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280436736 00000100:00100000:2.0:1786015382.428463:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280436736 00000100:00100000:2.0:1786015382.428611:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 893 00000100:00100000:2.0:1786015382.428624:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+36:25204:x1872772280436736:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015382.428668:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015382.428939:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c50109e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8474 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429042:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5010a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429060:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5010a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429075:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5010a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429093:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5010ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429101:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5010ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429108:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5010ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429215:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5010a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429225:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5010a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429232:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5010a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429240:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015382.429245:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5010a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429254:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5010a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429267:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8b7499c59400) 00010000:00010000:2.0:1786015382.429270:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015382.429276:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5010a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429281:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5010a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429299:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5010ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429304:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5010ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429309:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5010ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429321:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015382.429323:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5010ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429329:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5010ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429336:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff8b7499c59f00) 00010000:00010000:2.0:1786015382.429339:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015382.429341:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5010ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429347:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5010ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429390:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c50109e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8474 expref: 37 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429400:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8b7499c59400) 00010000:00010000:2.0:1786015382.429403:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015382.429407:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c50109e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8474 expref: 37 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015382.429416:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2178000, rc 0) 00000100:00100000:2.0:1786015382.429501:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+36:25204:x1872772280436736:12345-192.168.202.56@tcp:101:cp.0 Request processed in 880us (1148us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015382.429511:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 893 00000100:00100000:0.0:1786015382.432712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015382.432828:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280436864 00000100:00100000:3.0:1786015382.432842:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280436864 00000100:00100000:3.0:1786015382.432914:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 894 00000100:00100000:3.0:1786015382.432927:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+36:25204:x1872772280436864:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015382.432954:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015382.432981:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5010b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e847b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433060:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5010ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433073:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5010ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433084:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5010ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433095:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5010c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433100:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5010c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433104:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5010c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433206:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5010ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433212:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5010ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433217:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5010ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433222:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015382.433225:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5010ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433231:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5010ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433242:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8b7499c59400) 00010000:00010000:3.0:1786015382.433245:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015382.433249:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5010ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433253:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5010ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433264:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5010c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433267:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5010c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433271:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5010c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433279:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015382.433281:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5010c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433285:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5010c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433289:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff8b74a04b5f00) 00010000:00010000:3.0:1786015382.433290:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015382.433292:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5010c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433295:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5010c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433326:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5010b3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e847b expref: 37 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433333:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8b7499c59400) 00010000:00010000:3.0:1786015382.433335:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015382.433337:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5010b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e847b expref: 37 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.433342:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbde00, rc 0) 00000100:00100000:3.0:1786015382.433406:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+36:25204:x1872772280436864:12345-192.168.202.56@tcp:101:cp.0 Request processed in 482us (711us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015382.433414:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 894 00000100:00100000:2.0:1786015382.437433:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015382.437531:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280437120 00000100:00100000:1.0:1786015382.437547:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280437120 00000100:00100000:1.0:1786015382.437660:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 895 00000100:00100000:1.0:1786015382.437672:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+36:25204:x1872772280437120:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015382.437701:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015382.437731:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c5010c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8482 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.437950:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c5010cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.437969:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c5010cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.437984:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c5010cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.437999:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5010d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.438014:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5010d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.438021:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5010d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786015382.439329:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x14:0x0], index 1: 0 00010000:00010000:1.0:1786015382.439575:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46a00/0xb1a5ef690c5010dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.439589:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46a00/0xb1a5ef690c5010dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.439600:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46a00/0xb1a5ef690c5010dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.439644:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c5010cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.439651:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c5010cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.439658:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c5010cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.439665:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015382.439670:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c5010cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.439677:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c5010cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.439703:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8b7499c59400) 00010000:00010000:1.0:1786015382.439706:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015382.439712:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c5010cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.439719:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c5010cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786015382.439733:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b9bad107 reply state 000000004f9a0e41 transno 4294967890 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5010d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015382.439744:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786015382.439811:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c5010c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8482 expref: 39 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.439827:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46a00/0xb1a5ef690c5010dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8482 expref: 38 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.439834:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8b7483ee6400) 00010000:00010000:1.0:1786015382.439836:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015382.439839:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46a00, rc 0) 00000100:00100000:1.0:1786015382.439940:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+39:25204:x1872772280437120:12345-192.168.202.56@tcp:101:cp.0 Request processed in 2269us (2522us total) trans 4294967890 rc 0/0 00000100:00100000:1.0:1786015382.439949:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 895 00000100:00100000:2.0:1786015382.443787:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015382.443985:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280437248 00000100:00100000:3.0:1786015382.444021:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280437248 00000100:00100000:3.0:1786015382.444092:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 220 00000100:00100000:3.0:1786015382.444102:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280437248:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015382.444127:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015382.444166:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5010eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8489 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015382.444202:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786015382.444230:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=617s v=(0 0) 00010000:00010000:3.0:1786015382.444235:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015382.444248:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5010eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8489 expref: 10 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.444269:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5010eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8489 expref: 10 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.444285:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbcc00, rc 0) 00000100:00100000:3.0:1786015382.444376:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280437248:12345-192.168.202.56@tcp:101:cp.0 Request processed in 274us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015382.444383:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 220 00010000:00010000:1.0:1786015382.445044:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5010d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.445056:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5010d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.445080:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5010d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.445086:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015382.445091:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5010d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.445099:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5010d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.445118:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff8b7483ee6500) 00010000:00010000:1.0:1786015382.445121:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015382.445126:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5010d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.445143:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5010d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015382.450693:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015382.450905:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280437376 00000100:00100000:3.0:1786015382.450919:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280437376 00000100:00100000:3.0:1786015382.450998:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 221 00000100:00100000:3.0:1786015382.451014:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:25204:x1872772280437376:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015382.451042:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015382.451069:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5010f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8490 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.451135:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5010eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8489 expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.451146:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015382.451151:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015382.451156:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5010f2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8490 expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.451203:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5010eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8489 expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.451220:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5010eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8489 expref: 11 pid: 6591 timeout: 717 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015382.451237:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8979f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304390144:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015382.451358:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015382.455209:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015382.455287:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280437504 00000100:00100000:1.0:1786015382.455298:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280437504 00010000:00010000:1.0:1786015382.455345:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5010eb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8489 expref: 12 pid: 6591 timeout: 717 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015382.455394:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 276 00000100:00100000:1.0:1786015382.455404:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280437504:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015382.455427:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015382.455461:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5010eb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8489 expref: 12 pid: 6591 timeout: 717 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.455497:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5010eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8489 expref: 12 pid: 6591 timeout: 717 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.455530:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015382.455534:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015382.455541:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5010f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8490 expref: 12 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.455550:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5010f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8490 expref: 12 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.455615:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5010f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8490 expref: 12 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015382.455633:0:5781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1872772304390272:192.168.202.56@tcp:105: 00010000:00010000:3.0:1786015382.456236:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5010eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8489 expref: 12 pid: 6591 timeout: 717 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015382.456257:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8979f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304390144:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015382.456291:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5010f2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8490 expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.456304:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbde00, rc 0) 00000100:00100000:2.0:1786015382.456437:0:5781:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74853d0540 going to sleep for 11 seconds 00000100:00100000:3.0:1786015382.456495:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:25204:x1872772280437376:12345-192.168.202.56@tcp:101:cp.0 Request processed in 5486us (5816us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015382.456506:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 221 00000100:00100000:0.0:1786015382.459312:0:5781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1872772304390272:192.168.202.56@tcp:105: 00010000:00010000:0.0:1786015382.459348:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015382.459432:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280437504:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 4029us (4237us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015382.459446:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 276 00000100:00100000:0.0:1786015382.463733:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015382.463899:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280437760 00000100:00100000:1.0:1786015382.463914:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280437760 00000100:00100000:1.0:1786015382.464006:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 184 00000100:00100000:1.0:1786015382.464019:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916b6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+38:25204:x1872772280437760:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:1.0:1786015382.464504:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916b6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+39:25204:x1872772280437760:12345-192.168.202.56@tcp:35:cp.0 Request processed in 486us (784us total) trans 4294967891 rc 0/0 00000100:00100000:1.0:1786015382.464512:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 184 00000100:00100000:2.0:1786015382.493711:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015382.493889:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280437888 00000100:00100000:3.0:1786015382.493906:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280437888 00000100:00100000:3.0:1786015382.493988:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 896 00000100:00100000:3.0:1786015382.494001:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+88:25207:x1872772280437888:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015382.494034:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015382.494065:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5010f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8497 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494161:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501100 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494179:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501100 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494193:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501100 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494211:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501107 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494219:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494226:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494365:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c50110e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494393:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c50110e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494401:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c50110e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015382.494451:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 158 00000004:00200000:3.0:1786015382.494457:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015382.494484:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c50110e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494500:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c50110e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494511:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501100 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494518:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501100 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494525:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501100 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494531:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015382.494537:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501100 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494545:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501100 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494571:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8b7499c59400) 00010000:00010000:3.0:1786015382.494581:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015382.494589:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501100 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494596:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501100 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494615:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494621:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501107 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494626:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501107 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494631:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015382.494634:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501107 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494640:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501107 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494648:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff8b74a04b5f00) 00010000:00010000:3.0:1786015382.494651:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015382.494654:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501107 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494660:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501107 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494699:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5010f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8497 expref: 90 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494724:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c50110e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8497 expref: 89 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.494733:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8b7483ee6400) 00010000:00010000:3.0:1786015382.494736:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015382.494738:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd200, rc 0) 00000100:00100000:3.0:1786015382.495055:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+89:25207:x1872772280437888:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1054us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015382.495065:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 896 00000100:00100000:2.0:1786015382.499320:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015382.499437:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280438016 00000100:00100000:1.0:1786015382.499452:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280438016 00000100:00100000:1.0:1786015382.499550:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 222 00000100:00100000:1.0:1786015382.499573:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+11:2352:x1872772280438016:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015382.499601:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015382.499627:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b223b20f/0xb1a5ef690c501115 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e849e expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015382.499729:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304390400:192.168.202.56@tcp:106: 00000100:00100000:1.0:1786015382.499871:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74853d0480 going to sleep for 11 seconds 00002000:00010000:3.0:1786015382.502617:0:11384:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb size: 0 -> 158 00002000:00010000:3.0:1786015382.502632:0:11384:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb mtime: 0 -> 1786015382 00002000:00010000:3.0:1786015382.502635:0:11384:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb atime: 0 -> 1786015382 00002000:00010000:3.0:1786015382.502638:0:11384:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb ctime: 0 -> 1786015382 00000100:00100000:3.0:1786015382.503260:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304390400:192.168.202.56@tcp:106: 00010000:00010000:3.0:1786015382.503311:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b223b20f/0xb1a5ef690c501115 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e849e expref: 12 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.503343:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b223b20f/0xb1a5ef690c501115 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e849e expref: 12 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.503359:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46800, rc 0) 00000100:00100000:3.0:1786015382.503537:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+11:2352:x1872772280438016:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3977us (4234us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015382.503548:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 222 00000100:00100000:2.0:1786015382.507500:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015382.507616:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280438144 00000100:00100000:1.0:1786015382.507631:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280438144 00000100:00100000:1.0:1786015382.508093:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 897 00000100:00100000:1.0:1786015382.508105:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+89:25207:x1872772280438144:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015382.508135:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015382.508163:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c50111c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e84a5 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.508248:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c501123 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.508264:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c501123 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.508277:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c501123 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015382.508352:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3a:0x0]: returning size 512 00000004:00200000:1.0:1786015382.508356:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015382.508378:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c501123 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.508427:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c50111c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84a5 expref: 91 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.508445:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47e00/0xb1a5ef690c501123 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84a5 expref: 90 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015382.508454:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8b7499c59400) 00010000:00010000:1.0:1786015382.508457:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015382.508461:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47e00, rc 0) 00000100:00100000:1.0:1786015382.508608:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+90:25207:x1872772280438144:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 504us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015382.508616:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 897 00000100:00100000:2.0:1786015382.512429:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015382.512547:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280438272 00000100:00100000:3.0:1786015382.512570:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280438272 00000100:00100000:3.0:1786015382.513032:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 223 00000100:00100000:3.0:1786015382.513047:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+11:2354:x1872772280438272:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015382.513075:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015382.513099:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c50112a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e84ac expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015382.513182:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8979f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304390528:192.168.202.56@tcp:106: 00000100:00100000:3.0:1786015382.513301:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015382.516028:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8979f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304390528:192.168.202.56@tcp:106: 00010000:00010000:3.0:1786015382.516081:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c50112a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84ac expref: 12 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.516113:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c50112a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84ac expref: 12 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015382.516130:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbcc00, rc 0) 00000100:00100000:3.0:1786015382.516214:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+11:2354:x1872772280438272:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3170us (3800us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015382.516223:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 223 00000100:00100000:2.0:1786015382.520930:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015382.521255:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280438528 00000100:00100000:0.0:1786015382.521271:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280438528 00000100:00100000:0.0:1786015382.521373:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:0.0:1786015382.521387:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+90:25207:x1872772280438528:12345-192.168.202.56@tcp:103:lfs.0 00010000:00010000:0.0:1786015382.521414:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015382.521451:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c50110e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8497 expref: 90 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015382.521476:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8b7483ee6400) 00010000:00010000:0.0:1786015382.521483:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015382.521577:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+89:25207:x1872772280438528:12345-192.168.202.56@tcp:103:lfs.0 Request processed in 192us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015382.521587:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:2.0:1786015382.527899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015382.528062:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280438656 00000100:00100000:1.0:1786015382.528076:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280438656 00000100:00100000:1.0:1786015382.528161:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 898 00000100:00100000:1.0:1786015382.528173:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+89:25207:x1872772280438656:12345-192.168.202.56@tcp:58:lfs.0 00000100:00100000:1.0:1786015382.528370:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+89:25207:x1872772280438656:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 196us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015382.528382:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 898 00000040:00080000:0.0:1786015383.020014:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015383.020026:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015383.020598:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1786015383.020610:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015383.219449:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304390656:0@lo:400:kworker.0 00000100:00100000:3.0:1786015383.219483:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304390784:0@lo:400:kworker.0 00000100:00100000:1.0:1786015383.219596:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015383.221139:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304390656 00000100:00100000:0.0:1786015383.221157:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304390656 00000100:00100000:0.0:1786015383.221230:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:0.0:1786015383.221241:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304390656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015383.221651:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015383.221730:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304391296:0@lo:400:kworker.0 00000100:00100000:3.0:1786015383.221799:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015383.222626:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786015383.222639:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304390912:0@lo:400:kworker.0 00000100:00100000:3.0:1786015383.222686:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015383.222755:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304391296 00000100:00100000:3.0:1786015383.222787:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304391296 00000100:00100000:3.0:1786015383.222847:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1786015383.223040:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304391040:0@lo:400:kworker.0 00000100:00100000:1.0:1786015383.223060:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304391168:0@lo:400:kworker.0 00000100:00100000:2.0:1786015383.223084:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015383.223139:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015383.223140:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304390784 00000100:00100000:2.0:1786015383.223146:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304390784 00000100:00100000:2.0:1786015383.223177:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304390912 00000100:00100000:2.0:1786015383.223180:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304390912 00000100:00100000:2.0:1786015383.223200:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1786015383.223206:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304390784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015383.223262:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304390784:12345-0@lo:400:kworker.0 Request processed in 55us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015383.223269:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1786015383.223284:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1786015383.223289:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304390912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015383.223316:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304390912:12345-0@lo:400:kworker.0 Request processed in 26us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015383.223322:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1786015383.223337:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304391168 00000100:00100000:2.0:1786015383.223340:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304391168 00000100:00100000:2.0:1786015383.223363:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1786015383.223370:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304391168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015383.223431:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304391168:12345-0@lo:400:kworker.0 Request processed in 62us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015383.223438:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1786015383.223509:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304391168:0@lo:400:kworker.0 00000100:00100000:3.0:1786015383.224773:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304391296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015383.224876:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304391296:12345-0@lo:400:kworker.0 Request processed in 2020us (3074us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015383.224886:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1786015383.224910:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304391040 00000100:00100000:3.0:1786015383.224916:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304391040 00000100:00100000:3.0:1786015383.224967:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1786015383.224974:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304391040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015383.225071:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304391040:12345-0@lo:400:kworker.0 Request processed in 97us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015383.225079:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1786015383.225080:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304390656:12345-0@lo:400:kworker.0 Request processed in 3840us (5485us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015383.225089:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00080000:3.0:1786015383.225110:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786015383.225115:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015383.225117:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015383.225136:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304390656:0@lo:400:kworker.0 00000100:00100000:3.0:1786015383.225172:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304390912:0@lo:400:kworker.0 00000100:00100000:3.0:1786015383.225187:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304390784:0@lo:400:kworker.0 00000100:00100000:3.0:1786015383.225196:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967349 gen 2 00000004:00080000:3.0:1786015383.225202:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b738394bb80, transno 4294967348 00000004:00080000:3.0:1786015383.225219:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b7383949c00, transno 4294967349 00000100:00100000:3.0:1786015383.225224:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304391296:0@lo:400:kworker.0 00000100:00100000:2.0:1786015383.227462:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304391040:0@lo:400:kworker.0 00000040:00080000:1.0:1786015383.378421:0:18260:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015383.378435:0:18260:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015383.379418:0:18260:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 22 count 3 00000040:00080000:1.0:1786015383.379431:0:18260:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015383.413245:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015383.467315:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015383.467418:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280438784 00000100:00100000:1.0:1786015383.467431:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280438784 00000100:00100000:1.0:1786015383.467501:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 899 00000100:00100000:1.0:1786015383.467511:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+89:25218:x1872772280438784:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015383.467540:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015383.467583:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c501131 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e84b3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.469165:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47200/0xb1a5ef690c501138 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.469193:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47200/0xb1a5ef690c501138 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.469207:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47200/0xb1a5ef690c501138 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.469224:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50113f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.469231:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50113f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.469237:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50113f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.469605:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501146 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.469616:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501146 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.469624:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501146 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015383.469916:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 158 00000004:00200000:1.0:1786015383.469923:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015383.469950:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501146 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.469965:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501146 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.469975:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47200/0xb1a5ef690c501138 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.469982:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47200/0xb1a5ef690c501138 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.469990:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47200/0xb1a5ef690c501138 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.469997:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015383.470002:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47200/0xb1a5ef690c501138 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.470010:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47200/0xb1a5ef690c501138 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.470034:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8b7499c59400) 00010000:00010000:1.0:1786015383.470038:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015383.470043:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47200/0xb1a5ef690c501138 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.470050:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47200/0xb1a5ef690c501138 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.470064:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50113f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.470071:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50113f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.470076:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50113f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.470081:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015383.470084:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50113f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.470089:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50113f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.470097:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff8b7483ee6500) 00010000:00010000:1.0:1786015383.470099:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015383.470102:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50113f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.470107:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50113f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.470166:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c501131 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84b3 expref: 91 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.470182:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501146 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84b3 expref: 90 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015383.470190:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8b7483ee6400) 00010000:00010000:1.0:1786015383.470192:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015383.470195:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47600, rc 0) 00000100:00100000:1.0:1786015383.470298:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+90:25218:x1872772280438784:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 2786us (2998us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015383.470309:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 899 00000100:00100000:1.0:1786015383.476007:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015383.476161:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280438912 00000100:00100000:3.0:1786015383.476183:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280438912 00000100:00100000:3.0:1786015383.476276:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 224 00000100:00100000:3.0:1786015383.476288:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+11:2354:x1872772280438912:12345-192.168.202.56@tcp:101:lfs.0 00000100:00080000:0.0:1786015383.476310:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786015383.476319:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015383.476344:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000135410ea/0xb1a5ef690c50114d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e84ba expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015383.476441:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304391424:192.168.202.56@tcp:106: 00000100:00100000:3.0:1786015383.477192:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015383.480203:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304391424:192.168.202.56@tcp:106: 00010000:00010000:3.0:1786015383.480254:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000135410ea/0xb1a5ef690c50114d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84ba expref: 12 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015383.480287:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000135410ea/0xb1a5ef690c50114d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84ba expref: 12 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015383.480302:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd000, rc 0) 00000100:00100000:3.0:1786015383.480477:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+11:2354:x1872772280438912:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 4190us (4486us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015383.480489:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 224 00000100:00100000:3.0:1786015383.486683:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015383.486823:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280439040 00000100:00100000:0.0:1786015383.486838:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280439040 00000100:00100000:0.0:1786015383.486912:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 225 00000100:00100000:0.0:1786015383.486923:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+11:2353:x1872772280439040:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015383.486946:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015383.486971:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000053ed007/0xb1a5ef690c501154 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e84c1 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015383.487053:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304391552:192.168.202.56@tcp:106: 00000100:00100000:0.0:1786015383.487152:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74ac59cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1786015383.498638:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304391552:192.168.202.56@tcp:106: 00010000:00010000:3.0:1786015383.498697:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000053ed007/0xb1a5ef690c501154 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84c1 expref: 12 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015383.498746:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000053ed007/0xb1a5ef690c501154 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84c1 expref: 12 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015383.498792:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afcc00, rc 0) 00000100:00100000:3.0:1786015383.498884:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+11:2353:x1872772280439040:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 11962us (12216us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015383.498894:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 225 00000100:00100000:1.0:1786015383.514152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015383.514255:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280439296 00000100:00100000:0.0:1786015383.514270:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280439296 00000100:00100000:0.0:1786015383.514358:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 900 00000100:00100000:0.0:1786015383.514370:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+90:25218:x1872772280439296:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:0.0:1786015383.515051:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].22, 136 off11184 00000100:00100000:0.0:1786015383.515177:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+90:25218:x1872772280439296:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 807us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015383.515192:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 900 00000100:00100000:0.0:1786015383.724616:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786015383.724649:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304391680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015383.724786:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015383.724870:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304391680 00000100:00100000:0.0:1786015383.724881:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304391680 00000100:00100000:0.0:1786015383.724938:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1786015383.724947:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304391680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015383.724995:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 69664768 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015383.725048:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304391680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015383.725056:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1786015383.725128:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304391680:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1786015383.828473:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967889 is committed 00000004:00080000:3.0:1786015383.828492:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1786015383.828514:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:3.0:1786015383.828949:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304391808:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786015383.829061:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015383.829226:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304391808 00000100:00100000:2.0:1786015383.829238:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304391808 00000100:00100000:2.0:1786015383.829308:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1786015383.829319:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304391808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1786015383.829358:0:11384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:17 count 1 00010000:00010000:2.0:1786015383.829392:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316048d8/0xb1a5ef690c50115b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015383.829421:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f23b128/0xb1a5ef690c500f47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e840b expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015383.829432:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=10s v=(0 0) 00010000:00010000:2.0:1786015383.829437:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015383.829442:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000316048d8/0xb1a5ef690c50115b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015383.829477:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f23b128/0xb1a5ef690c500f47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e840b expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015383.829495:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f23b128/0xb1a5ef690c500f47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e840b expref: 11 pid: 6590 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015383.829531:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304391936:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015383.829621:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7381ffb780 going to sleep for 11 seconds 00000001:00080000:3.0:1786015383.830210:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967891 is committed 00000020:00080000:3.0:1786015383.830240:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 14 batchid updated 00000020:00080000:2.0:1786015383.830296:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 14 00000020:00080000:2.0:1786015383.830310:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 14 00000100:00100000:0.0:1786015383.836323:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015383.836407:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280439424 00000100:00100000:3.0:1786015383.836420:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280439424 00010000:00010000:3.0:1786015383.836500:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f23b128/0xb1a5ef690c500f47 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e840b expref: 12 pid: 6590 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015383.836561:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 277 00000100:00100000:3.0:1786015383.836574:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280439424:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015383.836593:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015383.836600:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f23b128/0xb1a5ef690c500f47 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e840b expref: 12 pid: 6590 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015383.836643:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f23b128/0xb1a5ef690c500f47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e840b expref: 12 pid: 6590 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015383.836699:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015383.836706:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015383.836714:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000316048d8/0xb1a5ef690c50115b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015383.836726:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000316048d8/0xb1a5ef690c50115b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015383.836755:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015383.836861:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280439424:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 289us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015383.836870:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 277 00000100:00080000:0.0:1786015383.837299:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786015383.845566:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f23b128/0xb1a5ef690c500f47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e840b expref: 11 pid: 6590 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015383.845602:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304391936:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015383.845641:0:11384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000316048d8/0xb1a5ef690c50115b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015383.846429:0:11384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000316048d8/0xb1a5ef690c50115b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015383.846444:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000316048d8/0xb1a5ef690c50115b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015383.846459:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316048d8/0xb1a5ef690c50115b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015383.846469:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000316048d8/0xb1a5ef690c50115b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015383.846504:0:11384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786015383.847407:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304391808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18085us (18341us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1786015383.847421:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00010000:00010000:0.0:1786015383.847797:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786015383.847808:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000316048d8/0xb1a5ef690c50115b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015383.847822:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2179200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015383.847827:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000316048d8/0xb1a5ef690c50115b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015383.847840:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000316048d8/0xb1a5ef690c50115b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015383.847881:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000316048d8/0xb1a5ef690c50115b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015383.847889:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000316048d8/0xb1a5ef690c50115b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015383.847918:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015383.847920:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015383.847922:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786015383.851311:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b74aa9ad880/2, rc 0, transno 4294967341 00000100:00100000:3.0:1786015383.853122:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304391808:0@lo:6:osp-syn-0-0.0 00000040:00080000:0.0:1786015384.045113:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015384.045124:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015384.045539:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 23 count 2 00000040:00080000:0.0:1786015384.045579:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015384.045897:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304392064:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786015384.046004:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7491f64300 going to sleep for 11 seconds 00000100:00100000:1.0:1786015384.069865:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304392064:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015384.097390:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015384.097488:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280439552 00000100:00100000:1.0:1786015384.097505:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280439552 00000100:00100000:1.0:1786015384.097613:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 901 00000100:00100000:1.0:1786015384.097627:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+37:25228:x1872772280439552:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000100:00080000:3.0:1786015384.097723:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:1.0:1786015384.097752:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x17:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786015384.097921:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+37:25228:x1872772280439552:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 298us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015384.097930:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 901 00000100:00100000:0.0:1786015384.109606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015384.110573:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280439808 00000100:00100000:3.0:1786015384.110586:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280439808 00000100:00100000:3.0:1786015384.110665:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 902 00000100:00100000:3.0:1786015384.110682:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+37:25228:x1872772280439808:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015384.110704:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015384.110738:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501162 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e84c8 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.110920:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501169 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.110937:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.110951:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015384.110965:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 158 00010000:00010000:3.0:1786015384.111154:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501162 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84c8 expref: 40 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.111176:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501169 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84c8 expref: 39 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.111187:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8b7483ee6400) 00010000:00010000:3.0:1786015384.111197:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015384.111201:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbdc00, rc 0) 00000100:00100000:3.0:1786015384.111271:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+39:25228:x1872772280439808:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 596us (1672us total) trans 4294967892 rc 0/0 00000100:00100000:3.0:1786015384.111278:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 902 00000100:00100000:3.0:1786015384.118331:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015384.118384:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015384.118433:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280440064 00000100:00100000:3.0:1786015384.118444:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280440064 00000100:00100000:3.0:1786015384.118516:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 227 00000100:00100000:3.0:1786015384.118528:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2352:x1872772280440064:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015384.118608:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fd4e14c8/0xb1a5ef690c501177 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.118631:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5010f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8490 expref: 10 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.118639:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x14:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1786015384.118644:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015384.118648:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd4e14c8/0xb1a5ef690c501177 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.118687:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5010f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8490 expref: 10 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.118702:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5010f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8490 expref: 10 pid: 6592 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015384.118718:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304392192:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015384.119065:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54e300 going to sleep for 11 seconds 00000100:00080000:3.0:1786015384.119083:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015384.119649:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280439936 00000100:00100000:1.0:1786015384.119657:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280439936 00000100:00100000:1.0:1786015384.119711:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:1.0:1786015384.119718:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74865aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+39:2353:x1872772280439936:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015384.119735:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015384.119757:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501169 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84c8 expref: 39 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015384.119799:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8b7483ee6400) 00010000:00010000:1.0:1786015384.119804:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015384.119848:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74865aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+38:2353:x1872772280439936:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 130us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015384.119857:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:3.0:1786015384.140508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015384.140551:0:17970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280440192 00000100:00100000:3.0:1786015384.140561:0:17970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280440192 00002000:00100000:3.0:1786015384.140616:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x14:0x0] (0->157) req@ffff8b74aeba1500 x1872772280440192/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:230/0 lens 648/0 e 0 to 0 dl 1786015395 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015384.140627:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aeba1500 with x1872772280440192 ext(0->157) 00010000:00010000:3.0:1786015384.140661:0:17970:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5010f2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8490 expref: 11 pid: 6592 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.140677:0:17970:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5010f2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8490 expref: 11 pid: 6592 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015384.140686:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b74aeba1500 00000100:00100000:3.0:1786015384.140717:0:17970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:3.0:1786015384.140733:0:17970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280440192:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:3.0:1786015384.141341:0:17970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280440192:12345-192.168.202.56@tcp:4:cp.0 Request processed in 612us (840us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1786015384.141351:0:17970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00002000:00100000:3.0:1786015384.141360:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x14:0x0] (0->157) req@ffff8b74aeba1500 x1872772280440192/t4294967350(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:230/0 lens 648/448 e 0 to 0 dl 1786015395 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015384.141368:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aeba1500 with x1872772280440192 ext(0->157) 00010000:00010000:3.0:1786015384.141375:0:17970:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5010f2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8490 expref: 13 pid: 6592 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.141389:0:17970:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5010f2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8490 expref: 13 pid: 6592 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015384.141396:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b74aeba1500 00000100:00100000:1.0:1786015384.143843:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304392192:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015384.143876:0:14547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd4e14c8/0xb1a5ef690c501177 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015384.152208:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015384.152294:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280440320 00000100:00100000:1.0:1786015384.152304:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280440320 00010000:00010000:1.0:1786015384.152350:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5010f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8490 expref: 13 pid: 6592 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015384.152395:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 278 00000100:00100000:1.0:1786015384.152404:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280440320:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015384.152419:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015384.152442:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5010f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8490 expref: 13 pid: 6592 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015384.152475:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5010f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8490 expref: 13 pid: 6592 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015384.152500:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5010f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8490 expref: 13 pid: 6592 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015384.152519:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015384.152524:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015384.152531:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd4e14c8/0xb1a5ef690c501177 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015384.152549:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd4e14c8/0xb1a5ef690c501177 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015384.152587:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015384.152658:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280440320:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 254us (461us total) trans 0 rc 0/0 00010000:00010000:2.0:1786015384.152660:0:14547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd4e14c8/0xb1a5ef690c501177 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015384.152666:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 278 00010000:00010000:2.0:1786015384.152669:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd4e14c8/0xb1a5ef690c501177 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015384.152698:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fd4e14c8/0xb1a5ef690c501177 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015384.152707:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd4e14c8/0xb1a5ef690c501177 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015384.152716:0:14547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd4e14c8/0xb1a5ef690c501177 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015384.152722:0:14547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbda00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015384.152727:0:14547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd4e14c8/0xb1a5ef690c501177 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015384.152736:0:14547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd4e14c8/0xb1a5ef690c501177 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015384.152748:0:14547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd4e14c8/0xb1a5ef690c501177 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015384.152793:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd4e14c8/0xb1a5ef690c501177 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015384.152846:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280440064:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 34321us (34461us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015384.152854:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 227 00000100:00100000:3.0:1786015384.165061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015384.165185:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280440576 00000100:00100000:0.0:1786015384.165196:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280440576 00000100:00100000:0.0:1786015384.165268:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 903 00000100:00100000:0.0:1786015384.165280:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+38:25228:x1872772280440576:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015384.165397:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+38:25228:x1872772280440576:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 120us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015384.165405:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 903 00000100:00100000:3.0:1786015384.177614:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015384.177656:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280440704 00000100:00100000:3.0:1786015384.177671:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280440704 00000100:00100000:3.0:1786015384.177723:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 228 00000100:00100000:3.0:1786015384.177735:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280440704:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015384.177755:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015384.177888:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000135410ea/0xb1a5ef690c50117e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e84cf expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015384.177920:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 158, mtime: 0x6a746e96, atime: 0x0, ctime: 0x6a746e96, blocks: 0x1 00010000:00010000:3.0:1786015384.177945:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=619s v=(0 0) 00010000:00010000:3.0:1786015384.177951:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015384.177961:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000135410ea/0xb1a5ef690c50117e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84cf expref: 12 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.177978:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000135410ea/0xb1a5ef690c50117e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84cf expref: 12 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.177991:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd000, rc 0) 00000100:00100000:3.0:1786015384.178062:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280440704:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 329us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015384.178069:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 228 00000100:00100000:3.0:1786015384.183572:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015384.183621:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280440960 00000100:00100000:3.0:1786015384.183631:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280440960 00000100:00100000:3.0:1786015384.183687:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 904 00000100:00100000:3.0:1786015384.183696:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+38:25228:x1872772280440960:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786015384.183833:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+38:25228:x1872772280440960:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 137us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015384.183851:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 904 00000100:00100000:1.0:1786015384.196127:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015384.200853:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280441088 00000100:00100000:2.0:1786015384.200871:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280441088 00002000:00100000:2.0:1786015384.200940:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x14:0x0] (0->4095) req@ffff8b73824f7800 x1872772280441088/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:230/0 lens 488/0 e 0 to 0 dl 1786015395 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015384.200951:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b73824f7800 with x1872772280441088 ext(0->4095) 00002000:00010000:2.0:1786015384.200958:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b73824f7800 00000100:00100000:2.0:1786015384.201001:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 86 00000100:00100000:2.0:1786015384.201010:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280441088:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1786015384.201267:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280441088:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 257us (5150us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786015384.201276:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 86 00002000:00100000:2.0:1786015384.201283:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x14:0x0] (0->4095) req@ffff8b73824f7800 x1872772280441088/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:230/0 lens 488/4536 e 0 to 0 dl 1786015395 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015384.201292:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b73824f7800 with x1872772280441088 ext(0->4095) 00002000:00010000:2.0:1786015384.201295:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b73824f7800 00000100:00100000:1.0:1786015384.210411:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015384.211803:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280441216 00000100:00100000:3.0:1786015384.211818:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280441216 00000100:00100000:3.0:1786015384.211896:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 905 00000100:00100000:3.0:1786015384.211908:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+38:25228:x1872772280441216:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015384.211932:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015384.211956:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501185 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e84d6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.211992:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50118c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.212007:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50118c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.212019:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50118c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.212336:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501185 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84d6 expref: 40 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.212354:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50118c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84d6 expref: 39 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.212362:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8b7483ee6400) 00010000:00010000:3.0:1786015384.212365:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786015384.212369:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd600, rc 0) 00000100:00100000:3.0:1786015384.212439:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+39:25228:x1872772280441216:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 534us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015384.212452:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 905 00000100:00100000:1.0:1786015384.222506:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015384.222555:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280441344 00000100:00100000:1.0:1786015384.222565:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280441344 00000100:00100000:1.0:1786015384.222616:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 906 00000100:00100000:1.0:1786015384.222627:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+39:25228:x1872772280441344:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786015384.222672:0:7673:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x17:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786015384.224981:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+39:25228:x1872772280441344:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 2343us (2471us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015384.224994:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 906 00000100:00100000:1.0:1786015384.247522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015384.247601:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280441472 00000100:00100000:3.0:1786015384.247615:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280441472 00000100:00100000:3.0:1786015384.247696:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 229 00000100:00100000:3.0:1786015384.247707:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280441472:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015384.247787:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009db89b9b/0xb1a5ef690c501193 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.247807:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015384.247811:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015384.247819:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009db89b9b/0xb1a5ef690c501193 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.247833:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009db89b9b/0xb1a5ef690c501193 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.247867:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009db89b9b/0xb1a5ef690c501193 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.247876:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009db89b9b/0xb1a5ef690c501193 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.247885:0:11384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009db89b9b/0xb1a5ef690c501193 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.247893:0:11384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd400 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015384.247911:0:11384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009db89b9b/0xb1a5ef690c501193 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.247921:0:11384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009db89b9b/0xb1a5ef690c501193 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.247938:0:11384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009db89b9b/0xb1a5ef690c501193 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.247947:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009db89b9b/0xb1a5ef690c501193 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015384.248040:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280441472:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 333us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015384.248051:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 229 00000100:00100000:0.0:1786015384.268599:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015384.269489:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280441728 00000100:00100000:3.0:1786015384.269501:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280441728 00000100:00100000:3.0:1786015384.269671:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 907 00000100:00100000:3.0:1786015384.269684:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+39:25228:x1872772280441728:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786015384.269781:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c50119a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.269799:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50118c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84d6 expref: 39 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.269808:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c50119a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.269858:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50118c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84d6 expref: 39 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015384.269872:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50118c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84d6 expref: 39 pid: 5794 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015384.269888:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304392320:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015384.269984:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54e180 going to sleep for 11 seconds 00000100:00100000:0.0:1786015384.283068:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015384.283109:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280441856 00000100:00100000:0.0:1786015384.283119:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280441856 00010000:00010000:0.0:1786015384.283159:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50118c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84d6 expref: 40 pid: 5794 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015384.283198:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 279 00000100:00100000:0.0:1786015384.283208:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+40:2353:x1872772280441856:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015384.283226:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015384.283234:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50118c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84d6 expref: 40 pid: 5794 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015384.283249:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50118c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84d6 expref: 40 pid: 5794 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015384.283273:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8b7483ee6400) 00010000:00010000:0.0:1786015384.283278:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c50119a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015384.283289:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c50119a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015384.283297:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c50119a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015384.283316:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015384.283365:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+40:2353:x1872772280441856:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 159us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015384.283372:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 279 00010000:00010000:2.0:1786015384.285004:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50118c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84d6 expref: 39 pid: 5794 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015384.285038:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304392320:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015384.285060:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c50119a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015384.285070:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c50119a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015384.285076:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c50119a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015384.285274:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c50119a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015384.285282:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c50119a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015384.285288:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c50119a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015384.285293:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015384.285297:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c50119a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015384.285305:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c50119a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015384.285319:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8b7483ee6400) 00010000:00010000:2.0:1786015384.285322:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015384.285326:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c50119a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015384.285337:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c50119a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015384.292935:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+39:25228:x1872772280441728:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 23243us (24336us total) trans 4294967893 rc 0/0 00000100:00100000:2.0:1786015384.292949:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 907 00000040:00080000:1.0:1786015384.293671:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015384.293679:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015384.294699:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1786015384.294712:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015384.298669:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015384.298869:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280442112 00000100:00100000:1.0:1786015384.298880:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280442112 00000100:00100000:1.0:1786015384.298951:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 185 00000100:00100000:1.0:1786015384.298962:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+39:25228:x1872772280442112:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015384.299200:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+40:25228:x1872772280442112:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 239us (537us total) trans 4294967894 rc 0/0 00000100:00100000:1.0:1786015384.299208:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 185 00010000:00010000:1.0:1786015384.427897:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015384.524671:0:18313:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015384.524681:0:18313:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015384.524713:0:18313:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 23 count 2 00000040:00080000:1.0:1786015384.524720:0:18313:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015384.636660:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015384.637094:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280442240 00000100:00100000:0.0:1786015384.637104:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280442240 00000100:00100000:0.0:1786015384.637168:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 230 00000100:00100000:0.0:1786015384.637178:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+11:2351:x1872772280442240:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015384.637197:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015384.637215:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d547258/0xb1a5ef690c5011a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e84dd expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015384.637239:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015384.637243:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015384.637252:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d547258/0xb1a5ef690c5011a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84dd expref: 12 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015384.637268:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005d547258/0xb1a5ef690c5011a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84dd expref: 12 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015384.637281:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc800, rc 0) 00000100:00100000:0.0:1786015384.637335:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2351:x1872772280442240:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 159us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015384.637341:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 230 00000100:00100000:0.0:1786015384.644284:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015384.644369:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280442496 00000100:00100000:1.0:1786015384.644380:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280442496 00000100:00100000:1.0:1786015384.644468:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 37 00000100:00100000:1.0:1786015384.644478:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+83:25229:x1872772280442496:12345-192.168.202.56@tcp:103:lfs.0 00010000:00010000:1.0:1786015384.644505:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015384.644546:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501146 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84b3 expref: 83 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015384.644566:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8b7483ee6400) 00010000:00010000:1.0:1786015384.644571:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015384.644639:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+82:25229:x1872772280442496:12345-192.168.202.56@tcp:103:lfs.0 Request processed in 151us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015384.644647:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 37 00000100:00080000:0.0:1786015384.645070:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015384.647450:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015384.647545:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280442624 00000100:00100000:1.0:1786015384.647557:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280442624 00000100:00100000:1.0:1786015384.647624:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 908 00000100:00100000:1.0:1786015384.647644:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+82:25229:x1872772280442624:12345-192.168.202.56@tcp:58:lfs.0 00000100:00100000:1.0:1786015384.647822:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+82:25229:x1872772280442624:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 189us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015384.647830:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 908 00000040:00080000:1.0:1786015385.325096:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015385.325108:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015385.325600:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1786015385.325615:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015385.454925:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015385.592461:0:18364:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015385.592472:0:18364:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015385.592510:0:18364:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 23 count 2 00000040:00080000:1.0:1786015385.592518:0:18364:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015386.476049:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015386.692555:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015386.692913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015386.692948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015386.693302:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015386.693333:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015386.693356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015386.693392:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015386.693428:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280443136 00000100:00100000:3.0:1786015386.693438:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280443136 00000100:00100000:3.0:1786015386.693495:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280443392 00000100:00100000:3.0:1786015386.693499:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280443392 00000100:00100000:3.0:1786015386.693514:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280443008 00000100:00100000:3.0:1786015386.693529:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280443008 00000100:00100000:3.0:1786015386.693544:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280443520 00000100:00100000:3.0:1786015386.693547:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280443520 00000100:00100000:3.0:1786015386.693566:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 359 00000100:00100000:3.0:1786015386.693575:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280443136:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015386.694098:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280442880 00000100:00100000:0.0:1786015386.694105:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280442880 00000100:00100000:0.0:1786015386.694151:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280443264 00000100:00100000:0.0:1786015386.694154:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280443264 00000100:00100000:0.0:1786015386.694179:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 389 00000100:00100000:0.0:1786015386.694187:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+82:2353:x1872772280442880:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015386.694250:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+82:2353:x1872772280442880:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 63us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015386.694257:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 389 00000100:00100000:0.0:1786015386.694275:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 390 00000100:00100000:0.0:1786015386.694282:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+40:2353:x1872772280443264:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015386.694312:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+40:2353:x1872772280443264:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015386.694317:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 390 00000100:00100000:3.0:1786015386.695530:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280443136:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 1938us (2906us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015386.695552:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 359 00000100:00100000:3.0:1786015386.695581:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 360 00000100:00100000:3.0:1786015386.695591:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280443392:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015386.695646:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280443392:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 57us (2697us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015386.695653:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 360 00000100:00100000:3.0:1786015386.695667:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 361 00000100:00100000:3.0:1786015386.695675:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+11:2353:x1872772280443008:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015386.695720:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+11:2353:x1872772280443008:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 46us (2387us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015386.695726:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 361 00000100:00100000:3.0:1786015386.695739:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 362 00000100:00100000:3.0:1786015386.695746:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280443520:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015386.696312:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280443520:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 564us (2917us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015386.696320:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 362 00000100:00100000:3.0:1786015386.696353:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280442752 00000100:00100000:3.0:1786015386.696359:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280442752 00000100:00100000:3.0:1786015386.696396:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 557 00000100:00100000:3.0:1786015386.696403:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280442752:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015386.696428:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280442752:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (3277us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015386.696434:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 557 00000100:00080000:3.0:1786015386.696483:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015386.696488:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786015386.696491:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015386.797937:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304392448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015386.798022:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015386.798131:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304392448 00000100:00100000:1.0:1786015386.798140:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304392448 00000100:00100000:1.0:1786015386.798213:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1786015386.798221:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304392448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015386.798256:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 73203712 pending 0 free 3852468224 avail 3850371072 00000100:00100000:1.0:1786015386.798298:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304392448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015386.798305:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1786015386.798324:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015386.798367:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304392448:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786015387.505065:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015388.332338:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304392704:0@lo:400:kworker.0 00000100:00100000:3.0:1786015388.332415:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015388.332484:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304393216:0@lo:400:kworker.0 00000100:00100000:3.0:1786015388.332520:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015388.332558:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786015388.332564:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304392576:0@lo:400:kworker.0 00000100:00100000:3.0:1786015388.332604:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015388.332627:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304393088:0@lo:400:kworker.0 00000100:00100000:3.0:1786015388.332650:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015388.332683:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304393216 00000100:00100000:3.0:1786015388.332692:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304393216 00000100:00100000:3.0:1786015388.332784:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1786015388.332796:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304393216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015388.332853:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304393216:12345-0@lo:400:kworker.0 Request processed in 59us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015388.332861:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1786015388.332884:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304392576 00000100:00100000:3.0:1786015388.332888:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304392576 00000100:00100000:3.0:1786015388.332911:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1786015388.332917:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304392576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015388.332948:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304392576:12345-0@lo:400:kworker.0 Request processed in 31us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015388.332954:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1786015388.333300:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304392704 00000100:00100000:3.0:1786015388.333335:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304392704 00000100:00100000:3.0:1786015388.333369:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304393088 00000100:00100000:3.0:1786015388.333373:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304393088 00000100:00100000:3.0:1786015388.333402:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1786015388.333409:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304392704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015388.333449:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304392704:12345-0@lo:400:kworker.0 Request processed in 41us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015388.333456:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1786015388.333470:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1786015388.333476:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304393088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015388.333515:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304393088:12345-0@lo:400:kworker.0 Request processed in 39us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015388.333521:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1786015388.333579:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304392576:0@lo:400:kworker.0 00000100:00100000:3.0:1786015388.334065:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304393088:0@lo:400:kworker.0 00000100:00100000:3.0:1786015388.334082:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304392704:0@lo:400:kworker.0 00000100:00100000:3.0:1786015388.334093:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304393216:0@lo:400:kworker.0 00000100:00100000:1.0:1786015388.334211:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304392832:0@lo:400:kworker.0 00000100:00100000:1.0:1786015388.334253:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015388.334286:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015388.334292:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304392960:0@lo:400:kworker.0 00000100:00100000:1.0:1786015388.334316:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786015388.334368:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015388.334373:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015388.334534:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304392960 00000100:00100000:0.0:1786015388.334540:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304392960 00000100:00100000:0.0:1786015388.334601:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1786015388.334612:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304392960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015388.334657:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304392960:12345-0@lo:400:kworker.0 Request processed in 49us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015388.334664:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1786015388.334889:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304392832 00000100:00100000:3.0:1786015388.334894:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304392832 00000100:00080000:1.0:1786015388.334987:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015388.334990:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015388.335014:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304392960:0@lo:400:kworker.0 00000100:00100000:3.0:1786015388.335119:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1786015388.335128:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304392832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015388.335183:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304392832:12345-0@lo:400:kworker.0 Request processed in 56us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015388.335190:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1786015388.335245:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304392832:0@lo:400:kworker.0 00010000:00010000:1.0:1786015388.524098:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015388.852931:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304393344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015388.853017:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015388.853326:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304393344 00000100:00100000:0.0:1786015388.853335:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304393344 00000100:00100000:0.0:1786015388.853386:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1786015388.853396:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304393344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015388.853431:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 73072640 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015388.853490:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304393344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015388.853512:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1786015388.853582:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304393344:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1786015388.959660:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967894 is committed 00000001:00080000:0.0:1786015388.959855:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967350 is committed 00000001:00080000:0.0:1786015388.960927:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967341 is committed 00010000:00010000:0.0:1786015389.548748:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015390.572125:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015391.596958:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015391.815021:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015391.815071:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015391.815112:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015391.815139:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015391.815156:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015391.815191:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015391.815214:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015391.815245:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280444160 00000100:00100000:1.0:1786015391.815254:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280444160 00000100:00100000:1.0:1786015391.815308:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280443776 00000100:00100000:1.0:1786015391.815312:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280443776 00000100:00100000:1.0:1786015391.815336:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 394 00000100:00100000:1.0:1786015391.815346:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2352:x1872772280444160:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015391.815433:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2352:x1872772280444160:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 88us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015391.815440:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 394 00000100:00100000:1.0:1786015391.815457:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 395 00000100:00100000:1.0:1786015391.815464:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+82:2352:x1872772280443776:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015391.815501:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+82:2352:x1872772280443776:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 37us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015391.815507:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 395 00000100:00100000:1.0:1786015391.815526:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280443904 00000100:00100000:1.0:1786015391.815529:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280443904 00000100:00100000:1.0:1786015391.815552:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280444416 00000100:00100000:1.0:1786015391.815555:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280444416 00000100:00100000:1.0:1786015391.815567:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280444032 00000100:00100000:1.0:1786015391.815569:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280444032 00000100:00100000:1.0:1786015391.815580:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280444288 00000100:00100000:1.0:1786015391.815583:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280444288 00000100:00100000:1.0:1786015391.815596:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 365 00000100:00100000:1.0:1786015391.815603:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+11:2352:x1872772280443904:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015391.815629:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+11:2352:x1872772280443904:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015391.815643:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 365 00000100:00100000:1.0:1786015391.815656:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 366 00000100:00100000:1.0:1786015391.815662:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2352:x1872772280444416:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015391.815704:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2352:x1872772280444416:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 42us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015391.815710:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 366 00000100:00100000:1.0:1786015391.815722:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 367 00000100:00100000:1.0:1786015391.815728:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280444032:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015391.815751:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280444032:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015391.815757:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 367 00000100:00100000:1.0:1786015391.815806:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 368 00000100:00100000:1.0:1786015391.815813:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280444288:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015391.815837:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280444288:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015391.815843:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 368 00000100:00080000:1.0:1786015391.815867:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015391.815872:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015391.815874:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015391.816161:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280443648 00000100:00100000:0.0:1786015391.816167:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280443648 00000100:00100000:0.0:1786015391.816209:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 559 00000100:00100000:0.0:1786015391.816216:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280443648:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015391.816244:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280443648:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015391.816249:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 559 00000100:00100000:2.0:1786015391.919276:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786015391.919305:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304393472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015391.919399:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015391.919489:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304393472 00000100:00100000:2.0:1786015391.919497:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304393472 00000100:00100000:2.0:1786015391.919561:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1786015391.919571:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304393472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015391.919613:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 73203712 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015391.919664:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304393472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015391.919671:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:2.0:1786015391.919690:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015391.919719:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967341 gen 2 00000004:00080000:2.0:1786015391.919726:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b74aa9ad880, transno 4294967341 00000100:00100000:2.0:1786015391.919744:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304393472:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786015392.623476:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015392.662160:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015392.662280:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280444544 00000100:00100000:3.0:1786015392.662292:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280444544 00000100:00100000:3.0:1786015392.662363:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 909 00000100:00100000:3.0:1786015392.662374:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+37:25200:x1872772280444544:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1786015392.662531:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+37:25200:x1872772280444544:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 157us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015392.662539:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 909 00000100:00100000:0.0:1786015393.452528:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304393728:0@lo:400:kworker.0 00000100:00100000:0.0:1786015393.452631:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015393.452747:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304393600:0@lo:400:kworker.0 00000100:00100000:2.0:1786015393.452916:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015393.453001:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304394112:0@lo:400:kworker.0 00000100:00100000:2.0:1786015393.453043:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304393600 00000100:00100000:2.0:1786015393.453052:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304393600 00000100:00100000:2.0:1786015393.453108:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:2.0:1786015393.453118:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304393600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015393.453154:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304393856:0@lo:400:kworker.0 00000100:00100000:2.0:1786015393.453185:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304393600:12345-0@lo:400:kworker.0 Request processed in 66us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015393.453216:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304393984:0@lo:400:kworker.0 00000100:00100000:2.0:1786015393.453218:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:1.0:1786015393.453286:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015393.454164:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304393728 00000100:00100000:0.0:1786015393.454171:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304394240:0@lo:400:kworker.0 00000100:00100000:3.0:1786015393.454177:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304393728 00000100:00100000:0.0:1786015393.454229:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015393.454384:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015393.454509:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304393856 00000100:00100000:1.0:1786015393.454517:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304393856 00000100:00100000:0.0:1786015393.456164:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304394112 00000100:00100000:0.0:1786015393.456185:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304394112 00000100:00100000:2.0:1786015393.456786:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304393600:0@lo:400:kworker.0 00000100:00100000:2.0:1786015393.456880:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015393.456960:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304393984 00000100:00100000:2.0:1786015393.456969:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304393984 00000100:00100000:2.0:1786015393.457019:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304394240 00000100:00100000:2.0:1786015393.457022:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304394240 00000100:00100000:2.0:1786015393.457044:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1786015393.457052:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304393984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015393.457138:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304393984:12345-0@lo:400:kworker.0 Request processed in 85us (3852us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015393.457145:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1786015393.457160:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1786015393.457167:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304394240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015393.457316:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1786015393.462101:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304394240:12345-0@lo:400:kworker.0 Request processed in 4919us (5206us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015393.462122:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00080000:2.0:1786015393.462172:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015393.462177:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015393.462260:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304394240:0@lo:400:kworker.0 00000100:00100000:1.0:1786015393.462537:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1786015393.462558:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304393856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015393.462717:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304393856:12345-0@lo:400:kworker.0 Request processed in 167us (8487us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015393.462726:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00080000:2.0:1786015393.462799:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015393.462847:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304393984:0@lo:400:kworker.0 00000100:00100000:2.0:1786015393.462860:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304393856:0@lo:400:kworker.0 00000100:00100000:0.0:1786015393.470394:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1786015393.470415:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304394112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015393.470584:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304394112:12345-0@lo:400:kworker.0 Request processed in 174us (16275us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015393.470593:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00080000:2.0:1786015393.470822:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015393.470918:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304394112:0@lo:400:kworker.0 00000100:00100000:3.0:1786015393.471000:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304393728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015393.471210:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304393728:12345-0@lo:400:kworker.0 Request processed in 13885us (18578us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015393.471221:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1786015393.475416:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304393728:0@lo:400:kworker.0 00010000:00010000:0.0:1786015393.644073:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015393.967845:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304394368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015393.967936:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015393.969078:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304394368 00000100:00100000:2.0:1786015393.969092:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304394368 00000100:00100000:2.0:1786015393.969159:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1786015393.969171:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304394368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015393.969210:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71368704 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015393.969294:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304394368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015393.969301:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1786015393.969447:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304394368:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1786015394.544190:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015394.544205:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015394.544257:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 23 count 2 00000040:00080000:0.0:1786015394.544266:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015394.668101:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786015395.070004:0:18564:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12e: Check forbidden restore ========== 07:23:13 (1786015393) 00000100:00100000:1.0:1786015395.487270:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015395.492454:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280444672 00000100:00100000:2.0:1786015395.492481:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280444672 00000100:00100000:2.0:1786015395.492604:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 910 00000100:00100000:2.0:1786015395.492622:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+37:25840:x1872772280444672:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1786015395.492994:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+37:25840:x1872772280444672:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 200us (5562us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015395.493004:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 910 00000100:00080000:3.0:1786015395.493203:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015395.508565:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015395.508724:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280444800 00000100:00100000:1.0:1786015395.508738:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280444800 00000100:00100000:1.0:1786015395.509115:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 911 00000100:00100000:1.0:1786015395.509127:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+82:25841:x1872772280444800:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015395.509158:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015395.509189:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c5011a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e84e4 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.509275:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5011af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.509292:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5011af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.509308:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5011af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.509349:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c5011b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.509356:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c5011b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.509363:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c5011b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.510029:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5011af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.510043:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5011af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.510050:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5011af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.510057:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015395.510062:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5011af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.510071:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5011af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.510087:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6200) 00010000:00010000:1.0:1786015395.510090:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015395.510096:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5011af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.510103:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5011af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.510127:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c5011b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.510134:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c5011b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.510140:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c5011b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.510145:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015395.510148:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c5011b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.510154:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c5011b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.510162:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x12938145 (ffff8b7483ee6800) 00010000:00010000:1.0:1786015395.510165:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015395.510167:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c5011b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.510173:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c5011b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.510220:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c5011a8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84e4 expref: 83 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.510233:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6200) 00010000:00010000:1.0:1786015395.510235:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015395.510246:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c5011a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84e4 expref: 83 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.510256:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46600, rc 0) 00000100:00100000:1.0:1786015395.510406:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+82:25841:x1872772280444800:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1280us (1857us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015395.510417:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 911 00000100:00080000:3.0:1786015395.511316:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015395.524753:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015395.524965:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280445056 00000100:00100000:3.0:1786015395.524980:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280445056 00000100:00100000:3.0:1786015395.525055:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 912 00000100:00100000:3.0:1786015395.525066:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+82:25841:x1872772280445056:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:3.0:1786015395.525142:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015395.525178:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501012 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8443 expref: 82 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.525200:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6200) 00010000:00010000:3.0:1786015395.525206:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015395.525566:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5011bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.525593:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501051 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8458 expref: 36 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.525603:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5011bd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.525648:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501051 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8458 expref: 36 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.525666:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501051 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8458 expref: 36 pid: 7673 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015395.525685:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304394496:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015395.526072:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7491f64540 going to sleep for 11 seconds 00000100:00100000:0.0:1786015395.530057:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015395.530196:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304394496:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015395.530238:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5011bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015395.530287:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280445184 00000100:00100000:1.0:1786015395.530297:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280445184 00010000:00010000:1.0:1786015395.530346:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501051 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8458 expref: 37 pid: 7673 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015395.530426:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 280 00000100:00100000:1.0:1786015395.530446:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2354:x1872772280445184:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015395.530468:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015395.530477:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501051 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8458 expref: 37 pid: 7673 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.530491:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501051 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8458 expref: 37 pid: 7673 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.530519:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501051 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8458 expref: 37 pid: 7673 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.530548:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6200) 00010000:00010000:1.0:1786015395.530554:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5011bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.530587:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5011bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.530596:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5011bd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.530633:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015395.530718:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+36:2354:x1872772280445184:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 283us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015395.530726:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 280 00010000:00010000:3.0:1786015395.530801:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5011bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.530809:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5011bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.530846:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5011c4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.530857:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5011c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.530873:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5011c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015395.532270:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3b:0x0]: returning size 512 00010000:00010000:3.0:1786015395.532292:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5011bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.532304:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5011bd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.532312:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5011bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.532320:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015395.532325:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5011bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.532334:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5011bd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.532352:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6200) 00010000:00010000:3.0:1786015395.532355:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015395.532361:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5011bd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.532367:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5011bd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015395.532394:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d7206d3 reply state 000000003eb1f5f5 transno 4294967895 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5011c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015395.532418:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015395.532542:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+83:25841:x1872772280445056:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 7473us (7800us total) trans 4294967895 rc 0/0 00000100:00100000:3.0:1786015395.532553:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 912 00010000:00010000:2.0:1786015395.541974:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5011c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.542003:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5011c4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.542013:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5011c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.542043:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015395.542050:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5011c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.542060:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5011c4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.542086:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x12938145 (ffff8b74a04b5300) 00010000:00010000:2.0:1786015395.542089:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015395.542095:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5011c4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.542102:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5011c4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015395.546995:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015395.547661:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280445312 00000100:00100000:1.0:1786015395.547677:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280445312 00000100:00100000:1.0:1786015395.547791:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 913 00000100:00100000:1.0:1786015395.547802:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+82:25842:x1872772280445312:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1786015395.547960:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015395.547999:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c5011cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e84eb expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.548097:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c5011d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.548114:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c5011d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.548128:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c5011d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015395.548215:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1786015395.548220:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 24 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015395.548274:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c5011d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.548307:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c5011cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84eb expref: 84 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.548327:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c5011d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84eb expref: 83 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.548336:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:1.0:1786015395.548339:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015395.548343:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46c00, rc 0) 00000100:00100000:1.0:1786015395.548488:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+83:25842:x1872772280445312:12345-192.168.202.56@tcp:101:bash.0 Request processed in 688us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015395.548497:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 913 00000100:00100000:0.0:1786015395.552475:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015395.552942:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280445440 00000100:00100000:2.0:1786015395.552957:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280445440 00000100:00100000:2.0:1786015395.553069:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 914 00000100:00100000:2.0:1786015395.553081:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+83:25842:x1872772280445440:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1786015395.553123:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015395.553154:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5011d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e84f2 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553258:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5011e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553277:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5011e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553322:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5011e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553342:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5011e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553350:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5011e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553357:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5011e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553540:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5011ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553549:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5011ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553556:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5011ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015395.553598:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3b:0x0]: returning size 512 00000004:00200000:2.0:1786015395.553603:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015395.553641:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5011ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553656:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5011e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553663:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5011e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553689:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5011e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553696:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2179200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015395.553701:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5011e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553709:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5011e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553722:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:2.0:1786015395.553725:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015395.553730:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5011e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553736:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5011e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553752:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5011e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553758:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5011e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553792:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5011e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553797:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015395.553800:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5011e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553990:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5011e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.553998:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x12938145 (ffff8b7499c59f00) 00010000:00010000:2.0:1786015395.554001:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015395.554004:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5011e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.554010:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5011e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.554057:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5011d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84f2 expref: 85 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.554071:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178a00/0xb1a5ef690c5011ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84f2 expref: 84 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.554079:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8b7499c59b00) 00010000:00010000:2.0:1786015395.554081:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786015395.554084:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2178a00, rc 0) 00000100:00100000:2.0:1786015395.554175:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+84:25842:x1872772280445440:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1095us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015395.554183:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 914 00000100:00100000:0.0:1786015395.557719:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015395.557972:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280445568 00000100:00100000:3.0:1786015395.557987:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280445568 00000100:00100000:3.0:1786015395.558059:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 915 00000100:00100000:3.0:1786015395.558071:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+84:25842:x1872772280445568:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1786015395.558101:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015395.558133:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5011f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e84f9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558226:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c5011fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558247:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c5011fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558262:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c5011fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558279:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501203 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558286:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501203 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558293:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501203 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558423:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c5011fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558443:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c5011fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558450:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c5011fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558458:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015395.558462:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c5011fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558471:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c5011fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558488:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8b7499c59b00) 00010000:00010000:3.0:1786015395.558491:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015395.558497:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c5011fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558503:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c5011fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558517:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501203 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558523:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501203 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558529:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501203 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558541:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015395.558545:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501203 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558551:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501203 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558559:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff8b74a04b5b00) 00010000:00010000:3.0:1786015395.558562:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015395.558564:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501203 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558570:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501203 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558901:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5011f5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84f9 expref: 85 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558916:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8b7499c59b00) 00010000:00010000:3.0:1786015395.558918:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015395.558923:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5011f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84f9 expref: 85 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.558934:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc600, rc 0) 00000100:00100000:3.0:1786015395.559025:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+84:25842:x1872772280445568:12345-192.168.202.56@tcp:101:bash.0 Request processed in 956us (1320us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015395.559034:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 915 00000040:00080000:0.0:1786015395.565216:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015395.565232:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015395.565277:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 23 count 2 00000040:00080000:0.0:1786015395.565285:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015395.572400:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015395.572525:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280445696 00000100:00100000:1.0:1786015395.572548:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280445696 00000100:00100000:1.0:1786015395.572638:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 916 00000100:00100000:1.0:1786015395.572650:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+36:25843:x1872772280445696:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:1.0:1786015395.573089:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015395.573189:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50120a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8500 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.573461:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501211 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.573504:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501211 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.573529:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501211 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015395.573629:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1786015395.573634:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 24 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015395.573665:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501211 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.573697:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c50120a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8500 expref: 38 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.573726:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501211 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8500 expref: 37 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.573736:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:2.0:1786015395.573739:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015395.573743:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2178000, rc 0) 00000100:00100000:3.0:1786015395.574493:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+37:25843:x1872772280445696:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1836us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015395.574517:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 916 00000100:00100000:0.0:1786015395.578270:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015395.578386:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280445824 00000100:00100000:1.0:1786015395.578401:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280445824 00000100:00100000:1.0:1786015395.578537:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 917 00000100:00100000:1.0:1786015395.578550:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+37:25843:x1872772280445824:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:1.0:1786015395.578583:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015395.578630:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501218 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8507 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.578757:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50121f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.578808:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50121f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.578947:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50121f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.578967:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c501226 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.578974:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c501226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.578982:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c501226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579154:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47200/0xb1a5ef690c50122d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579164:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47200/0xb1a5ef690c50122d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579171:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47200/0xb1a5ef690c50122d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015395.579214:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3b:0x0]: returning size 512 00000004:00200000:1.0:1786015395.579218:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015395.579248:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47200/0xb1a5ef690c50122d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579278:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50121f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579286:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50121f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579293:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50121f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579300:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015395.579305:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50121f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579313:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50121f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579328:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:1.0:1786015395.579331:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015395.579336:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50121f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579343:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50121f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579358:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c501226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579364:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c501226 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579371:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c501226 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579382:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015395.579385:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c501226 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579391:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c501226 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579398:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x12938145 (ffff8b7483ee6d00) 00010000:00010000:1.0:1786015395.579401:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015395.579403:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c501226 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579407:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c501226 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579459:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501218 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8507 expref: 39 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579475:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47200/0xb1a5ef690c50122d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8507 expref: 38 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.579483:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8b7499c59b00) 00010000:00010000:1.0:1786015395.579486:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1786015395.579488:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47200, rc 0) 00000100:00100000:1.0:1786015395.579627:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+38:25843:x1872772280445824:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1079us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015395.579635:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 917 00000100:00100000:0.0:1786015395.583270:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015395.583341:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280445952 00000100:00100000:2.0:1786015395.583354:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280445952 00000100:00100000:2.0:1786015395.583427:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 918 00000100:00100000:2.0:1786015395.583447:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+38:25843:x1872772280445952:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015395.583476:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015395.583503:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501234 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e850e expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.583638:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50123b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.583656:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50123b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.583669:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50123b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.583684:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501242 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.583692:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.583697:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.583950:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50123b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.583957:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50123b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.583964:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50123b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.583970:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bec00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015395.583974:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50123b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.583991:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50123b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.584005:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8b7499c59b00) 00010000:00010000:2.0:1786015395.584008:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015395.584014:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50123b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.584020:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c50123b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.584032:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.584037:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501242 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.584043:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501242 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.584047:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015395.584050:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501242 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.584055:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501242 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.584061:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff8b7499c59f00) 00010000:00010000:2.0:1786015395.584064:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015395.584066:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501242 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.584081:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501242 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.584124:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501234 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e850e expref: 39 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.584135:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8b7499c59b00) 00010000:00010000:2.0:1786015395.584138:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015395.584141:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501234 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e850e expref: 39 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.584152:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2179200, rc 0) 00000100:00100000:2.0:1786015395.584226:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+38:25843:x1872772280445952:12345-192.168.202.56@tcp:101:rm.0 Request processed in 791us (974us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015395.584235:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 918 00000100:00100000:0.0:1786015395.588252:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015395.588414:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280446080 00000100:00100000:3.0:1786015395.588428:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280446080 00000100:00100000:3.0:1786015395.588513:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 919 00000100:00100000:3.0:1786015395.588525:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+38:25843:x1872772280446080:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015395.588555:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015395.588586:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c501249 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8515 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.588697:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501250 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.588716:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501250 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.588730:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501250 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.588748:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501257 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.588756:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.588803:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.588909:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501250 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.588937:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501250 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.588943:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501250 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.588950:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015395.588955:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501250 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.588963:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501250 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.588978:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8b7499c59b00) 00010000:00010000:3.0:1786015395.588981:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015395.588986:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501250 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.588991:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501250 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.589008:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.589015:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501257 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.589021:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.589027:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015395.589036:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.589043:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501257 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.589051:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff8b74a04b5b00) 00010000:00010000:3.0:1786015395.589053:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015395.589056:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501257 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.589062:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501257 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.589101:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c501249 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8515 expref: 39 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.589114:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8b7499c59b00) 00010000:00010000:3.0:1786015395.589116:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015395.589119:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c501249 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8515 expref: 39 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.589131:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc600, rc 0) 00000100:00100000:3.0:1786015395.589213:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+38:25843:x1872772280446080:12345-192.168.202.56@tcp:101:rm.0 Request processed in 690us (976us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015395.589221:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 919 00000100:00100000:0.0:1786015395.606930:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015395.607117:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280446208 00000100:00100000:2.0:1786015395.607133:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280446208 00000100:00100000:2.0:1786015395.607212:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 920 00000100:00100000:2.0:1786015395.607223:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+38:25844:x1872772280446208:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015395.607260:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015395.607289:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50125e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e851c expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607383:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501265 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607401:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501265 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607445:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501265 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607465:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50126c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607472:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50126c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607479:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50126c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607564:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501265 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607571:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501265 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607576:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501265 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607582:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bec00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015395.607587:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501265 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607595:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501265 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607609:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8b7499c59b00) 00010000:00010000:2.0:1786015395.607612:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015395.607616:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501265 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607629:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c501265 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607644:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50126c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607651:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50126c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607655:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50126c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607659:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015395.607662:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50126c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607667:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50126c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607674:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff8b7499c59f00) 00010000:00010000:2.0:1786015395.607677:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015395.607691:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50126c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607697:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50126c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.607742:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50125e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e851c expref: 39 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.608387:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8b7499c59b00) 00010000:00010000:2.0:1786015395.608391:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015395.608398:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50125e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e851c expref: 39 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.608413:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf600, rc 0) 00000100:00100000:2.0:1786015395.608539:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+38:25844:x1872772280446208:12345-192.168.202.56@tcp:101:cp.0 Request processed in 1316us (1624us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015395.608549:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 920 00000100:00100000:0.0:1786015395.616649:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015395.616805:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280446336 00000100:00100000:1.0:1786015395.616848:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280446336 00000100:00100000:1.0:1786015395.616920:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 921 00000100:00100000:1.0:1786015395.616932:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+38:25844:x1872772280446336:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015395.616964:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015395.616992:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501273 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8523 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617084:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50127a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617101:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50127a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617115:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50127a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617130:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501281 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617137:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617143:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617232:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50127a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617240:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50127a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617248:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50127a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617261:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015395.617266:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50127a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617274:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50127a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617288:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8b7499c59b00) 00010000:00010000:1.0:1786015395.617292:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015395.617297:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50127a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617304:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50127a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617320:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617326:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501281 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617332:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501281 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617338:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015395.617341:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501281 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617348:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501281 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617366:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff8b7483ee6d00) 00010000:00010000:1.0:1786015395.617369:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015395.617371:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501281 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617377:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501281 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617422:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501273 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8523 expref: 39 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617445:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8b7499c59b00) 00010000:00010000:1.0:1786015395.617448:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015395.617453:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501273 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8523 expref: 39 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.617462:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47600, rc 0) 00000100:00100000:1.0:1786015395.617540:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+38:25844:x1872772280446336:12345-192.168.202.56@tcp:101:cp.0 Request processed in 610us (909us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015395.617549:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 921 00000100:00100000:0.0:1786015395.622965:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015395.623135:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280446592 00000100:00100000:1.0:1786015395.623150:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280446592 00000100:00100000:1.0:1786015395.623231:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 922 00000100:00100000:1.0:1786015395.623242:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+38:25844:x1872772280446592:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015395.623271:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015395.623300:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501288 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e852a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.623515:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c50128f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.623533:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c50128f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.623547:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c50128f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.623565:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501296 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.623573:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501296 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.623580:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501296 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786015395.624491:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x12:0x0], index 0: 0 00010000:00010000:1.0:1786015395.624738:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46200/0xb1a5ef690c50129d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.624752:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46200/0xb1a5ef690c50129d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.624796:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46200/0xb1a5ef690c50129d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.624844:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c50128f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.624864:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c50128f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.624871:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c50128f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.624880:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015395.624886:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c50128f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.624895:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c50128f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.624911:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8b7499c59b00) 00010000:00010000:1.0:1786015395.624915:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015395.624921:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c50128f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.624928:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c50128f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786015395.624945:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e033efd0 reply state 000000005fcb1845 transno 4294967896 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501296 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015395.624956:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786015395.625000:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501288 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e852a expref: 41 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.625015:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46200/0xb1a5ef690c50129d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e852a expref: 40 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.625034:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8b7483ee6700) 00010000:00010000:1.0:1786015395.625037:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015395.625040:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46200, rc 0) 00000100:00100000:1.0:1786015395.625142:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+41:25844:x1872772280446592:12345-192.168.202.56@tcp:101:cp.0 Request processed in 1899us (2191us total) trans 4294967896 rc 0/0 00000100:00100000:1.0:1786015395.625153:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 922 00000100:00100000:2.0:1786015395.626066:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6699:1872772304394624:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1786015395.626151:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015395.626188:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0175180 going to sleep for 11 seconds 00000100:00100000:0.0:1786015395.626402:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304394624 00000100:00100000:0.0:1786015395.626425:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304394624 00000100:00100000:0.0:1786015395.626511:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1786015395.626521:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6699:x1872772304394624:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1786015395.626583:0:6592:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00080000:2.0:1786015395.628040:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786015395.634605:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501296 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.634637:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501296 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.634644:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501296 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.634651:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015395.634656:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501296 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.634665:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501296 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.634703:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff8b7483ee6500) 00010000:00010000:2.0:1786015395.634706:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015395.634711:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501296 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.634718:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501296 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015395.636226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015395.636584:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280446720 00000100:00100000:2.0:1786015395.636598:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280446720 00000100:00100000:2.0:1786015395.636693:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 232 00000100:00100000:2.0:1786015395.636705:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280446720:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015395.636732:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015395.636785:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c5012ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8531 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786015395.636961:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1786015395.637013:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786015395.637051:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1786015395.637056:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015395.637070:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c5012ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8531 expref: 9 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.637103:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c5012ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8531 expref: 9 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.637120:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf600, rc 0) 00000100:00100000:2.0:1786015395.637269:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280446720:12345-192.168.202.56@tcp:101:cp.0 Request processed in 566us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015395.637278:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 232 00000100:00100000:1.0:1786015395.651811:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015395.651975:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280446848 00000100:00100000:3.0:1786015395.651993:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280446848 00000100:00100000:3.0:1786015395.652077:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 233 00000100:00100000:3.0:1786015395.652103:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:25844:x1872772280446848:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015395.652129:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015395.652155:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009db89b9b/0xb1a5ef690c5012b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8538 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.652197:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c5012ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8531 expref: 10 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.652208:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015395.652213:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015395.652219:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009db89b9b/0xb1a5ef690c5012b2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8538 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.652269:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c5012ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8531 expref: 10 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.652285:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c5012ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8531 expref: 10 pid: 11384 timeout: 730 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015395.652304:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304394752:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015395.654255:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7491f64540 going to sleep for 11 seconds 00000100:00100000:3.0:1786015395.665591:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015395.665648:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304394752:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015395.665700:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280446976 00010000:00010000:2.0:1786015395.665717:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009db89b9b/0xb1a5ef690c5012b2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8538 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015395.665717:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280446976 00010000:00010000:2.0:1786015395.665798:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd400, rc 0) 00010000:00010000:1.0:1786015395.665830:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c5012ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8531 expref: 11 pid: 11384 timeout: 730 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015395.665892:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 281 00000100:00100000:1.0:1786015395.665904:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280446976:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015395.665925:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015395.665975:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c5012ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8531 expref: 11 pid: 11384 timeout: 730 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.665992:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c5012ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8531 expref: 11 pid: 11384 timeout: 730 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.666027:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c5012ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8531 expref: 11 pid: 11384 timeout: 730 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015395.666055:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:25844:x1872772280446848:12345-192.168.202.56@tcp:101:cp.0 Request processed in 13952us (14296us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015395.666089:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 233 00010000:00010000:1.0:1786015395.666101:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015395.666109:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015395.666120:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009db89b9b/0xb1a5ef690c5012b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8538 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.666133:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009db89b9b/0xb1a5ef690c5012b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8538 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.666190:0:6607:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009db89b9b/0xb1a5ef690c5012b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8538 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015395.666212:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381941f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304394880:192.168.202.56@tcp:105: 00000100:00100000:1.0:1786015395.666299:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0312b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786015395.676040:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015395.676390:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280447232 00000100:00100000:1.0:1786015395.676408:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280447232 00000100:00100000:1.0:1786015395.676522:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 186 00000100:00100000:1.0:1786015395.676535:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+40:25844:x1872772280447232:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:2.0:1786015395.676738:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381941f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304394880:192.168.202.56@tcp:105: 00010000:00010000:2.0:1786015395.676800:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015395.676957:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280446976:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 11053us (11380us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015395.676968:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 281 00000100:00100000:1.0:1786015395.677154:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+41:25844:x1872772280447232:12345-192.168.202.56@tcp:35:cp.0 Request processed in 619us (1122us total) trans 4294967897 rc 0/0 00000100:00100000:1.0:1786015395.677164:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 186 00000100:00100000:0.0:1786015395.692295:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6699:x1872772304394624:12345-0@lo:5:osp-pre-0-0.0 Request processed in 65761us (66128us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1786015395.692316:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00010000:00010000:1.0:1786015395.694940:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015395.696776:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6699:1872772304394624:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1786015395.696806:0:6699:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x12:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:2.0:1786015395.742995:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015395.743093:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280447360 00000100:00100000:1.0:1786015395.743104:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280447360 00000100:00100000:1.0:1786015395.743174:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 923 00000100:00100000:1.0:1786015395.743185:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+84:25847:x1872772280447360:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015395.743230:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015395.743259:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c5012b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e853f expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743339:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c5012c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743358:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c5012c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743371:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c5012c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743388:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5012c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743395:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5012c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743402:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5012c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743539:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c5012ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743548:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c5012ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743555:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c5012ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015395.743592:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 158 00000004:00200000:1.0:1786015395.743603:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015395.743626:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c5012ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743640:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c5012ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743649:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c5012c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743655:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c5012c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743662:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c5012c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743669:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015395.743673:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c5012c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743681:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c5012c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743694:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8b7499c59b00) 00010000:00010000:1.0:1786015395.743697:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015395.743701:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c5012c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743708:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c5012c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743722:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5012c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743737:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5012c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743743:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5012c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743748:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015395.743751:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5012c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743757:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5012c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743833:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff8b7483ee6d00) 00010000:00010000:1.0:1786015395.743836:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015395.743839:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5012c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743846:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5012c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743885:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c5012b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e853f expref: 86 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743899:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c5012ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e853f expref: 85 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.743907:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8b7483ee6700) 00010000:00010000:1.0:1786015395.743909:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015395.743917:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46600, rc 0) 00000100:00100000:1.0:1786015395.744004:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+85:25847:x1872772280447360:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 820us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015395.744013:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 923 00000100:00100000:3.0:1786015395.751455:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015395.751600:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280447488 00000100:00100000:2.0:1786015395.751621:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280447488 00000100:00100000:2.0:1786015395.751708:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 234 00000100:00100000:2.0:1786015395.751720:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+11:2354:x1872772280447488:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015395.751744:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015395.751903:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c5012d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8546 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015395.751985:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304395008:192.168.202.56@tcp:106: 00000100:00100000:2.0:1786015395.752101:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0175180 going to sleep for 11 seconds 00000100:00080000:3.0:1786015395.752253:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1786015395.754279:0:11384:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1786015395.754289:0:11384:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb mtime: 0 -> 1786015395 00002000:00010000:2.0:1786015395.754292:0:11384:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb atime: 0 -> 1786015395 00002000:00010000:2.0:1786015395.754294:0:11384:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb ctime: 0 -> 1786015395 00000100:00100000:2.0:1786015395.754322:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304395008:192.168.202.56@tcp:106: 00010000:00010000:2.0:1786015395.754368:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c5012d5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8546 expref: 12 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.754395:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010ad2002/0xb1a5ef690c5012d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8546 expref: 12 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.754410:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf600, rc 0) 00000100:00100000:2.0:1786015395.754620:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+11:2354:x1872772280447488:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 2902us (3189us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015395.754630:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 234 00000100:00100000:1.0:1786015395.765058:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015395.765195:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280447616 00000100:00100000:3.0:1786015395.765216:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280447616 00000100:00100000:3.0:1786015395.765339:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 924 00000100:00100000:3.0:1786015395.765354:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+85:25847:x1872772280447616:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015395.765384:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015395.765414:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5012dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e854d expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.765580:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5012e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.765599:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5012e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015395.765675:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5012e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015395.769095:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3b:0x0]: returning size 512 00000004:00200000:2.0:1786015395.769106:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015395.769173:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5012e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.769220:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5012dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e854d expref: 87 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.769271:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5012e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e854d expref: 86 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015395.769282:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8b7499c59b00) 00010000:00010000:2.0:1786015395.769285:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015395.769289:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbcc00, rc 0) 00000100:00100000:2.0:1786015395.769380:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+86:25847:x1872772280447616:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 4029us (4332us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015395.769390:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 924 00000100:00100000:3.0:1786015395.790331:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015395.790953:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280447744 00000100:00100000:1.0:1786015395.790969:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280447744 00000100:00100000:1.0:1786015395.791050:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 235 00000100:00100000:1.0:1786015395.791062:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+11:2354:x1872772280447744:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015395.791091:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015395.791118:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1a8b25f/0xb1a5ef690c5012ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8554 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015395.791211:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304395136:192.168.202.56@tcp:106: 00000100:00100000:1.0:1786015395.791358:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74866320c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015395.794908:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304395136:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015395.794968:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1a8b25f/0xb1a5ef690c5012ea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8554 expref: 12 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.795003:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1a8b25f/0xb1a5ef690c5012ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8554 expref: 12 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015395.795020:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47800, rc 0) 00000100:00100000:1.0:1786015395.795099:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+11:2354:x1872772280447744:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 4040us (4784us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015395.795110:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 235 00000100:00100000:2.0:1786015395.804381:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015395.804456:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280448000 00000100:00100000:3.0:1786015395.804475:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280448000 00000100:00100000:3.0:1786015395.804556:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 925 00000100:00100000:3.0:1786015395.804568:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+86:25847:x1872772280448000:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:3.0:1786015395.806080:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].23, 136 off11320 00000100:00100000:3.0:1786015395.806500:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+86:25847:x1872772280448000:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 1924us (2122us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015395.806515:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 925 00000040:00080000:1.0:1786015396.590077:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015396.590090:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015396.590137:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 24 count 3 00000040:00080000:1.0:1786015396.590145:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015396.590473:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304395264:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015396.591800:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74aee18300 going to sleep for 11 seconds 00000100:00100000:0.0:1786015396.604193:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304395264:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015396.616193:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015396.618816:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280448128 00000100:00100000:2.0:1786015396.618833:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280448128 00000100:00100000:2.0:1786015396.618915:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 926 00000100:00100000:2.0:1786015396.618926:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+41:25858:x1872772280448128:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015396.618972:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x18:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015396.619112:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+41:25858:x1872772280448128:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 188us (2933us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015396.619120:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 926 00000100:00100000:1.0:1786015396.625122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015396.625234:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280448384 00000100:00100000:2.0:1786015396.625261:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280448384 00000100:00100000:2.0:1786015396.625334:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 927 00000100:00100000:2.0:1786015396.625344:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+41:25858:x1872772280448384:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015396.625367:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015396.625442:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5012f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e855b expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015396.625581:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5012f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015396.625599:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5012f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015396.625615:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5012f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015396.625630:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 158 00010000:00010000:2.0:1786015396.625833:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5012f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e855b expref: 44 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015396.625853:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5012f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e855b expref: 43 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015396.625862:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8b7483ee6700) 00010000:00010000:2.0:1786015396.625865:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015396.625869:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bec00, rc 0) 00000100:00100000:2.0:1786015396.625946:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+43:25858:x1872772280448384:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 602us (852us total) trans 4294967898 rc 0/0 00000100:00100000:2.0:1786015396.625957:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 927 00000100:00100000:2.0:1786015396.642953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015396.643005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015396.643624:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280448640 00000100:00100000:3.0:1786015396.643639:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280448640 00000100:00100000:3.0:1786015396.643920:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 38 00000100:00100000:3.0:1786015396.643930:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+43:2353:x1872772280448640:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015396.643953:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015396.643975:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bec00/0xb1a5ef690c5012f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e855b expref: 43 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015396.643987:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8b7483ee6700) 00010000:00010000:3.0:1786015396.643990:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015396.644041:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+42:2353:x1872772280448640:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 114us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015396.644046:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 38 00000100:00100000:0.0:1786015396.644178:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280448512 00000100:00100000:0.0:1786015396.644190:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280448512 00000100:00100000:0.0:1786015396.644254:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 236 00000100:00100000:0.0:1786015396.644264:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280448512:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786015396.644320:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c796b6be/0xb1a5ef690c501306 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015396.644343:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009db89b9b/0xb1a5ef690c5012b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8538 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015396.644353:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x12:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786015396.644358:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015396.644363:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c796b6be/0xb1a5ef690c501306 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015396.644406:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009db89b9b/0xb1a5ef690c5012b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8538 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015396.644434:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009db89b9b/0xb1a5ef690c5012b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8538 expref: 9 pid: 14547 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015396.644466:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304395392:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015396.644550:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7381ffba80 going to sleep for 11 seconds 00000100:00100000:2.0:1786015396.655154:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304395392:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015396.655183:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c796b6be/0xb1a5ef690c501306 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015396.663022:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015396.664154:0:17970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280448768 00000100:00100000:1.0:1786015396.664176:0:17970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280448768 00002000:00100000:1.0:1786015396.664268:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x12:0x0] (0->157) req@ffff8b74b8c7ed80 x1872772280448768/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:242/0 lens 648/0 e 0 to 0 dl 1786015407 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015396.664284:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74b8c7ed80 with x1872772280448768 ext(0->157) 00010000:00010000:1.0:1786015396.664297:0:17970:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009db89b9b/0xb1a5ef690c5012b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8538 expref: 10 pid: 14547 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.664399:0:17970:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009db89b9b/0xb1a5ef690c5012b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8538 expref: 10 pid: 14547 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015396.664410:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b74b8c7ed80 00000100:00100000:1.0:1786015396.664470:0:17970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:1.0:1786015396.664483:0:17970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280448768:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:1.0:1786015396.667321:0:17970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280448768:12345-192.168.202.56@tcp:4:cp.0 Request processed in 2829us (4296us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1786015396.667336:0:17970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00002000:00100000:1.0:1786015396.667350:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x12:0x0] (0->157) req@ffff8b74b8c7ed80 x1872772280448768/t4294967343(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:242/0 lens 648/448 e 0 to 0 dl 1786015407 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015396.667379:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74b8c7ed80 with x1872772280448768 ext(0->157) 00010000:00010000:1.0:1786015396.667392:0:17970:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009db89b9b/0xb1a5ef690c5012b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8538 expref: 12 pid: 14547 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.667415:0:17970:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009db89b9b/0xb1a5ef690c5012b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8538 expref: 12 pid: 14547 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015396.667432:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b74b8c7ed80 00000100:00100000:1.0:1786015396.678902:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015396.679729:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280448896 00000100:00100000:0.0:1786015396.679748:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280448896 00010000:00010000:0.0:1786015396.679856:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009db89b9b/0xb1a5ef690c5012b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8538 expref: 12 pid: 14547 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015396.679911:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 282 00000100:00100000:0.0:1786015396.679923:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b024d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280448896:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015396.679944:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015396.679988:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009db89b9b/0xb1a5ef690c5012b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8538 expref: 12 pid: 14547 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015396.680005:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009db89b9b/0xb1a5ef690c5012b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8538 expref: 12 pid: 14547 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015396.680039:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009db89b9b/0xb1a5ef690c5012b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8538 expref: 12 pid: 14547 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015396.680060:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015396.680065:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015396.680072:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c796b6be/0xb1a5ef690c501306 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015396.680105:0:17038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c796b6be/0xb1a5ef690c501306 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015396.680145:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015396.680227:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b024d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280448896:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 305us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015396.680235:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 282 00010000:00010000:1.0:1786015396.681531:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c796b6be/0xb1a5ef690c501306 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.681552:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c796b6be/0xb1a5ef690c501306 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.681593:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c796b6be/0xb1a5ef690c501306 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.681601:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c796b6be/0xb1a5ef690c501306 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.681609:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c796b6be/0xb1a5ef690c501306 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.681617:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd400 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015396.681637:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c796b6be/0xb1a5ef690c501306 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.681646:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c796b6be/0xb1a5ef690c501306 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.681668:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c796b6be/0xb1a5ef690c501306 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.681677:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c796b6be/0xb1a5ef690c501306 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786015396.681876:0:18613:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015396.681882:0:18613:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015396.681926:0:18613:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 24 count 3 00000040:00080000:3.0:1786015396.681933:0:18613:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015396.692232:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280448512:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 47959us (49281us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015396.692250:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 236 00000100:00100000:2.0:1786015396.701950:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015396.702399:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280449152 00000100:00100000:0.0:1786015396.702429:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280449152 00000100:00100000:0.0:1786015396.702510:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 928 00000100:00100000:0.0:1786015396.702525:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+42:25858:x1872772280449152:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015396.702699:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+42:25858:x1872772280449152:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 178us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015396.702707:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 928 00010000:00010000:0.0:1786015396.716038:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015396.733471:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015396.733555:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280449280 00000100:00100000:2.0:1786015396.733568:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280449280 00000100:00100000:2.0:1786015396.733642:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 237 00000100:00100000:2.0:1786015396.733662:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280449280:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015396.733682:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015396.733713:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c50130d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8562 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015396.733744:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 158, mtime: 0x6a746ea3, atime: 0x0, ctime: 0x6a746ea3, blocks: 0x1 00010000:00010000:2.0:1786015396.733798:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=631s v=(0 0) 00010000:00010000:2.0:1786015396.733803:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015396.733814:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c50130d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8562 expref: 11 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015396.733831:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c50130d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8562 expref: 11 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015396.733845:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf800, rc 0) 00000100:00100000:2.0:1786015396.733907:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280449280:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 247us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015396.733915:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 237 00000100:00100000:1.0:1786015396.750379:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015396.750415:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280449536 00000100:00100000:1.0:1786015396.750436:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280449536 00000100:00100000:1.0:1786015396.750500:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 929 00000100:00100000:1.0:1786015396.750510:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+42:25858:x1872772280449536:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786015396.750639:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+42:25858:x1872772280449536:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 130us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015396.751307:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 929 00000100:00100000:1.0:1786015396.760645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015396.760836:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280449664 00000100:00100000:3.0:1786015396.760848:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280449664 00002000:00100000:3.0:1786015396.760899:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x12:0x0] (0->4095) req@ffff8b7384bb6300 x1872772280449664/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:242/0 lens 488/0 e 0 to 0 dl 1786015407 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015396.760910:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb6300 with x1872772280449664 ext(0->4095) 00002000:00010000:3.0:1786015396.760916:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7384bb6300 00000100:00100000:3.0:1786015396.760950:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 87 00000100:00100000:3.0:1786015396.760961:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280449664:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1786015396.761186:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280449664:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 226us (554us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786015396.761205:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 87 00002000:00100000:3.0:1786015396.761213:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x12:0x0] (0->4095) req@ffff8b7384bb6300 x1872772280449664/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:242/0 lens 488/4536 e 0 to 0 dl 1786015407 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015396.761221:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb6300 with x1872772280449664 ext(0->4095) 00002000:00010000:3.0:1786015396.761224:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7384bb6300 00000100:00100000:0.0:1786015396.765240:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015396.765329:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280449792 00000100:00100000:1.0:1786015396.765349:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280449792 00000100:00100000:1.0:1786015396.765464:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 930 00000100:00100000:1.0:1786015396.765477:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+42:25858:x1872772280449792:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015396.765507:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015396.765541:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c501314 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8569 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.765587:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c50131b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.765612:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c50131b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.765629:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c50131b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.765802:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c501314 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8569 expref: 44 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.765825:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c50131b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8569 expref: 43 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.765835:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8b7483ee6700) 00010000:00010000:1.0:1786015396.765839:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015396.765843:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47a00, rc 0) 00000100:00100000:1.0:1786015396.765928:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+43:25858:x1872772280449792:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 454us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015396.765937:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 930 00000100:00100000:1.0:1786015396.774801:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015396.775127:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280449920 00000100:00100000:0.0:1786015396.775140:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280449920 00000100:00100000:0.0:1786015396.775228:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 931 00000100:00100000:0.0:1786015396.775239:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:25858:x1872772280449920:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015396.775276:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x18:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015396.775420:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:25858:x1872772280449920:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 182us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015396.775436:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 931 00000100:00100000:1.0:1786015396.779281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015396.781816:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280450048 00000100:00100000:2.0:1786015396.781837:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280450048 00000100:00100000:2.0:1786015396.781943:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 238 00000100:00100000:2.0:1786015396.781956:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280450048:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786015396.782008:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c68a413/0xb1a5ef690c501322 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015396.782028:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786015396.782034:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015396.782041:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c68a413/0xb1a5ef690c501322 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015396.782059:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c68a413/0xb1a5ef690c501322 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015396.782095:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c68a413/0xb1a5ef690c501322 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015396.782103:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c68a413/0xb1a5ef690c501322 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015396.782113:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c68a413/0xb1a5ef690c501322 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015396.782121:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bec00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015396.782125:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c68a413/0xb1a5ef690c501322 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015396.782135:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c68a413/0xb1a5ef690c501322 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015396.782158:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c68a413/0xb1a5ef690c501322 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015396.782166:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c68a413/0xb1a5ef690c501322 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015396.782269:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280450048:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 316us (3011us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015396.782278:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 238 00000100:00100000:1.0:1786015396.785252:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015396.785471:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280450304 00000100:00100000:3.0:1786015396.785483:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280450304 00000100:00100000:3.0:1786015396.785545:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 932 00000100:00100000:3.0:1786015396.785555:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+43:25858:x1872772280450304:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786015396.785658:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501329 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015396.785679:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c50131b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8569 expref: 43 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015396.785689:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501329 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015396.785724:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c50131b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8569 expref: 43 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015396.785740:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c50131b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8569 expref: 43 pid: 7673 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015396.785756:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304395520:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015396.785878:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7491f64300 going to sleep for 11 seconds 00000100:00100000:1.0:1786015396.792510:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015396.792572:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280450432 00000100:00100000:1.0:1786015396.792586:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280450432 00010000:00010000:1.0:1786015396.792664:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c50131b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8569 expref: 44 pid: 7673 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015396.792717:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 283 00000100:00100000:1.0:1786015396.792731:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2354:x1872772280450432:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015396.792753:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015396.792801:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c50131b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8569 expref: 44 pid: 7673 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.792818:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c50131b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8569 expref: 44 pid: 7673 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.792850:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8b7483ee6700) 00010000:00010000:1.0:1786015396.792858:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501329 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.792870:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501329 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.792881:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501329 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.792907:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015396.792975:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2354:x1872772280450432:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 247us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015396.793001:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 283 00010000:00010000:2.0:1786015396.795900:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c50131b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8569 expref: 43 pid: 7673 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015396.795928:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304395520:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015396.795955:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501329 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.796041:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501329 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.796050:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501329 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.796266:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501329 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.796275:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501329 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.796282:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501329 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.796288:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015396.796292:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501329 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.796299:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501329 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.796872:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8b7483ee6700) 00010000:00010000:1.0:1786015396.796878:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015396.796884:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501329 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015396.796892:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501329 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015396.797111:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+43:25858:x1872772280450304:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 11552us (11865us total) trans 4294967899 rc 0/0 00000100:00100000:1.0:1786015396.797123:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 932 00000040:00080000:0.0:1786015396.798288:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015396.798297:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015396.799207:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1786015396.799220:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015396.811677:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015396.811881:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280450688 00000100:00100000:0.0:1786015396.811891:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280450688 00000100:00100000:0.0:1786015396.811962:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 187 00000100:00100000:0.0:1786015396.811972:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+43:25858:x1872772280450688:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786015396.812238:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:25858:x1872772280450688:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 266us (570us total) trans 4294967900 rc 0/0 00000100:00100000:0.0:1786015396.812248:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 187 00000100:00100000:2.0:1786015396.932838:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015396.932883:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280450944 00000100:00100000:2.0:1786015396.932888:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015396.932894:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280450944 00000100:00100000:2.0:1786015396.932919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015396.932941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015396.932950:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 399 00000100:00100000:1.0:1786015396.932960:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+86:2351:x1872772280450944:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015396.932963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015396.932984:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280451200 00000100:00100000:2.0:1786015396.932987:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280451200 00000100:00100000:2.0:1786015396.933018:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280451072 00000100:00100000:2.0:1786015396.933021:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280451072 00000100:00100000:1.0:1786015396.933037:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+86:2351:x1872772280450944:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 79us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015396.933045:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 399 00000100:00100000:2.0:1786015396.933053:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280451328 00000100:00100000:2.0:1786015396.933055:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280451328 00000100:00100000:1.0:1786015396.933068:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280450816 00000100:00100000:2.0:1786015396.933070:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 371 00000100:00100000:1.0:1786015396.933071:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280450816 00000100:00100000:2.0:1786015396.933076:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+12:2351:x1872772280451200:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015396.933092:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 561 00000100:00100000:1.0:1786015396.933098:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280450816:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015396.933103:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+12:2351:x1872772280451200:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015396.933109:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 371 00000100:00100000:1.0:1786015396.933119:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280450816:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015396.933122:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 372 00000100:00100000:1.0:1786015396.933125:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 561 00000100:00100000:2.0:1786015396.933127:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+11:2351:x1872772280451072:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015396.933149:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+11:2351:x1872772280451072:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015396.933153:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 372 00000100:00100000:2.0:1786015396.933163:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 373 00000100:00100000:2.0:1786015396.933167:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280451328:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015396.933192:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280451328:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015396.933198:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 373 00000100:00080000:2.0:1786015396.933219:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015397.036550:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015397.036576:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304395648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015397.036682:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015397.036891:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304395648 00000100:00100000:1.0:1786015397.036901:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304395648 00000100:00100000:1.0:1786015397.036979:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1786015397.036992:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304395648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015397.037041:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 76480512 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015397.037096:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304395648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015397.037123:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1786015397.037180:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304395648:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786015397.038067:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786015397.740063:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015398.573518:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304396160:0@lo:400:kworker.0 00000100:00100000:2.0:1786015398.573605:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015398.573685:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786015398.573692:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304396032:0@lo:400:kworker.0 00000100:00100000:2.0:1786015398.573722:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015398.573797:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304396160 00000100:00100000:2.0:1786015398.573806:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304396160 00000100:00100000:2.0:1786015398.573876:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1786015398.573885:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304396160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015398.574059:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304395904:0@lo:400:kworker.0 00000100:00100000:3.0:1786015398.574093:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015398.574123:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304396416:0@lo:400:kworker.0 00000100:00100000:3.0:1786015398.574145:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015398.574165:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786015398.574170:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304395776:0@lo:400:kworker.0 00000100:00100000:3.0:1786015398.574198:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015398.574226:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304396288:0@lo:400:kworker.0 00000100:00100000:3.0:1786015398.574247:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015398.574277:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304396032 00000100:00100000:3.0:1786015398.574282:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304396032 00000100:00100000:3.0:1786015398.574320:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304395904 00000100:00100000:3.0:1786015398.574324:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304395904 00000100:00100000:3.0:1786015398.574340:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304396288 00000100:00100000:3.0:1786015398.574342:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304396288 00000100:00100000:3.0:1786015398.574356:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1786015398.574361:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304396032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015398.574399:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304396032:12345-0@lo:400:kworker.0 Request processed in 37us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015398.574419:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1786015398.574438:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1786015398.574443:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304395904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015398.574477:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304395904:12345-0@lo:400:kworker.0 Request processed in 33us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015398.574493:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1786015398.574505:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1786015398.574511:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304396288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015398.574544:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304396288:12345-0@lo:400:kworker.0 Request processed in 33us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015398.574549:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1786015398.574568:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304396416 00000100:00100000:3.0:1786015398.574572:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304396416 00000100:00100000:3.0:1786015398.574598:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1786015398.574604:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304396416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015398.574634:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304396416:12345-0@lo:400:kworker.0 Request processed in 31us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015398.574640:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1786015398.574657:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304395776 00000100:00100000:3.0:1786015398.574660:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304395776 00000100:00100000:3.0:1786015398.574687:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:3.0:1786015398.574696:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304395776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015398.574728:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304395776:12345-0@lo:400:kworker.0 Request processed in 36us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015398.574733:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00080000:3.0:1786015398.574799:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015398.574805:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015398.574842:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304395776:0@lo:400:kworker.0 00000100:00100000:3.0:1786015398.574855:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304396288:0@lo:400:kworker.0 00000100:00100000:3.0:1786015398.574863:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304395904:0@lo:400:kworker.0 00000100:00100000:3.0:1786015398.574883:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304396416:0@lo:400:kworker.0 00000100:00100000:3.0:1786015398.574917:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304396032:0@lo:400:kworker.0 00000100:00100000:2.0:1786015398.576360:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304396160:12345-0@lo:400:kworker.0 Request processed in 2468us (2747us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015398.576374:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1786015398.576556:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304396160:0@lo:400:kworker.0 00010000:00010000:0.0:1786015398.763955:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015398.845289:0:18664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015398.845298:0:18664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015398.845344:0:18664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 24 count 3 00000040:00080000:1.0:1786015398.845350:0:18664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015398.907380:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015398.907452:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280451584 00000100:00100000:1.0:1786015398.907464:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280451584 00000100:00080000:2.0:1786015398.907525:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015398.907555:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 933 00000100:00100000:1.0:1786015398.907566:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+86:25867:x1872772280451584:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1786015398.907616:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015398.907620:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786015398.907658:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5012e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e854d expref: 86 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015398.907682:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8b7499c59b00) 00010000:00010000:1.0:1786015398.907688:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015398.907705:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c501330 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8570 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015398.907869:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501337 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015398.907883:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015398.907894:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015398.907920:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 158 00010000:00010000:0.0:1786015398.908303:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c501330 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8570 expref: 88 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015398.908320:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501337 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8570 expref: 87 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015398.908327:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8b7483ee6700) 00010000:00010000:0.0:1786015398.908329:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015398.908332:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47600, rc 0) 00000100:00100000:0.0:1786015398.908397:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+87:25867:x1872772280451584:12345-192.168.202.56@tcp:101:bash.0 Request processed in 832us (1031us total) trans 4294967901 rc 0/0 00000100:00100000:0.0:1786015398.908416:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 933 00000100:00100000:1.0:1786015398.918568:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015398.918652:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015398.918751:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280451712 00000100:00100000:2.0:1786015398.918793:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280451712 00000100:00100000:2.0:1786015398.918880:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:2.0:1786015398.918891:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+87:2353:x1872772280451712:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015398.918918:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015398.918954:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501337 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8570 expref: 87 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015398.918975:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8b7483ee6700) 00010000:00010000:2.0:1786015398.918980:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015398.919030:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+86:2353:x1872772280451712:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 142us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015398.919038:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:0.0:1786015398.919609:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280451840 00000100:00100000:0.0:1786015398.919616:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280451840 00000100:00100000:0.0:1786015398.919696:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 239 00000100:00100000:0.0:1786015398.919705:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+11:2351:x1872772280451840:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1786015398.919722:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015398.919741:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c501345 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8577 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015398.919792:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1786015398.919797:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015398.919805:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c501345 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8577 expref: 12 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015398.919822:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c501345 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8577 expref: 12 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015398.919834:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd800, rc 0) 00000100:00100000:0.0:1786015398.920175:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2351:x1872772280451840:12345-192.168.202.56@tcp:101:cat.0 Request processed in 469us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015398.920184:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 239 00000100:00080000:2.0:1786015398.920347:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015398.923938:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015398.924021:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280451968 00000100:00100000:2.0:1786015398.924032:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280451968 00000100:00100000:2.0:1786015398.924104:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 240 00000100:00100000:2.0:1786015398.924115:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+12:25867:x1872772280451968:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1786015398.924134:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015398.924167:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c68a413/0xb1a5ef690c50134c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e857e expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015398.924210:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c50130d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8562 expref: 10 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015398.924231:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c501345 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8577 expref: 13 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015398.924239:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015398.924244:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015398.924249:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c68a413/0xb1a5ef690c50134c lrc: 5/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e857e expref: 13 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015398.924295:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c501345 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8577 expref: 13 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015398.924319:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c501345 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8577 expref: 13 pid: 6592 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015398.924334:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304396544:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015398.924453:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c50130d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8562 expref: 10 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015398.924464:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c50130d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8562 expref: 10 pid: 11384 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015398.924505:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304396672:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015398.924536:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b13f0840 going to sleep for 11 seconds 00000100:00100000:1.0:1786015398.931625:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015398.931738:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015398.931842:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280452096 00000100:00100000:1.0:1786015398.931854:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280452096 00010000:00010000:1.0:1786015398.931897:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c501345 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8577 expref: 14 pid: 6592 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015398.931937:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280452224 00000100:00100000:1.0:1786015398.931941:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280452224 00010000:00010000:1.0:1786015398.931969:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c50130d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8562 expref: 11 pid: 11384 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015398.931993:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 284 00000100:00100000:1.0:1786015398.932003:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+14:2354:x1872772280452096:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015398.932019:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015398.932044:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c501345 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8577 expref: 14 pid: 6592 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015398.932059:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c501345 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8577 expref: 14 pid: 6592 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015398.932105:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015398.932177:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+14:2354:x1872772280452096:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 174us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015398.932184:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 284 00000100:00100000:1.0:1786015398.932202:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 285 00000100:00100000:1.0:1786015398.932208:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280452224:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015398.932215:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015398.932224:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c50130d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8562 expref: 11 pid: 11384 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015398.932236:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c50130d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8562 expref: 11 pid: 11384 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015398.932251:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015398.932255:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015398.932263:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003c68a413/0xb1a5ef690c50134c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e857e expref: 13 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015398.932274:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c68a413/0xb1a5ef690c50134c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e857e expref: 13 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015398.932324:0:6607:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003c68a413/0xb1a5ef690c50134c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e857e expref: 13 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015398.932339:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304396800:192.168.202.56@tcp:105: 00000100:00100000:1.0:1786015398.932390:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748570a6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1786015398.934318:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c501345 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8577 expref: 13 pid: 6592 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015398.934341:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304396544:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015398.934357:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c50130d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8562 expref: 11 pid: 11384 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015398.934367:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304396672:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015398.934399:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003c68a413/0xb1a5ef690c50134c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e857e expref: 12 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015398.934427:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bec00, rc 0) 00000100:00100000:2.0:1786015398.935587:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+12:25867:x1872772280451968:12345-192.168.202.56@tcp:101:cat.0 Request processed in 11466us (11651us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015398.935599:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 240 00000100:00080000:2.0:1786015398.935643:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015398.943415:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304396800:192.168.202.56@tcp:105: 00010000:00010000:0.0:1786015398.943449:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015398.943511:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280452224:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 11301us (11771us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015398.943523:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 285 00000100:00100000:1.0:1786015398.949341:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015398.950200:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280452352 00000100:00100000:0.0:1786015398.950214:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280452352 00002000:00100000:0.0:1786015398.950278:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x12:0x0] (0->4095) req@ffff8b74b8f1b480 x1872772280452352/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:244/0 lens 488/0 e 0 to 0 dl 1786015409 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015398.950297:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74b8f1b480 with x1872772280452352 ext(0->4095) 00002000:00010000:0.0:1786015398.950304:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74b8f1b480 00000100:00100000:0.0:1786015398.950346:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 88 00000100:00100000:0.0:1786015398.950356:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280452352:12345-192.168.202.56@tcp:3:cat.0 00000100:00100000:0.0:1786015398.950613:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280452352:12345-192.168.202.56@tcp:3:cat.0 Request processed in 258us (1282us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786015398.950622:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 88 00002000:00100000:0.0:1786015398.950629:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x12:0x0] (0->4095) req@ffff8b74b8f1b480 x1872772280452352/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:244/0 lens 488/4536 e 0 to 0 dl 1786015409 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015398.950638:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74b8f1b480 with x1872772280452352 ext(0->4095) 00002000:00010000:0.0:1786015398.950641:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74b8f1b480 00000100:00100000:1.0:1786015398.959161:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015398.959493:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280452608 00000100:00100000:0.0:1786015398.959504:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280452608 00000100:00100000:0.0:1786015398.959591:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 188 00000100:00100000:0.0:1786015398.959604:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+86:25867:x1872772280452608:12345-192.168.202.56@tcp:35:cat.0 00000001:00080000:0.0:1786015398.961182:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967902 00000001:00080000:0.0:1786015398.961285:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967903 00000100:00100000:0.0:1786015398.961444:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+89:25867:x1872772280452608:12345-192.168.202.56@tcp:35:cat.0 Request processed in 1839us (2289us total) trans 4294967904 rc 0/0 00000100:00100000:0.0:1786015398.961455:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 188 00000020:00080000:0.0:1786015398.961460:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1786015399.007437:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015399.007657:0:17970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280452736 00000100:00100000:3.0:1786015399.007668:0:17970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280452736 00002000:00100000:3.0:1786015399.007726:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x12:0x0] (0->315) req@ffff8b74b8f1a300 x1872772280452736/t0(0) o4->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:245/0 lens 808/0 e 0 to 0 dl 1786015410 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015399.007739:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74b8f1a300 with x1872772280452736 ext(0->315) 00002000:00010000:3.0:1786015399.007746:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74b8f1a300 00000100:00100000:3.0:1786015399.007915:0:17970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 89 00000100:00100000:3.0:1786015399.007934:0:17970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280452736:12345-192.168.202.56@tcp:4:cat.0 00000100:00100000:3.0:1786015399.010098:0:17970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41677fca-39fb-471c-b582-96bce6540a36+14:2354:x1872772280452736:12345-192.168.202.56@tcp:4:cat.0 Request processed in 2157us (2662us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1786015399.010113:0:17970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 89 00002000:00100000:3.0:1786015399.010128:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x12:0x0] (0->315) req@ffff8b74b8f1a300 x1872772280452736/t4294967344(0) o4->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:245/0 lens 808/448 e 0 to 0 dl 1786015410 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015399.010138:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74b8f1a300 with x1872772280452736 ext(0->315) 00002000:00010000:3.0:1786015399.010145:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74b8f1a300 00000100:00100000:2.0:1786015399.060064:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015399.060118:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280452992 00000100:00100000:2.0:1786015399.060128:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280452992 00000100:00100000:2.0:1786015399.060185:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 934 00000100:00100000:2.0:1786015399.060195:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+89:25869:x1872772280452992:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015399.060235:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015399.060259:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c501353 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8585 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015399.060395:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50135a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015399.060422:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50135a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015399.060435:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50135a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015399.060447:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 316 00010000:00010000:2.0:1786015399.060581:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c501353 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8585 expref: 92 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015399.060613:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50135a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8585 expref: 91 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015399.060623:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8b7483ee6700) 00010000:00010000:2.0:1786015399.060627:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1786015399.060630:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf600, rc 0) 00000100:00100000:2.0:1786015399.060692:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+91:25869:x1872772280452992:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 499us (638us total) trans 4294967905 rc 0/0 00000100:00100000:2.0:1786015399.060700:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 934 00000100:00100000:3.0:1786015399.067739:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015399.072590:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280453120 00000100:00100000:0.0:1786015399.072609:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280453120 00000100:00100000:3.0:1786015399.073749:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 935 00000100:00100000:3.0:1786015399.073778:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+91:25869:x1872772280453120:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:3.0:1786015399.073856:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501368 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015399.073899:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015399.073913:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015399.074105:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015399.074114:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501368 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015399.074122:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501368 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015399.074128:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015399.074133:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501368 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015399.074141:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501368 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015399.074155:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8b7483ee6700) 00010000:00010000:3.0:1786015399.074159:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786015399.074164:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501368 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015399.074171:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501368 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015399.074262:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+91:25869:x1872772280453120:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 500us (6536us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015399.074276:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 935 00000100:00100000:3.0:1786015399.089145:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304396928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015399.089227:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015399.089314:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304396928 00000100:00100000:3.0:1786015399.089323:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304396928 00000100:00100000:3.0:1786015399.089373:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1786015399.089382:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304396928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015399.089435:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71368704 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015399.089484:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304396928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015399.089491:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1786015399.089542:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304396928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015399.134479:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015399.135228:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280453248 00000100:00100000:0.0:1786015399.135247:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280453248 00000100:00100000:0.0:1786015399.135349:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 936 00000100:00100000:0.0:1786015399.135362:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+91:25870:x1872772280453248:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015399.135386:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015399.135426:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c50136f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e858c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015399.135504:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afde00/0xb1a5ef690c501376 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015399.135520:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afde00/0xb1a5ef690c501376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015399.135534:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afde00/0xb1a5ef690c501376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015399.135714:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3b:0x0]: returning size 7680 00000004:00200000:0.0:1786015399.135719:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015399.135835:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afde00/0xb1a5ef690c501376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015399.137711:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c50136f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e858c expref: 93 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015399.137749:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afde00/0xb1a5ef690c501376 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e858c expref: 92 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015399.137792:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8b7499c59b00) 00010000:00010000:0.0:1786015399.137797:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015399.137801:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afde00, rc 0) 00000100:00100000:0.0:1786015399.138025:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+92:25870:x1872772280453248:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 2664us (3556us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015399.138048:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 936 00000100:00100000:1.0:1786015399.147487:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015399.153234:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280453632 00000100:00100000:2.0:1786015399.153253:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280453632 00000100:00100000:2.0:1786015399.153353:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 189 00000100:00100000:2.0:1786015399.153365:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+92:25870:x1872772280453632:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1786015399.153718:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+93:25870:x1872772280453632:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 354us (6245us total) trans 4294967906 rc 0/0 00000100:00100000:2.0:1786015399.153727:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 189 00000100:00100000:3.0:1786015399.162854:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015399.163128:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280453760 00000100:00100000:0.0:1786015399.163142:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280453760 00000100:00100000:0.0:1786015399.163220:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 40 00000100:00100000:0.0:1786015399.163233:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+93:25870:x1872772280453760:12345-192.168.202.56@tcp:103:lfs.0 00010000:00010000:0.0:1786015399.163252:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1786015399.163281:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50135a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8585 expref: 93 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015399.163315:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c5012ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e853f expref: 92 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015399.163332:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8b7483ee6700) 00010000:00010000:0.0:1786015399.163337:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015399.164230:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+91:25870:x1872772280453760:12345-192.168.202.56@tcp:103:lfs.0 Request processed in 992us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015399.164259:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 40 00000001:00080000:2.0:1786015399.167199:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967904 is committed 00000001:00080000:2.0:1786015399.167222:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967900 is committed 00000001:00080000:2.0:1786015399.167244:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967905 is committed 00000100:00100000:3.0:1786015399.169956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015399.170162:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280453888 00000100:00100000:2.0:1786015399.170179:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280453888 00000100:00100000:2.0:1786015399.170249:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 937 00000100:00100000:2.0:1786015399.170260:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+85:25870:x1872772280453888:12345-192.168.202.56@tcp:58:lfs.0 00000100:00100000:2.0:1786015399.170432:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+85:25870:x1872772280453888:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 172us (490us total) trans 0 rc -1/-1 00000100:00100000:2.0:1786015399.170441:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 937 00000001:00080000:0.0:1786015399.217974:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967342 is committed 00000001:00080000:0.0:1786015399.218013:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967343 is committed 00000001:00080000:0.0:1786015399.218036:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967344 is committed 00010000:00010000:1.0:1786015399.788505:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015400.819324:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015401.836551:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015402.055266:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015402.055392:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015402.055412:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015402.055434:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015402.055449:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015402.055493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015402.056090:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280454400 00000100:00100000:0.0:1786015402.056108:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280454400 00000100:00100000:0.0:1786015402.056205:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280454656 00000100:00100000:0.0:1786015402.056211:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280454656 00000100:00100000:2.0:1786015402.056240:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015402.056260:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280454272 00000100:00100000:0.0:1786015402.056266:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280454272 00000100:00100000:2.0:1786015402.056276:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280454784 00000100:00100000:2.0:1786015402.056285:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280454784 00000100:00100000:2.0:1786015402.056335:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 376 00000100:00080000:3.0:1786015402.056343:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015402.056347:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280454400:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015402.056405:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 377 00000100:00080000:3.0:1786015402.056438:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015402.056467:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280454656:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015402.056959:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280454400:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 613us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015402.056968:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 376 00000100:00100000:2.0:1786015402.056989:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 378 00000100:00100000:2.0:1786015402.056996:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280454784:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015402.057014:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280454784:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015402.057020:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 378 00000100:00100000:2.0:1786015402.057040:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 379 00000100:00100000:2.0:1786015402.057047:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280454272:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015402.057067:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280454272:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015402.057073:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 379 00000100:00100000:2.0:1786015402.057126:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280454016 00000100:00100000:2.0:1786015402.057131:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280454016 00000100:00100000:2.0:1786015402.057163:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 563 00000100:00100000:2.0:1786015402.057168:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280454016:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015402.057189:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280454016:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015402.057194:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 563 00000100:00100000:0.0:1786015402.057465:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280454656:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 251us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015402.057482:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 377 00000100:00100000:1.0:1786015402.058731:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280454144 00000100:00100000:1.0:1786015402.058746:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280454144 00000100:00100000:1.0:1786015402.058842:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280454528 00000100:00100000:1.0:1786015402.058845:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280454528 00000100:00100000:1.0:1786015402.058875:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 403 00000100:00100000:1.0:1786015402.058884:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+85:2354:x1872772280454144:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015402.058959:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+85:2354:x1872772280454144:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 76us (3702us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015402.058966:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 403 00000100:00100000:1.0:1786015402.058981:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 404 00000100:00100000:1.0:1786015402.058988:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+39:2354:x1872772280454528:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015402.059024:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+39:2354:x1872772280454528:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 36us (3530us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015402.059045:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 404 00000100:00080000:3.0:1786015402.059077:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015402.156261:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304397056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015402.156344:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015402.156799:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304397056 00000100:00100000:1.0:1786015402.156809:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304397056 00000100:00100000:1.0:1786015402.156880:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1786015402.156890:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304397056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015402.156931:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 76480512 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015402.156988:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304397056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015402.156995:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1786015402.157048:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967342 gen 2 00000100:00100000:1.0:1786015402.157083:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304397056:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786015402.157232:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786015402.861420:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015403.693021:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304397184:0@lo:400:kworker.0 00000100:00100000:0.0:1786015403.693111:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015403.693273:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304397184 00000100:00100000:3.0:1786015403.693283:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304397184 00000100:00100000:3.0:1786015403.693334:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1786015403.693343:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304397184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015403.693439:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304397312:0@lo:400:kworker.0 00000100:00100000:1.0:1786015403.693476:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015403.693534:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304397312 00000100:00100000:1.0:1786015403.693550:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304397312 00000100:00100000:1.0:1786015403.693582:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1786015403.693588:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304397312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015403.693629:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304397312:12345-0@lo:400:kworker.0 Request processed in 40us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015403.693637:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1786015403.693684:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304397312:0@lo:400:kworker.0 00000100:00100000:2.0:1786015403.700918:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304397568:0@lo:400:kworker.0 00000100:00100000:2.0:1786015403.700999:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015403.701039:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786015403.701046:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304397440:0@lo:400:kworker.0 00000100:00100000:2.0:1786015403.701073:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015403.701104:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304397568 00000100:00100000:2.0:1786015403.701111:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304397568 00000100:00100000:2.0:1786015403.701161:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1786015403.701170:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304397568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015403.701222:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304397568:12345-0@lo:400:kworker.0 Request processed in 53us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015403.701230:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1786015403.701254:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304397440 00000100:00100000:2.0:1786015403.701258:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304397440 00000100:00100000:2.0:1786015403.701294:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1786015403.701301:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304397440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015403.701335:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304397440:12345-0@lo:400:kworker.0 Request processed in 35us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015403.701341:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00080000:2.0:1786015403.701371:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015403.701386:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304397824:0@lo:400:kworker.0 00000100:00100000:2.0:1786015403.701413:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015403.701432:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786015403.701437:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304397696:0@lo:400:kworker.0 00000100:00100000:2.0:1786015403.701459:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015403.701484:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304397824 00000100:00100000:2.0:1786015403.701489:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304397824 00000100:00100000:2.0:1786015403.701535:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1786015403.701554:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304397824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015403.701590:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304397824:12345-0@lo:400:kworker.0 Request processed in 36us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015403.701596:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1786015403.701612:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304397696 00000100:00100000:2.0:1786015403.701616:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304397696 00000100:00100000:2.0:1786015403.701642:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1786015403.701648:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304397696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015403.701680:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304397696:12345-0@lo:400:kworker.0 Request processed in 32us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015403.701685:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00080000:2.0:1786015403.701702:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786015403.701705:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015403.701736:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304397440:0@lo:400:kworker.0 00000100:00100000:2.0:1786015403.701747:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304397568:0@lo:400:kworker.0 00000100:00100000:2.0:1786015403.701805:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304397696:0@lo:400:kworker.0 00000100:00100000:2.0:1786015403.701813:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304397824:0@lo:400:kworker.0 00000100:00100000:3.0:1786015403.705492:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304397184:12345-0@lo:400:kworker.0 Request processed in 12137us (12368us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015403.705510:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:0.0:1786015403.705900:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304397184:0@lo:400:kworker.0 00010000:00010000:0.0:1786015403.893666:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015404.203980:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304397952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015404.204070:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015404.204160:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304397952 00000100:00100000:1.0:1786015404.204168:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304397952 00000100:00100000:1.0:1786015404.204218:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1786015404.204227:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304397952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015404.204265:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71368704 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015404.204313:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304397952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015404.204320:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1786015404.204377:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304397952:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1786015404.279204:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967906 is committed 00000100:00100000:2.0:1786015404.476117:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015404.476195:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280454912 00000100:00100000:1.0:1786015404.476216:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280454912 00000100:00100000:1.0:1786015404.476278:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 938 00000100:00100000:1.0:1786015404.476285:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+39:25840:x1872772280454912:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1786015404.476397:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+39:25840:x1872772280454912:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 111us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015404.476404:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 938 00000100:00080000:2.0:1786015404.476936:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786015404.908120:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015404.972548:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015404.972557:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015404.972888:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 24 count 2 00000040:00080000:1.0:1786015404.972895:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015405.937806:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786015406.073603:0:18865:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12f: Restore a released file explicitly ========================================================== 07:23:24 (1786015404) 00000100:00100000:1.0:1786015406.336527:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015406.337365:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280455040 00000100:00100000:2.0:1786015406.337376:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280455040 00000100:00100000:2.0:1786015406.337473:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 939 00000100:00100000:2.0:1786015406.337483:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+39:26472:x1872772280455040:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1786015406.337732:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015406.337926:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+39:26472:x1872772280455040:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 443us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015406.337949:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 939 00000100:00100000:0.0:1786015406.374115:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015406.374239:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280455168 00000100:00100000:2.0:1786015406.374254:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280455168 00000100:00100000:2.0:1786015406.374395:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 940 00000100:00100000:2.0:1786015406.374410:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+84:26473:x1872772280455168:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015406.374440:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1786015406.377236:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786015406.378905:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50137d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8593 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.379865:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c501384 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.379885:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c501384 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.379900:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c501384 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.379920:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50138b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.379927:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50138b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.379934:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50138b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.381660:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c501384 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.381692:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c501384 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.381710:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c501384 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.381717:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015406.381722:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c501384 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.381729:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c501384 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.381747:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:2.0:1786015406.381749:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.381755:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c501384 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.381789:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c501384 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.381808:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50138b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.381814:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50138b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.381819:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50138b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.381823:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015406.381832:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50138b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.381839:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50138b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.381847:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd947e073 (ffff8b7499c59600) 00010000:00010000:2.0:1786015406.381850:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.381853:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50138b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.381859:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c50138b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.381911:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50137d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8593 expref: 85 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.381922:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:2.0:1786015406.381924:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.381927:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50137d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8593 expref: 85 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.381937:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2179200, rc 0) 00000100:00100000:2.0:1786015406.382041:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+84:26473:x1872772280455168:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 7633us (7938us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015406.382051:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 940 00000100:00100000:1.0:1786015406.387965:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015406.388103:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280455424 00000100:00100000:3.0:1786015406.388118:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280455424 00000100:00100000:3.0:1786015406.388230:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 941 00000100:00100000:3.0:1786015406.388243:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+84:26473:x1872772280455424:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:3.0:1786015406.388363:0:7673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015406.388407:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c5011d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e84eb expref: 84 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.388434:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:3.0:1786015406.388440:0:7673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015406.388868:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501392 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.388886:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501211 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8500 expref: 38 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.388898:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501392 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.388941:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501211 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8500 expref: 38 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.388958:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501211 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8500 expref: 38 pid: 12526 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015406.388975:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8caca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304398080:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015406.389110:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482dfd180 going to sleep for 11 seconds 00000100:00100000:2.0:1786015406.394979:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8caca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304398080:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015406.395024:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501392 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015406.395471:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015406.395525:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280455552 00000100:00100000:2.0:1786015406.395534:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280455552 00010000:00010000:2.0:1786015406.395569:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501211 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8500 expref: 39 pid: 12526 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015406.395620:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 286 00000100:00100000:2.0:1786015406.395630:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+39:2354:x1872772280455552:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015406.395646:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015406.395654:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501211 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8500 expref: 39 pid: 12526 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.395663:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501211 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8500 expref: 39 pid: 12526 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.395682:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501211 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8500 expref: 39 pid: 12526 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.395706:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:2.0:1786015406.395710:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501392 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.395717:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501392 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.395723:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501392 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.395749:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015406.395848:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501392 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015406.395849:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+38:2354:x1872772280455552:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 217us (422us total) trans 0 rc 0/0 00010000:00010000:3.0:1786015406.395874:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501392 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015406.395882:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 286 00010000:00010000:3.0:1786015406.395914:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501399 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.395928:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501399 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.395939:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501399 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015406.400210:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 512 00010000:00010000:2.0:1786015406.400232:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501392 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.400244:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501392 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.400250:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501392 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.400256:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015406.400260:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501392 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.400268:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501392 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.400286:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:2.0:1786015406.400289:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.400293:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501392 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.400299:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501392 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015406.400323:0:7673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000003041afd reply state 00000000c4fc1966 transno 4294967907 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501399 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015406.400343:0:7673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786015406.400473:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+85:26473:x1872772280455424:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 12229us (12520us total) trans 4294967907 rc 0/0 00000100:00100000:2.0:1786015406.400481:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 941 00010000:00010000:0.0:1786015406.404964:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501399 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015406.404990:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501399 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015406.405002:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501399 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015406.405007:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015406.405011:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501399 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015406.405019:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501399 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015406.405058:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd947e073 (ffff8b74a04b5500) 00010000:00010000:0.0:1786015406.405061:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015406.405066:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501399 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015406.405072:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501399 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015406.405626:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015406.405733:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280455680 00000100:00100000:2.0:1786015406.405751:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280455680 00000100:00100000:2.0:1786015406.405894:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 942 00000100:00100000:2.0:1786015406.405906:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+84:26474:x1872772280455680:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1786015406.405932:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015406.405959:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5013a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e859a expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.406027:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5013a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.406041:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5013a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.406053:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5013a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015406.406114:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1786015406.406119:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 25 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015406.406147:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5013a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.406172:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5013a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e859a expref: 86 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.406190:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5013a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e859a expref: 85 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.406220:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:2.0:1786015406.406223:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015406.406226:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf800, rc 0) 00000100:00100000:2.0:1786015406.406307:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+85:26474:x1872772280455680:12345-192.168.202.56@tcp:101:bash.0 Request processed in 403us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015406.406315:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 942 00000100:00100000:3.0:1786015406.413305:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015406.413419:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280455808 00000100:00100000:2.0:1786015406.413435:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280455808 00000100:00100000:2.0:1786015406.413577:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 943 00000100:00100000:2.0:1786015406.413589:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+85:26474:x1872772280455808:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1786015406.413623:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015406.413679:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5013ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e85a1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.413792:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5013b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.413806:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5013b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.413819:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5013b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.413835:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5013bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.413842:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5013bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.413910:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5013bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414045:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c5013c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414055:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c5013c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414062:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c5013c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015406.414095:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 512 00000004:00200000:2.0:1786015406.414099:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015406.414124:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c5013c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414138:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5013b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414144:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5013b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414150:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5013b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414156:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2179200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015406.414160:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5013b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414167:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5013b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414188:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:2.0:1786015406.414191:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.414195:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5013b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414202:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c5013b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414217:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5013bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414224:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5013bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414230:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5013bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414235:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015406.414237:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5013bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414244:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5013bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414251:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd947e073 (ffff8b7499c59500) 00010000:00010000:2.0:1786015406.414253:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.414256:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5013bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414261:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c5013bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414319:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c5013ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85a1 expref: 87 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414344:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6c00/0xb1a5ef690c5013c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85a1 expref: 86 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.414352:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:2.0:1786015406.414354:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786015406.414356:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6c00, rc 0) 00000100:00100000:2.0:1786015406.414435:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+86:26474:x1872772280455808:12345-192.168.202.56@tcp:101:bash.0 Request processed in 848us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015406.414442:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 943 00000100:00100000:0.0:1786015406.417473:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015406.417991:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280455936 00000100:00100000:2.0:1786015406.418007:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280455936 00000100:00100000:2.0:1786015406.418095:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 944 00000100:00100000:2.0:1786015406.418106:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+86:26474:x1872772280455936:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1786015406.418135:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015406.418163:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5013ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e85a8 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.418264:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.418281:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.418412:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421089:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421113:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421126:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421215:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421223:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421230:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421236:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015406.421240:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421248:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421260:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:2.0:1786015406.421264:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.421269:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421275:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421303:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421310:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421315:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421320:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e7e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015406.421324:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421344:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421352:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff8b7499c59100) 00010000:00010000:2.0:1786015406.421355:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.421358:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421362:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421412:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5013ca lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85a8 expref: 87 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421434:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:2.0:1786015406.421436:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.421456:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5013ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85a8 expref: 87 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.421467:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6600, rc 0) 00000100:00100000:2.0:1786015406.421554:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+86:26474:x1872772280455936:12345-192.168.202.56@tcp:101:bash.0 Request processed in 3449us (4094us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015406.421564:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 944 00000100:00100000:3.0:1786015406.435551:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015406.435681:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280456064 00000100:00100000:1.0:1786015406.435691:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280456064 00000100:00100000:1.0:1786015406.435758:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 945 00000100:00100000:1.0:1786015406.435818:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+38:26475:x1872772280456064:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:1.0:1786015406.435841:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015406.435864:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5013df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e85af expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.435930:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c5013e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.435945:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c5013e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.435957:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c5013e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015406.436042:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1786015406.436047:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 25 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015406.436075:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c5013e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.436099:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5013df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85af expref: 40 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.436118:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c5013e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85af expref: 39 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.436126:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:1.0:1786015406.436129:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015406.436133:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46000, rc 0) 00000100:00100000:1.0:1786015406.436189:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+39:26475:x1872772280456064:12345-192.168.202.56@tcp:101:rm.0 Request processed in 374us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015406.436196:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 945 00000100:00100000:3.0:1786015406.442411:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015406.442557:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280456192 00000100:00100000:2.0:1786015406.442567:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280456192 00000100:00100000:2.0:1786015406.442623:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 946 00000100:00100000:2.0:1786015406.442633:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+39:26475:x1872772280456192:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015406.442654:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015406.442676:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5013ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e85b6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.442737:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.442751:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.442804:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.442821:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.442828:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.442834:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.442955:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501402 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.442965:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.442973:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015406.443001:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 512 00000004:00200000:2.0:1786015406.443005:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015406.443036:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.443047:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.443054:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.443061:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.443067:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e7e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015406.443071:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.443078:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.443090:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:2.0:1786015406.443098:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.443103:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.443110:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5013f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.443123:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.443129:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.443136:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.443141:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015406.443144:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.443150:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.443157:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd947e073 (ffff8b7499c59100) 00010000:00010000:2.0:1786015406.443159:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.443161:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.443167:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5013fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.443192:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5013ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85b6 expref: 41 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.443215:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178000/0xb1a5ef690c501402 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85b6 expref: 40 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.443223:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:2.0:1786015406.443225:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786015406.443227:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2178000, rc 0) 00000100:00100000:2.0:1786015406.443388:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+40:26475:x1872772280456192:12345-192.168.202.56@tcp:101:rm.0 Request processed in 756us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015406.443396:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 946 00000100:00100000:0.0:1786015406.449566:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015406.449651:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280456320 00000100:00100000:2.0:1786015406.449662:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280456320 00000100:00100000:2.0:1786015406.449724:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 947 00000100:00100000:2.0:1786015406.449733:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+40:26475:x1872772280456320:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015406.449757:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015406.449927:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c501409 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e85bd expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.449998:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501410 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450013:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501410 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450036:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501410 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450056:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501417 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450080:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501417 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450088:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501417 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450150:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501410 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450157:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501410 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450164:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501410 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450169:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2179200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015406.450174:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501410 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450180:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501410 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450192:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:2.0:1786015406.450195:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.450199:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501410 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450206:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c501410 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450217:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501417 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450228:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501417 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450234:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501417 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450239:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015406.450242:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501417 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450248:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501417 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450254:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff8b7499c59500) 00010000:00010000:2.0:1786015406.450257:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.450259:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501417 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450266:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501417 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450521:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c501409 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85bd expref: 41 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450533:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:2.0:1786015406.450536:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.450540:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c501409 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85bd expref: 41 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.450562:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2178c00, rc 0) 00000100:00100000:3.0:1786015406.450812:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+40:26475:x1872772280456320:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1078us (1253us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015406.450822:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 947 00000100:00100000:3.0:1786015406.454700:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015406.454827:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280456448 00000100:00100000:2.0:1786015406.454838:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280456448 00000100:00100000:2.0:1786015406.454889:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 948 00000100:00100000:2.0:1786015406.454899:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+40:26475:x1872772280456448:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015406.454919:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015406.454942:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c50141e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e85c4 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455045:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501425 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455059:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501425 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455070:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501425 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455084:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50142c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455090:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50142c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455095:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50142c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455161:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501425 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455185:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501425 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455191:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501425 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455197:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015406.455201:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501425 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455230:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501425 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455244:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:2.0:1786015406.455246:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.455251:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501425 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455257:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501425 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455272:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50142c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455277:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50142c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455283:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50142c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455288:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015406.455310:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50142c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455316:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50142c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455323:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff8b7499c59a00) 00010000:00010000:2.0:1786015406.455326:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.455337:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50142c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455343:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50142c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455378:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c50141e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85c4 expref: 41 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455388:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:2.0:1786015406.455390:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.455394:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c50141e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85c4 expref: 41 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.455404:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7381935200, rc 0) 00000100:00100000:2.0:1786015406.455476:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+40:26475:x1872772280456448:12345-192.168.202.56@tcp:101:rm.0 Request processed in 578us (786us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015406.455485:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 948 00000100:00100000:1.0:1786015406.469240:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015406.469437:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280456576 00000100:00100000:2.0:1786015406.469453:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280456576 00000100:00100000:2.0:1786015406.469530:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 949 00000100:00100000:2.0:1786015406.469540:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+40:26476:x1872772280456576:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015406.469575:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015406.469599:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501433 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e85cb expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469672:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50143a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469686:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50143a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469699:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50143a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469715:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501441 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469722:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469728:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469860:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50143a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469868:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50143a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469875:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50143a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469881:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015406.469892:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50143a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469900:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50143a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469914:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:2.0:1786015406.469917:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.469922:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50143a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469928:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50143a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469941:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469947:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501441 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469953:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501441 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469957:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015406.469960:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501441 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469965:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501441 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469972:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff8b7499c59a00) 00010000:00010000:2.0:1786015406.469975:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.469986:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501441 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.469992:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501441 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.470101:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501433 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85cb expref: 41 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.470113:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:2.0:1786015406.470115:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015406.470119:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501433 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85cb expref: 41 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.470129:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906800, rc 0) 00000100:00100000:2.0:1786015406.470280:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+40:26476:x1872772280456576:12345-192.168.202.56@tcp:101:cp.0 Request processed in 740us (1060us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015406.470425:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 949 00000100:00100000:2.0:1786015406.473286:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015406.480414:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280456704 00000100:00100000:3.0:1786015406.480438:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280456704 00000100:00100000:3.0:1786015406.483676:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 950 00000100:00100000:3.0:1786015406.483704:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+40:26476:x1872772280456704:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015406.483729:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015406.483790:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501448 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e85d2 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.483877:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50144f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.483892:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50144f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.483904:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50144f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.483920:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501456 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.483927:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.483933:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.483998:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50144f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.484007:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50144f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.484013:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50144f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.484019:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbdc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015406.484024:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50144f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.484043:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50144f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.484056:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:3.0:1786015406.484059:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015406.484065:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50144f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.484071:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50144f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.484086:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.484092:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501456 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.484098:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501456 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.484103:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015406.484105:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501456 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.484111:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501456 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.484118:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff8b74a04b5900) 00010000:00010000:3.0:1786015406.484121:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015406.484124:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501456 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.484138:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501456 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.484280:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501448 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85d2 expref: 41 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.484367:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:3.0:1786015406.484370:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015406.484375:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501448 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85d2 expref: 41 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.484386:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd400, rc 0) 00000100:00100000:3.0:1786015406.484475:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+40:26476:x1872772280456704:12345-192.168.202.56@tcp:101:cp.0 Request processed in 785us (11196us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015406.484481:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 950 00000100:00100000:3.0:1786015406.491103:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015406.491246:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280456960 00000100:00100000:1.0:1786015406.491257:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280456960 00000100:00100000:1.0:1786015406.491342:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 951 00000100:00100000:1.0:1786015406.491353:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+40:26476:x1872772280456960:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015406.491378:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015406.491407:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50145d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e85d9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.491720:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501464 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.491751:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501464 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.492116:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501464 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.492135:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50146b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.492143:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50146b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.492150:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50146b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786015406.493624:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15:0x0], index 1: 0 00010000:00010000:1.0:1786015406.494721:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c501472 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.494740:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c501472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.494753:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c501472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.495160:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501464 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.495168:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501464 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.495175:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501464 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.495195:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015406.495199:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501464 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.495205:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501464 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.495218:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:1.0:1786015406.495221:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015406.495226:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501464 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.495232:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501464 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786015406.495246:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001a2f162f reply state 00000000fe852390 transno 4294967908 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50146b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015406.495255:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786015406.495372:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50145d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85d9 expref: 43 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.495389:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c501472 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85d9 expref: 42 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.495398:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:1.0:1786015406.495401:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015406.495403:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46c00, rc 0) 00000100:00100000:1.0:1786015406.495595:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+43:26476:x1872772280456960:12345-192.168.202.56@tcp:101:cp.0 Request processed in 4242us (4500us total) trans 4294967908 rc 0/0 00000100:00100000:1.0:1786015406.495611:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 951 00010000:00010000:0.0:1786015406.497633:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50146b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015406.497650:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50146b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015406.497657:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50146b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015406.497664:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015406.497668:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50146b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015406.497675:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50146b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015406.497689:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff8b7483ee6d00) 00010000:00010000:0.0:1786015406.497691:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015406.497696:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50146b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015406.497718:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50146b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015406.503566:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015406.503993:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280457088 00000100:00100000:0.0:1786015406.504004:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280457088 00000100:00100000:0.0:1786015406.504232:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 241 00000100:00100000:0.0:1786015406.504245:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280457088:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015406.504265:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015406.504296:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c796b6be/0xb1a5ef690c501480 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e85e0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015406.504336:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786015406.504359:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=641s v=(0 0) 00010000:00010000:0.0:1786015406.504365:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015406.504376:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c796b6be/0xb1a5ef690c501480 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e0 expref: 11 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015406.504395:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c796b6be/0xb1a5ef690c501480 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e0 expref: 11 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015406.504409:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd400, rc 0) 00000100:00100000:0.0:1786015406.504480:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280457088:12345-192.168.202.56@tcp:101:cp.0 Request processed in 238us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015406.504488:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 241 00000100:00080000:3.0:1786015406.504747:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015406.509965:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015406.510116:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280457216 00000100:00100000:0.0:1786015406.510126:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280457216 00000100:00100000:0.0:1786015406.510228:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 242 00000100:00100000:0.0:1786015406.510238:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:26476:x1872772280457216:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015406.510256:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015406.510275:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033a84cb9/0xb1a5ef690c501487 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e85e7 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015406.510316:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c796b6be/0xb1a5ef690c501480 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e0 expref: 12 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015406.510326:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015406.510340:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015406.510347:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033a84cb9/0xb1a5ef690c501487 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e7 expref: 12 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015406.510381:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c796b6be/0xb1a5ef690c501480 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e0 expref: 12 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015406.510395:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c796b6be/0xb1a5ef690c501480 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e0 expref: 12 pid: 11384 timeout: 741 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015406.510408:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304398208:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015406.510493:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7491f64180 going to sleep for 11 seconds 00000100:00100000:0.0:1786015406.514107:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304398208:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015406.514146:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000033a84cb9/0xb1a5ef690c501487 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e7 expref: 12 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015406.514187:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd000, rc 0) 00000100:00100000:0.0:1786015406.514280:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:26476:x1872772280457216:12345-192.168.202.56@tcp:101:cp.0 Request processed in 4043us (4325us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015406.514289:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 242 00000100:00100000:3.0:1786015406.520547:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015406.520739:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280457344 00000100:00100000:2.0:1786015406.520750:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280457344 00010000:00010000:2.0:1786015406.520851:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c796b6be/0xb1a5ef690c501480 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e0 expref: 12 pid: 11384 timeout: 741 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015406.520886:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 287 00000100:00100000:2.0:1786015406.520895:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b024dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280457344:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015406.520910:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015406.520947:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c796b6be/0xb1a5ef690c501480 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e0 expref: 12 pid: 11384 timeout: 741 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.520960:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c796b6be/0xb1a5ef690c501480 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e0 expref: 12 pid: 11384 timeout: 741 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.520983:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c796b6be/0xb1a5ef690c501480 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e0 expref: 12 pid: 11384 timeout: 741 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.521001:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015406.521005:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015406.521013:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000033a84cb9/0xb1a5ef690c501487 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e7 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.522019:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033a84cb9/0xb1a5ef690c501487 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e7 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.522085:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000033a84cb9/0xb1a5ef690c501487 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e7 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015406.522101:0:5781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11a8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1872772304398336:192.168.202.56@tcp:105: 00000100:00100000:2.0:1786015406.522272:0:5781:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b8e29000 going to sleep for 11 seconds 00000100:00100000:2.0:1786015406.530593:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015406.530723:0:5781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11a8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1872772304398336:192.168.202.56@tcp:105: 00010000:00010000:1.0:1786015406.530751:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015406.530868:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b024dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280457344:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 9973us (10331us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015406.530880:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 287 00000100:00100000:0.0:1786015406.535122:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280457600 00000100:00100000:0.0:1786015406.535138:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280457600 00000100:00100000:0.0:1786015406.535300:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 190 00000100:00100000:0.0:1786015406.535313:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916b4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+42:26476:x1872772280457600:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:0.0:1786015406.535691:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916b4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+43:26476:x1872772280457600:12345-192.168.202.56@tcp:35:cp.0 Request processed in 380us (5108us total) trans 4294967909 rc 0/0 00000100:00100000:0.0:1786015406.535700:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 190 00000100:00100000:2.0:1786015406.596044:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015406.596164:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280457728 00000100:00100000:1.0:1786015406.596179:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280457728 00000100:00100000:1.0:1786015406.596263:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 952 00000100:00100000:1.0:1786015406.596276:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+86:26479:x1872772280457728:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015406.596308:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015406.596350:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50148e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e85ee expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.596580:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501495 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.596599:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501495 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.596614:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501495 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.596632:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50149c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.596640:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50149c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.596670:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50149c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.596865:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5014a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.596874:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5014a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.596881:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5014a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015406.596924:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00000004:00200000:1.0:1786015406.596929:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015406.596952:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5014a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.596967:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5014a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.596978:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501495 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.596986:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501495 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.596995:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501495 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.597002:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015406.597006:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501495 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.597022:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501495 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.597038:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:1.0:1786015406.597041:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015406.597046:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501495 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.597052:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501495 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.597067:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50149c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.597073:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50149c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.597078:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50149c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.597083:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015406.597085:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50149c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.597091:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50149c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.597097:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff8b7483ee6b00) 00010000:00010000:1.0:1786015406.597099:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015406.597102:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50149c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.597116:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c50149c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.597153:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50148e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85ee expref: 88 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.597168:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5014a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85ee expref: 87 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015406.597175:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:1.0:1786015406.597178:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015406.597181:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47600, rc 0) 00000100:00100000:1.0:1786015406.597268:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+87:26479:x1872772280457728:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 995us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015406.597277:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 952 00000100:00100000:1.0:1786015406.600925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015406.601223:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280457856 00000100:00100000:2.0:1786015406.601239:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280457856 00000100:00100000:2.0:1786015406.601360:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 243 00000100:00100000:2.0:1786015406.601373:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280457856:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015406.601398:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015406.601584:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d05d36f/0xb1a5ef690c5014aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e85f5 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015406.601672:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304398464:192.168.202.56@tcp:106: 00000100:00100000:2.0:1786015406.601864:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b8e29000 going to sleep for 11 seconds 00000100:00080000:3.0:1786015406.601967:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1786015406.604162:0:6592:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1786015406.604173:0:6592:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb mtime: 0 -> 1786015406 00002000:00010000:2.0:1786015406.604176:0:6592:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb atime: 0 -> 1786015406 00002000:00010000:2.0:1786015406.604178:0:6592:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb ctime: 0 -> 1786015406 00000100:00100000:2.0:1786015406.604209:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304398464:192.168.202.56@tcp:106: 00010000:00010000:2.0:1786015406.604253:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008d05d36f/0xb1a5ef690c5014aa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85f5 expref: 13 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.604285:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d05d36f/0xb1a5ef690c5014aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85f5 expref: 13 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.604301:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907200, rc 0) 00000100:00100000:2.0:1786015406.604386:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280457856:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3016us (3475us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015406.604396:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 243 00000100:00100000:1.0:1786015406.610080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015406.610214:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280457984 00000100:00100000:3.0:1786015406.610229:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280457984 00000100:00100000:3.0:1786015406.610304:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 953 00000100:00100000:3.0:1786015406.610316:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+87:26479:x1872772280457984:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015406.610360:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015406.610390:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5014b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e85fc expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.610531:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5014b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.610549:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5014b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.610564:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5014b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015406.610649:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 512 00000004:00200000:3.0:1786015406.610654:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015406.610817:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5014b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.610853:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5014b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85fc expref: 89 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.610877:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5014b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85fc expref: 88 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015406.610887:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:3.0:1786015406.610891:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015406.610895:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbce00, rc 0) 00000100:00100000:3.0:1786015406.611035:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+88:26479:x1872772280457984:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 720us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015406.611043:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 953 00000100:00100000:2.0:1786015406.617242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015406.617363:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280458112 00000100:00100000:0.0:1786015406.617377:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280458112 00000100:00100000:0.0:1786015406.617607:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 244 00000100:00100000:0.0:1786015406.617621:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2351:x1872772280458112:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015406.617648:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015406.617674:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b59939b/0xb1a5ef690c5014bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8603 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015406.617757:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304398592:192.168.202.56@tcp:106: 00000100:00100000:0.0:1786015406.617979:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7491f64300 going to sleep for 11 seconds 00000100:00100000:2.0:1786015406.620640:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304398592:192.168.202.56@tcp:106: 00010000:00010000:2.0:1786015406.620717:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002b59939b/0xb1a5ef690c5014bf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8603 expref: 13 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.620750:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b59939b/0xb1a5ef690c5014bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8603 expref: 13 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015406.620786:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afce00, rc 0) 00000100:00100000:2.0:1786015406.620863:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2351:x1872772280458112:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3245us (3638us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015406.620874:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 244 00000100:00100000:1.0:1786015406.624599:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015406.625214:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280458368 00000100:00100000:2.0:1786015406.625231:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280458368 00000100:00100000:2.0:1786015406.625306:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 954 00000100:00100000:2.0:1786015406.625319:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+88:26479:x1872772280458368:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:2.0:1786015406.625915:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].24, 136 off11456 00000100:00100000:2.0:1786015406.626054:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+88:26479:x1872772280458368:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 736us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015406.626063:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 954 00010000:00010000:3.0:1786015406.956817:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015407.024754:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015407.024793:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015407.024848:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 25 count 3 00000040:00080000:0.0:1786015407.024866:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015407.027716:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304398720:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786015407.029041:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486543e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786015407.047116:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015407.047247:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304398720:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015407.049007:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280458496 00000100:00100000:3.0:1786015407.049037:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280458496 00000100:00100000:3.0:1786015407.049130:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 955 00000100:00100000:3.0:1786015407.049144:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+43:26489:x1872772280458496:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015407.049213:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x19:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015407.049394:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+43:26489:x1872772280458496:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 252us (2294us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015407.049404:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 955 00000100:00100000:2.0:1786015407.063910:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015407.064098:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280458752 00000100:00100000:1.0:1786015407.064110:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280458752 00000100:00100000:1.0:1786015407.064185:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 956 00000100:00100000:1.0:1786015407.064205:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+43:26489:x1872772280458752:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015407.064237:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015407.064381:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c5014c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e860a expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.065448:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5014cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.065470:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5014cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.065486:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5014cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015407.065502:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00010000:00010000:0.0:1786015407.065851:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c5014c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e860a expref: 46 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.065886:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5014cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e860a expref: 45 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.065899:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:0.0:1786015407.065903:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015407.065908:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd200, rc 0) 00000100:00100000:0.0:1786015407.066003:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:26489:x1872772280458752:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1807us (2108us total) trans 4294967910 rc 0/0 00000100:00100000:0.0:1786015407.066014:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 956 00000100:00100000:1.0:1786015407.071574:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015407.071623:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280458880 00000100:00100000:1.0:1786015407.071626:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015407.071641:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280458880 00000100:00100000:1.0:1786015407.071664:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280459008 00000100:00100000:1.0:1786015407.071667:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280459008 00000100:00100000:0.0:1786015407.071726:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 245 00000100:00100000:0.0:1786015407.071739:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280458880:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00000100:00100000:1.0:1786015407.071798:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00100000:1.0:1786015407.071805:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+45:2352:x1872772280459008:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015407.071818:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015407.071833:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5014db lrc: 3/1,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.071849:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5014cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e860a expref: 45 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.071858:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000033a84cb9/0xb1a5ef690c501487 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e7 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.071868:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x15:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786015407.071870:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:1.0:1786015407.071875:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015407.071884:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015407.071891:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5014db lrc: 4/1,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.071935:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000033a84cb9/0xb1a5ef690c501487 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e7 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015407.071944:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2352:x1872772280459008:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 141us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015407.071952:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 41 00010000:00010000:0.0:1786015407.071952:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000033a84cb9/0xb1a5ef690c501487 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e7 expref: 11 pid: 6590 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015407.071970:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304398848:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015407.072034:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486543c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786015407.080453:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304398848:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015407.080494:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5014db lrc: 3/1,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015407.084189:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015407.084376:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280459136 00000100:00100000:2.0:1786015407.084402:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280459136 00002000:00100000:2.0:1786015407.084483:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x15:0x0] (0->157) req@ffff8b74af06b100 x1872772280459136/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:253/0 lens 648/0 e 0 to 0 dl 1786015418 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015407.084496:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74af06b100 with x1872772280459136 ext(0->157) 00010000:00010000:2.0:1786015407.084508:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000033a84cb9/0xb1a5ef690c501487 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e7 expref: 12 pid: 6590 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.084529:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000033a84cb9/0xb1a5ef690c501487 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e7 expref: 12 pid: 6590 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015407.084538:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b74af06b100 00000100:00100000:2.0:1786015407.084579:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:2.0:1786015407.084590:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2352:x1872772280459136:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:2.0:1786015407.085549:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2352:x1872772280459136:12345-192.168.202.56@tcp:4:cp.0 Request processed in 952us (1362us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1786015407.085563:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00002000:00100000:2.0:1786015407.085576:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x15:0x0] (0->157) req@ffff8b74af06b100 x1872772280459136/t4294967351(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:253/0 lens 648/448 e 0 to 0 dl 1786015418 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015407.085587:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74af06b100 with x1872772280459136 ext(0->157) 00010000:00010000:2.0:1786015407.085599:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000033a84cb9/0xb1a5ef690c501487 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e7 expref: 14 pid: 6590 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.085625:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000033a84cb9/0xb1a5ef690c501487 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e7 expref: 14 pid: 6590 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015407.085646:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b74af06b100 00000100:00100000:0.0:1786015407.090996:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015407.091043:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280459264 00000100:00100000:0.0:1786015407.091056:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280459264 00010000:00010000:0.0:1786015407.091120:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000033a84cb9/0xb1a5ef690c501487 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e7 expref: 14 pid: 6590 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015407.091165:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 288 00000100:00100000:0.0:1786015407.091185:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2351:x1872772280459264:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015407.091218:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015407.091251:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000033a84cb9/0xb1a5ef690c501487 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e7 expref: 14 pid: 6590 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.091531:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000033a84cb9/0xb1a5ef690c501487 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e7 expref: 14 pid: 6590 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.091567:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033a84cb9/0xb1a5ef690c501487 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85e7 expref: 14 pid: 6590 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.091590:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015407.091596:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015407.091604:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5014db lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.091616:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5014db lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.091691:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015407.091786:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2351:x1872772280459264:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 603us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015407.091795:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 288 00010000:00010000:2.0:1786015407.095846:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5014db lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.096019:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5014db lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.096084:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5014db lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.096094:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5014db lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.096104:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5014db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.096111:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc600 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015407.096117:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5014db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.096126:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5014db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.096151:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5014db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.096183:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5014db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015407.096453:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280458880:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 24710us (24888us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015407.096465:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 245 00000100:00100000:0.0:1786015407.109132:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015407.109379:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280459520 00000100:00100000:2.0:1786015407.109395:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280459520 00000100:00100000:2.0:1786015407.109475:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 957 00000100:00100000:2.0:1786015407.109490:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+44:26489:x1872772280459520:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015407.110884:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+44:26489:x1872772280459520:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 1376us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015407.110899:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 957 00000100:00100000:3.0:1786015407.120655:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015407.120718:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280459648 00000100:00100000:2.0:1786015407.120733:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280459648 00000100:00100000:2.0:1786015407.121126:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 246 00000100:00100000:2.0:1786015407.121145:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2351:x1872772280459648:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015407.121166:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015407.121193:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d05d36f/0xb1a5ef690c5014e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8611 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015407.121224:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 158, mtime: 0x6a746eae, atime: 0x0, ctime: 0x6a746eae, blocks: 0x1 00010000:00010000:2.0:1786015407.121248:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=642s v=(0 0) 00010000:00010000:2.0:1786015407.121254:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015407.121274:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d05d36f/0xb1a5ef690c5014e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8611 expref: 13 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.121293:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008d05d36f/0xb1a5ef690c5014e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8611 expref: 13 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.121307:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907200, rc 0) 00000100:00100000:2.0:1786015407.121877:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2351:x1872772280459648:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 734us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015407.121890:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 246 00000100:00100000:0.0:1786015407.125670:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015407.125884:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280459904 00000100:00100000:2.0:1786015407.125899:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280459904 00000100:00100000:2.0:1786015407.126075:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 958 00000100:00100000:2.0:1786015407.126090:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:26489:x1872772280459904:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015407.126215:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:26489:x1872772280459904:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 129us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015407.126223:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 958 00000100:00100000:1.0:1786015407.130025:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015407.130256:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280460032 00000100:00100000:2.0:1786015407.130268:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280460032 00002000:00100000:2.0:1786015407.130333:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x15:0x0] (0->4095) req@ffff8b74af06bb80 x1872772280460032/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:253/0 lens 488/0 e 0 to 0 dl 1786015418 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015407.130345:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74af06bb80 with x1872772280460032 ext(0->4095) 00002000:00010000:2.0:1786015407.130351:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74af06bb80 00000100:00100000:2.0:1786015407.130394:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 90 00000100:00100000:2.0:1786015407.130410:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280460032:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1786015407.130721:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280460032:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 316us (704us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786015407.130730:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 90 00002000:00100000:2.0:1786015407.130738:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x15:0x0] (0->4095) req@ffff8b74af06bb80 x1872772280460032/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:253/0 lens 488/4536 e 0 to 0 dl 1786015418 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015407.130746:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74af06bb80 with x1872772280460032 ext(0->4095) 00002000:00010000:2.0:1786015407.130750:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74af06bb80 00000100:00100000:0.0:1786015407.146106:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015407.146956:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280460160 00000100:00100000:1.0:1786015407.146971:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280460160 00000100:00100000:1.0:1786015407.147028:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 959 00000100:00100000:1.0:1786015407.147037:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+44:26489:x1872772280460160:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015407.147060:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015407.147081:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c5014e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8618 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.147134:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5014f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.147147:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5014f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.147158:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5014f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.147251:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c5014e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8618 expref: 46 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.147268:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5014f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8618 expref: 45 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.147277:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:1.0:1786015407.147279:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015407.147283:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47c00, rc 0) 00000100:00100000:1.0:1786015407.147367:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:26489:x1872772280460160:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 330us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015407.147375:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 959 00000100:00100000:0.0:1786015407.151114:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015407.151241:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280460288 00000100:00100000:3.0:1786015407.151251:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280460288 00000100:00100000:3.0:1786015407.151305:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 960 00000100:00100000:3.0:1786015407.151314:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+45:26489:x1872772280460288:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015407.151361:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x19:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015407.151470:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+45:26489:x1872772280460288:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 156us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015407.151486:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 960 00000100:00100000:0.0:1786015407.154699:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015407.155463:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280460416 00000100:00100000:1.0:1786015407.155473:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280460416 00000100:00100000:1.0:1786015407.155543:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 247 00000100:00100000:1.0:1786015407.155552:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280460416:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015407.155597:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c5014f7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.155639:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015407.155643:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015407.155650:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c5014f7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.155671:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c5014f7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.155704:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c5014f7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.155713:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c5014f7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.155722:0:14547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c5014f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.155729:0:14547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46e00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015407.155734:0:14547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c5014f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.155742:0:14547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c5014f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.155757:0:14547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c5014f7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.155797:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c5014f7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015407.155876:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280460416:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 324us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015407.155885:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 247 00000100:00100000:3.0:1786015407.160158:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015407.160244:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280460672 00000100:00100000:0.0:1786015407.160253:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280460672 00000100:00100000:0.0:1786015407.160314:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 961 00000100:00100000:0.0:1786015407.160335:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+45:26489:x1872772280460672:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786015407.160416:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5014fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.160434:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5014f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8618 expref: 45 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.160442:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5014fe lrc: 4/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.160480:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5014f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8618 expref: 45 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.160493:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5014f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8618 expref: 45 pid: 12526 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015407.160508:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304398976:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015407.160594:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486543c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786015407.169851:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015407.169898:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015407.169923:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015407.169950:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280461056 00000100:00100000:2.0:1786015407.169959:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280461056 00000100:00100000:2.0:1786015407.170008:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 408 00000100:00100000:2.0:1786015407.170018:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+88:2352:x1872772280461056:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015407.170094:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+88:2352:x1872772280461056:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 77us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015407.170101:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 408 00000100:00100000:0.0:1786015407.170263:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304398976:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015407.170289:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5014fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015407.170369:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280460800 00000100:00100000:3.0:1786015407.170373:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280460800 00010000:00010000:3.0:1786015407.170399:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5014f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8618 expref: 46 pid: 12526 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015407.170430:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 289 00000100:00100000:3.0:1786015407.170437:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+46:2353:x1872772280460800:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015407.170447:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015407.170454:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5014f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8618 expref: 46 pid: 12526 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015407.170480:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5014f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8618 expref: 46 pid: 12526 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015407.170502:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5014f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8618 expref: 46 pid: 12526 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015407.170519:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:3.0:1786015407.170523:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5014fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015407.170534:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5014fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015407.170542:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5014fe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015407.170569:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015407.170597:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:2353:x1872772280460800:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 160us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015407.170604:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 289 00000100:00100000:3.0:1786015407.170625:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280460928 00000100:00100000:3.0:1786015407.170628:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280460928 00000100:00100000:3.0:1786015407.170650:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 565 00000100:00100000:3.0:1786015407.170656:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280460928:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015407.170680:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280460928:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015407.170685:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 565 00010000:00010000:2.0:1786015407.170857:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5014fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.170865:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5014fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.171066:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5014fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.171075:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5014fe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.171087:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5014fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.171093:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015407.171098:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5014fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.171107:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5014fe lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.171118:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:2.0:1786015407.171120:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015407.171123:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5014fe lrc: 2/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.171128:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5014fe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015407.171249:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+45:26489:x1872772280460672:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 10925us (11099us total) trans 4294967911 rc 0/0 00000100:00100000:2.0:1786015407.171256:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 961 00000040:00080000:3.0:1786015407.171477:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015407.171481:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015407.172069:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1786015407.172077:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015407.174654:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015407.174695:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015407.174724:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015407.174889:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280461312 00000100:00100000:2.0:1786015407.174900:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280461312 00000100:00100000:1.0:1786015407.175651:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280461440 00000100:00100000:1.0:1786015407.175659:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280461440 00000100:00100000:1.0:1786015407.175705:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280461184 00000100:00100000:1.0:1786015407.175709:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280461184 00000100:00100000:1.0:1786015407.175731:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 382 00000100:00100000:1.0:1786015407.175739:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2351:x1872772280461312:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015407.175837:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2351:x1872772280461312:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 98us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015407.175845:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 382 00000100:00100000:1.0:1786015407.175864:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 383 00000100:00100000:1.0:1786015407.175871:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2351:x1872772280461440:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015407.175895:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2351:x1872772280461440:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015407.175901:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 383 00000100:00100000:1.0:1786015407.175911:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 384 00000100:00100000:1.0:1786015407.175917:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280461184:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015407.175936:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280461184:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 19us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015407.175949:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 384 00000100:00100000:1.0:1786015407.178643:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00080000:3.0:1786015407.178871:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015407.179874:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280461696 00000100:00100000:3.0:1786015407.179889:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280461696 00000100:00100000:3.0:1786015407.179997:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 191 00000100:00100000:3.0:1786015407.180009:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:26489:x1872772280461696:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786015407.180263:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+46:26489:x1872772280461696:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 255us (1628us total) trans 4294967912 rc 0/0 00000100:00100000:3.0:1786015407.180271:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 191 00000100:00100000:1.0:1786015407.275929:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304399104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015407.276024:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015407.276092:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304399104 00000100:00100000:1.0:1786015407.276099:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304399104 00000100:00100000:1.0:1786015407.276153:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1786015407.276161:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304399104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015407.276198:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 76480512 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015407.276244:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304399104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015407.276251:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:3.0:1786015407.276455:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015407.276600:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304399104:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1786015407.449025:0:18915:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015407.449034:0:18915:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015407.449077:0:18915:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 25 count 3 00000040:00080000:3.0:1786015407.449083:0:18915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015407.507848:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015407.507990:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280461824 00000100:00100000:0.0:1786015407.508005:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280461824 00000100:00100000:0.0:1786015407.508106:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 248 00000100:00100000:0.0:1786015407.508116:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280461824:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015407.508134:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015407.508152:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055f19d6a/0xb1a5ef690c501505 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e861f expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.508178:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015407.508182:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015407.508191:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055f19d6a/0xb1a5ef690c501505 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e861f expref: 13 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.508208:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000055f19d6a/0xb1a5ef690c501505 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e861f expref: 13 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.508221:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd200, rc 0) 00000100:00100000:0.0:1786015407.508279:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+13:2353:x1872772280461824:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 164us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015407.508286:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 248 00000100:00100000:2.0:1786015407.522512:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015407.522605:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280462080 00000100:00100000:1.0:1786015407.522616:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280462080 00000100:00100000:1.0:1786015407.522681:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 962 00000100:00100000:1.0:1786015407.522691:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+88:26490:x1872772280462080:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015407.522714:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015407.522737:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50150c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8626 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.522865:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501513 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.522880:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501513 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.522900:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501513 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015407.522915:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00010000:00010000:1.0:1786015407.523046:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50150c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8626 expref: 91 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.523063:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501513 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8626 expref: 90 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.523072:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:1.0:1786015407.523075:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786015407.523078:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46600, rc 0) 00000100:00100000:1.0:1786015407.523143:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+90:26490:x1872772280462080:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 453us (646us total) trans 4294967913 rc 0/0 00000100:00100000:1.0:1786015407.523150:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 962 00000100:00100000:2.0:1786015407.525654:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015407.525802:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280462208 00000100:00100000:1.0:1786015407.525812:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280462208 00000100:00100000:1.0:1786015407.525867:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 249 00000100:00100000:1.0:1786015407.525877:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+13:2352:x1872772280462208:12345-192.168.202.56@tcp:1:lfs.0 00010000:00010000:1.0:1786015407.525922:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501521 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.525943:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008d05d36f/0xb1a5ef690c5014e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8611 expref: 12 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.525969:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000055f19d6a/0xb1a5ef690c501505 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e861f expref: 13 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.525977:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015407.525982:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015407.525986:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501521 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.526024:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000055f19d6a/0xb1a5ef690c501505 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e861f expref: 13 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.526039:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000055f19d6a/0xb1a5ef690c501505 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e861f expref: 13 pid: 6592 timeout: 742 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015407.526055:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f1bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304399232:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015407.526154:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008d05d36f/0xb1a5ef690c5014e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8611 expref: 12 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.526164:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008d05d36f/0xb1a5ef690c5014e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8611 expref: 12 pid: 6592 timeout: 742 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015407.526174:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304399360:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015407.526199:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b8d19180 going to sleep for 11 seconds 00000100:00100000:1.0:1786015407.528743:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f1bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304399232:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015407.528796:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304399360:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015407.528822:0:11384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501521 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015407.529658:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015407.530119:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280462336 00000100:00100000:1.0:1786015407.530129:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280462336 00010000:00010000:1.0:1786015407.530169:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000055f19d6a/0xb1a5ef690c501505 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e861f expref: 14 pid: 6592 timeout: 742 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015407.530221:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 290 00000100:00100000:1.0:1786015407.530230:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+14:2353:x1872772280462336:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015407.530245:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015407.530270:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000055f19d6a/0xb1a5ef690c501505 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e861f expref: 14 pid: 6592 timeout: 742 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.530283:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000055f19d6a/0xb1a5ef690c501505 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e861f expref: 14 pid: 6592 timeout: 742 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.530308:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055f19d6a/0xb1a5ef690c501505 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e861f expref: 14 pid: 6592 timeout: 742 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.530336:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015407.530387:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+13:2353:x1872772280462336:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 158us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015407.530406:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 290 00000100:00100000:1.0:1786015407.537728:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015407.537826:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280462464 00000100:00100000:0.0:1786015407.537835:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280462464 00010000:00010000:0.0:1786015407.537871:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008d05d36f/0xb1a5ef690c5014e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8611 expref: 13 pid: 6592 timeout: 742 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015407.537911:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 291 00000100:00100000:0.0:1786015407.537920:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280462464:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015407.537948:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015407.537971:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008d05d36f/0xb1a5ef690c5014e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8611 expref: 13 pid: 6592 timeout: 742 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.537985:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008d05d36f/0xb1a5ef690c5014e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8611 expref: 13 pid: 6592 timeout: 742 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.538008:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d05d36f/0xb1a5ef690c5014e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8611 expref: 13 pid: 6592 timeout: 742 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.538025:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015407.538030:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015407.538036:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501521 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.538045:0:17038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501521 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.538074:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015407.538121:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280462464:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 202us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015407.538129:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 291 00010000:00010000:0.0:1786015407.538228:0:11384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501521 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.538238:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501521 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.538269:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501521 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.538278:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501521 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.538286:0:11384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501521 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.538293:0:11384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47a00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015407.538297:0:11384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501521 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.538306:0:11384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501521 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.538316:0:11384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501521 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.538335:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501521 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015407.538384:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280462208:12345-192.168.202.56@tcp:1:lfs.0 Request processed in 12509us (12739us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015407.538392:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 249 00000100:00100000:1.0:1786015407.540436:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015407.540521:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280462720 00000100:00100000:0.0:1786015407.540531:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280462720 00000100:00100000:0.0:1786015407.540597:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 192 00000100:00100000:0.0:1786015407.540606:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+90:26490:x1872772280462720:12345-192.168.202.56@tcp:35:lfs.0 00000004:00010000:0.0:1786015407.540676:0:5797:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x19:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501513 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8626 expref: 90 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786015407.540967:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967914 00000001:00080000:0.0:1786015407.541627:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967915 00010000:00010000:0.0:1786015407.541693:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501528 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.541709:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c501472 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85d9 expref: 45 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.541718:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5014a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85ee expref: 93 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.541724:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501528 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.541757:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5014a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85ee expref: 93 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.541798:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5014a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85ee expref: 93 pid: 5795 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015407.541814:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304399488:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015407.541917:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c501472 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85d9 expref: 45 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.541933:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c501472 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85d9 expref: 45 pid: 5794 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015407.541944:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304399616:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015407.541970:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486632780 going to sleep for 11 seconds 00000100:00100000:0.0:1786015407.550033:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015407.550074:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015407.550106:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280462848 00000100:00100000:0.0:1786015407.550115:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280462848 00010000:00010000:0.0:1786015407.550152:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5014a3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85ee expref: 94 pid: 5795 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015407.550183:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280462976 00000100:00100000:0.0:1786015407.550186:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280462976 00010000:00010000:0.0:1786015407.550199:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c501472 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85d9 expref: 46 pid: 5794 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015407.550217:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 292 00000100:00100000:0.0:1786015407.550226:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+94:2354:x1872772280462848:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015407.550242:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015407.550249:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5014a3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85ee expref: 94 pid: 5795 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.550262:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5014a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85ee expref: 94 pid: 5795 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.550299:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:0.0:1786015407.550306:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501528 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.550315:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501528 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.550335:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015407.550389:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+94:2354:x1872772280462848:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 163us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015407.550397:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 292 00000100:00100000:0.0:1786015407.550414:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 293 00000100:00100000:0.0:1786015407.550421:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b024ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+46:2353:x1872772280462976:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015407.550428:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015407.550432:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c501472 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85d9 expref: 46 pid: 5794 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.550441:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c501472 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85d9 expref: 46 pid: 5794 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.550452:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:0.0:1786015407.550456:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501528 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.550463:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501528 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.550481:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501528 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.550505:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015407.550526:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b024ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+46:2353:x1872772280462976:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 105us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015407.550532:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 293 00010000:00010000:2.0:1786015407.552015:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5014a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85ee expref: 93 pid: 5795 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015407.552037:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304399488:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015407.552054:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c501472 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85d9 expref: 45 pid: 5794 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015407.552063:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304399616:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015407.552085:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501528 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.552093:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501528 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.552098:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501528 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786015407.552235:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967916 00000001:00080000:2.0:1786015407.552647:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967917 00000001:00080000:2.0:1786015407.552710:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967918 00000100:00100000:2.0:1786015407.553627:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383749c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304399744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1786015407.553748:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015407.553979:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748827ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015407.554791:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304399744 00000100:00100000:0.0:1786015407.554800:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304399744 00000100:00100000:0.0:1786015407.554861:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1786015407.554871:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1872772304399744:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1786015407.554965:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1872772304399744:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 96us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015407.554972:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1786015407.555034:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015407.555128:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383749c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304399744:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1786015407.555881:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967919 00000100:00100000:2.0:1786015407.555958:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383749c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304399872:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1786015407.555998:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015407.556077:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748827c000 going to sleep for 11 seconds 00000100:00100000:3.0:1786015407.559606:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304399872 00000100:00100000:3.0:1786015407.559621:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304399872 00000100:00100000:2.0:1786015407.563059:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1786015407.563073:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1872772304399872:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1786015407.563375:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5797:x1872772304399872:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 304us (7375us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1786015407.563384:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1786015407.563454:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383749c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304399872:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:2.0:1786015407.563485:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501528 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.563494:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501528 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.563515:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501528 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.563521:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015407.563526:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501528 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.563533:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501528 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.563549:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:2.0:1786015407.563552:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1786015407.563557:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501528 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015407.563563:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501528 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786015407.563822:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x3d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1786015407.563964:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].12, 64 off9032 00000004:00080000:2.0:1786015407.563976:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642815214311ns, next at 643815212289ns, rc = 0 00000001:00080000:2.0:1786015407.563984:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967920 00010000:00010000:2.0:1786015407.564029:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b7483ee6e00) 00010000:00010000:2.0:1786015407.564032:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786015407.564040:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501513 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8626 expref: 97 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015407.564139:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+96:26490:x1872772280462720:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 23534us (23712us total) trans 4294967921 rc 0/0 00000100:00100000:2.0:1786015407.564147:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 192 00000020:00080000:2.0:1786015407.564150:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:1.0:1786015407.603285:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015407.603358:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280463104 00000100:00100000:1.0:1786015407.603367:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280463104 00000100:00100000:1.0:1786015407.604902:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 963 00000100:00100000:1.0:1786015407.604923:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+96:26491:x1872772280463104:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015407.604952:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015407.604977:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50152f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e862d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.605049:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501536 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.605064:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501536 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.605076:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501536 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.605091:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c50153d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.605098:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c50153d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.605104:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c50153d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.605222:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501544 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.605231:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501544 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.605238:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501544 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015407.605275:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00000004:00200000:1.0:1786015407.605280:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015407.605300:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501544 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.605311:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501544 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.605331:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501536 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.605338:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501536 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.605345:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501536 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.605351:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015407.605355:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501536 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.605362:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501536 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.605382:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:1.0:1786015407.605385:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015407.605390:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501536 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.605397:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c501536 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.606659:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c50153d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.606674:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c50153d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.606680:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c50153d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.606686:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015407.606690:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c50153d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.606696:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c50153d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.606708:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff8b7483ee6b00) 00010000:00010000:1.0:1786015407.606711:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015407.606714:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c50153d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.606720:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c50153d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.606795:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50152f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e862d expref: 98 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.606811:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501544 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e862d expref: 97 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.606819:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:1.0:1786015407.606821:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015407.606823:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46800, rc 0) 00000100:00100000:1.0:1786015407.606900:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+97:26491:x1872772280463104:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1984us (3625us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015407.606909:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 963 00000100:00100000:0.0:1786015407.614978:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015407.615115:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280463360 00000100:00100000:1.0:1786015407.615125:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280463360 00000100:00100000:1.0:1786015407.615211:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:1.0:1786015407.615222:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+97:26491:x1872772280463360:12345-192.168.202.56@tcp:103:lfs.0 00010000:00010000:1.0:1786015407.615238:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015407.615262:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501544 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e862d expref: 97 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015407.615279:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:1.0:1786015407.615290:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015407.615350:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+96:26491:x1872772280463360:12345-192.168.202.56@tcp:103:lfs.0 Request processed in 129us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015407.615359:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:1.0:1786015407.618366:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015407.618834:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280463488 00000100:00100000:0.0:1786015407.618854:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280463488 00000100:00100000:0.0:1786015407.618903:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 964 00000100:00100000:0.0:1786015407.618911:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+96:26491:x1872772280463488:12345-192.168.202.56@tcp:58:lfs.0 00010000:00010000:0.0:1786015407.619020:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50154b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.619036:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50154b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015407.619047:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50154b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786015407.619219:0:7673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].25, 136 off11592 00000100:00100000:0.0:1786015407.619306:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+96:26491:x1872772280463488:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 396us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015407.619314:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 964 00010000:00010000:0.0:1786015407.982363:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015408.238118:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015408.238131:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015408.238177:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 26 count 4 00000040:00080000:1.0:1786015408.238187:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015408.240170:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cafb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304400000:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015408.241846:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b8d19840 going to sleep for 11 seconds 00000100:00100000:1.0:1786015408.265551:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015408.265659:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280463616 00000100:00100000:3.0:1786015408.265676:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280463616 00000100:00100000:3.0:1786015408.265860:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 965 00000100:00100000:2.0:1786015408.265869:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cafb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304400000:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015408.265882:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+46:26501:x1872772280463616:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015408.265926:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x19:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015408.266057:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:26501:x1872772280463616:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 185us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015408.266070:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 965 00000100:00080000:1.0:1786015408.266547:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015408.269184:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015408.269370:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280463744 00000100:00100000:2.0:1786015408.269385:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280463744 00000100:00100000:2.0:1786015408.269465:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 966 00000100:00100000:2.0:1786015408.269479:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:26501:x1872772280463744:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1786015408.269582:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c501552 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269604:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c501552 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269620:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c501552 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269661:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501559 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269669:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501559 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269677:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501559 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269713:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501560 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269722:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269730:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015408.269806:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00000004:00200000:2.0:1786015408.269811:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015408.269829:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269842:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c501552 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269849:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c501552 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269856:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c501552 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269873:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015408.269878:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c501552 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269887:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c501552 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269902:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:2.0:1786015408.269906:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015408.269911:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c501552 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269918:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c501552 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269934:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501559 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269941:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501559 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269948:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501559 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269954:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015408.269957:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501559 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269963:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501559 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269982:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x8876c877 (ffff8b7499c59e00) 00010000:00010000:2.0:1786015408.269984:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015408.269987:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501559 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.269993:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501559 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.270009:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.270017:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501560 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.270022:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501560 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.270027:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015408.270031:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501560 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.270037:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501560 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.270045:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b748f24af00) 00010000:00010000:2.0:1786015408.270048:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015408.270051:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501560 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.270058:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501560 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015408.270161:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:26501:x1872772280463744:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 684us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015408.270172:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 966 00000100:00100000:1.0:1786015408.274567:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015408.274692:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280464000 00000100:00100000:2.0:1786015408.274705:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280464000 00000100:00100000:2.0:1786015408.274808:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 967 00000100:00100000:2.0:1786015408.274821:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+45:26501:x1872772280464000:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015408.274851:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015408.274882:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501567 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8634 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.275055:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50156e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.275081:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50156e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.275096:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50156e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015408.275111:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00010000:00010000:2.0:1786015408.275399:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50156e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.275409:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50156e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.275416:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50156e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.275434:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015408.275439:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50156e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.275447:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50156e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.275460:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b748f24af00) 00010000:00010000:2.0:1786015408.275463:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015408.275467:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50156e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.275473:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50156e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.275524:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501567 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8634 expref: 47 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.275535:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:2.0:1786015408.275538:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786015408.275541:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501567 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8634 expref: 47 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.275552:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906400, rc 0) 00000100:00100000:2.0:1786015408.275627:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+46:26501:x1872772280464000:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 809us (1074us total) trans 4294967922 rc 301/301 00000100:00100000:2.0:1786015408.275634:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 967 00000100:00100000:1.0:1786015408.288338:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015408.288674:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280464128 00000100:00100000:2.0:1786015408.288700:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280464128 00000100:00100000:2.0:1786015408.288840:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 968 00000100:00100000:2.0:1786015408.288852:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+46:26501:x1872772280464128:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015408.288906:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x19:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015408.289069:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+46:26501:x1872772280464128:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 209us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015408.289077:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 968 00000100:00100000:2.0:1786015408.295802:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015408.296033:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280464384 00000100:00100000:1.0:1786015408.296046:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280464384 00000100:00100000:1.0:1786015408.296122:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 969 00000100:00100000:1.0:1786015408.296133:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+46:26501:x1872772280464384:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015408.296161:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015408.296187:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50157c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e863b expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.300682:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501583 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.300709:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.300724:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015408.300738:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1a:0x0]: returning size 0 00010000:00010000:1.0:1786015408.300847:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50157c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e863b expref: 49 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.300868:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501583 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e863b expref: 48 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.300878:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:1.0:1786015408.300881:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015408.300885:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46800, rc 0) 00000100:00100000:1.0:1786015408.300973:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+48:26501:x1872772280464384:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 4841us (5211us total) trans 4294967923 rc 0/0 00000100:00100000:1.0:1786015408.300984:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 969 00000100:00100000:0.0:1786015408.315609:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015408.318024:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280464640 00000100:00100000:3.0:1786015408.318041:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280464640 00000100:00100000:3.0:1786015408.318135:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 970 00000100:00100000:3.0:1786015408.318272:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+48:26501:x1872772280464640:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786015408.318356:0:12526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015408.318386:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501583 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e863b expref: 48 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.318407:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:3.0:1786015408.318419:0:12526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015408.318447:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501591 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.318462:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5014b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85fc expref: 95 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.318472:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501591 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.318508:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5014b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85fc expref: 95 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.318522:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5014b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85fc expref: 95 pid: 7673 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015408.318685:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304400128:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015408.318817:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb000 going to sleep for 11 seconds 00000100:00100000:2.0:1786015408.327924:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015408.327992:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304400128:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015408.328039:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501591 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015408.328146:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280464768 00000100:00100000:1.0:1786015408.328173:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280464768 00010000:00010000:1.0:1786015408.328257:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5014b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85fc expref: 96 pid: 7673 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015408.328304:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 294 00000100:00100000:1.0:1786015408.328327:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+96:2353:x1872772280464768:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015408.328349:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015408.328358:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5014b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85fc expref: 96 pid: 7673 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.328374:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5014b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85fc expref: 96 pid: 7673 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.328403:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5014b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85fc expref: 96 pid: 7673 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.328441:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:1.0:1786015408.328448:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501591 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.328461:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501591 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786015408.328463:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786015408.328477:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501591 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.328522:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015408.328555:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501591 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.328566:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501591 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.328643:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501598 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0x961d882a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.328655:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501598 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x961d882a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.328667:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501598 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x961d882a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.328794:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501591 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.328803:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501591 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.328810:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501591 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.328816:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015408.328821:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501591 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.328841:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501591 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.328855:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:3.0:1786015408.328858:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015408.328863:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501591 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.328869:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501591 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.328886:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501598 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x961d882a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.328891:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501598 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x961d882a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.328897:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501598 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x961d882a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.328901:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015408.328905:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501598 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x961d882a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.328911:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501598 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x961d882a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.328919:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x961d882a (ffff8b74a04b5900) 00010000:00010000:3.0:1786015408.328921:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015408.328924:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501598 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x961d882a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.328952:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501598 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x961d882a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015408.333170:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+95:2353:x1872772280464768:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 4828us (5235us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015408.333192:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 294 00000100:00100000:3.0:1786015408.337730:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+47:26501:x1872772280464640:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 19452us (22125us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786015408.337745:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 970 00000100:00100000:2.0:1786015408.346672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015408.346831:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280464896 00000100:00100000:1.0:1786015408.346846:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280464896 00000100:00100000:1.0:1786015408.346921:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 971 00000100:00100000:1.0:1786015408.346933:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:26501:x1872772280464896:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015408.346963:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015408.347000:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50159f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8642 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.347048:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5015a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.347066:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5015a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.347104:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5015a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.347236:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50159f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8642 expref: 49 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.347258:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5015a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8642 expref: 48 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.347268:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:1.0:1786015408.347272:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015408.347276:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47000, rc 0) 00000100:00100000:1.0:1786015408.347377:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:26501:x1872772280464896:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 447us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015408.347386:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 971 00000100:00100000:1.0:1786015408.352909:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015408.353024:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280465152 00000100:00100000:0.0:1786015408.353039:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280465152 00000100:00100000:0.0:1786015408.353132:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 972 00000100:00100000:0.0:1786015408.353144:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+48:26501:x1872772280465152:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786015408.353276:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5015ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.353300:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5015ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.353322:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5015ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015408.353600:0:7673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000499b0f0a reply state 00000000dc160b03 transno 4294967924 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5015ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015408.353611:0:7673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015408.353742:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+50:26501:x1872772280465152:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 600us (848us total) trans 4294967924 rc 0/0 00000100:00100000:0.0:1786015408.353750:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 972 00010000:00010000:0.0:1786015408.356000:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5015ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.356049:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5015ad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.356070:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5015ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.356077:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015408.356083:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5015ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.356092:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5015ad lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.356113:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:0.0:1786015408.356117:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786015408.356123:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5015ad lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.356129:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5015ad lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015408.361151:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015408.361951:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280465280 00000100:00100000:0.0:1786015408.361968:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280465280 00000100:00100000:0.0:1786015408.362038:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 973 00000100:00100000:0.0:1786015408.362050:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+49:26501:x1872772280465280:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015408.362206:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015408.362321:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5015b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8649 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.362455:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5015b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8649 expref: 50 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.362476:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5015b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8649 expref: 50 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.362488:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:0.0:1786015408.362602:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015408.362608:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd200, rc 0) 00000100:00100000:0.0:1786015408.362737:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+50:26501:x1872772280465280:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 687us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015408.362748:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 973 00000100:00100000:1.0:1786015408.374206:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015408.374333:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280465408 00000100:00100000:2.0:1786015408.374349:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280465408 00000100:00100000:2.0:1786015408.374460:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 193 00000100:00100000:2.0:1786015408.374472:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:26501:x1872772280465408:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1786015408.374666:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:26501:x1872772280465408:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 Request processed in 195us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015408.374675:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 193 00000100:00100000:1.0:1786015408.390700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015408.391027:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280465664 00000100:00100000:2.0:1786015408.391042:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280465664 00000100:00100000:2.0:1786015408.391134:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 194 00000100:00100000:2.0:1786015408.391146:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:26501:x1872772280465664:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015408.391614:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+51:26501:x1872772280465664:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 469us (928us total) trans 4294967925 rc 0/0 00000100:00100000:2.0:1786015408.391624:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 194 00000100:00100000:1.0:1786015408.394048:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015408.394414:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280465920 00000100:00100000:2.0:1786015408.394450:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280465920 00000100:00100000:2.0:1786015408.394545:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 974 00000100:00100000:2.0:1786015408.394557:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:26501:x1872772280465920:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015408.394725:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:26501:x1872772280465920:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 169us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015408.394733:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 974 00000100:00100000:1.0:1786015408.397535:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015408.397930:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280466176 00000100:00100000:2.0:1786015408.397944:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280466176 00000100:00100000:2.0:1786015408.398018:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 975 00000100:00100000:2.0:1786015408.398029:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+51:26501:x1872772280466176:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015408.398059:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015408.398089:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c5015bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8650 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.398237:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5015c2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.398255:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5015b4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8649 expref: 52 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.398264:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5015c2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.398319:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5015b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8649 expref: 52 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.398337:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5015b4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8649 expref: 52 pid: 12526 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015408.398379:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738374b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304400256:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015408.398539:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748827c240 going to sleep for 11 seconds 00000100:00100000:0.0:1786015408.404259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015408.404447:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738374b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304400256:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015408.404498:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5015c2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015408.405412:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280466304 00000100:00100000:1.0:1786015408.405427:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280466304 00010000:00010000:1.0:1786015408.405482:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5015b4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8649 expref: 53 pid: 12526 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015408.405534:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 295 00000100:00100000:1.0:1786015408.405555:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2354:x1872772280466304:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015408.405574:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015408.405584:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5015b4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8649 expref: 53 pid: 12526 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.405599:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5015b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8649 expref: 53 pid: 12526 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.405630:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5015b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8649 expref: 53 pid: 12526 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.405648:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:1.0:1786015408.405654:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5015c2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.405666:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5015c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.405676:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5015c2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.405723:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015408.405833:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+52:2354:x1872772280466304:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 279us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015408.405842:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 295 00010000:00010000:3.0:1786015408.406199:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5015c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.406218:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5015c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015408.406243:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1a:0x0]: returning size 0 00000004:00080000:3.0:1786015408.406529:0:5796:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x13:0x0], index 0: 0 00010000:00010000:3.0:1786015408.406748:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5015c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.406758:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5015c2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.406797:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5015c2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.406804:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015408.406809:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5015c2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.406829:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5015c2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.406844:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:3.0:1786015408.406848:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015408.406852:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5015c2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.406859:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5015c2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.406928:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c5015bb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8650 expref: 52 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.406939:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:3.0:1786015408.406942:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786015408.406946:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c5015bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8650 expref: 52 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.406956:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907200, rc 0) 00000100:00100000:3.0:1786015408.407020:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+51:26501:x1872772280466176:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 8993us (9500us total) trans 4294967926 rc 301/301 00000100:00100000:3.0:1786015408.407030:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 975 00000100:00100000:1.0:1786015408.416223:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015408.416640:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280466560 00000100:00100000:2.0:1786015408.416654:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280466560 00000100:00100000:2.0:1786015408.416746:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 195 00000100:00100000:2.0:1786015408.416786:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916b4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:26501:x1872772280466560:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015408.417849:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916b4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+52:26501:x1872772280466560:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1085us (1645us total) trans 4294967927 rc 0/0 00000100:00100000:2.0:1786015408.417861:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 195 00000100:00100000:1.0:1786015408.426009:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015408.426109:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280466688 00000100:00100000:0.0:1786015408.426123:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280466688 00000100:00100000:2.0:1786015408.426300:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 976 00000100:00100000:2.0:1786015408.426326:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+52:26501:x1872772280466688:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015408.426364:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015408.426405:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5015d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8657 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.426514:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5015d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.426533:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5015d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.426546:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5015d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015408.426596:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1a:0x0]: returning size 0 00000004:00200000:2.0:1786015408.426620:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015408.426649:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5015d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.426684:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5015d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8657 expref: 54 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.426705:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5015d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8657 expref: 53 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.426715:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:2.0:1786015408.426718:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786015408.426722:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906000, rc 0) 00000100:00100000:2.0:1786015408.426832:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:26501:x1872772280466688:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 521us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015408.426840:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 976 00000100:00100000:0.0:1786015408.431883:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015408.432040:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280466816 00000100:00100000:2.0:1786015408.432053:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280466816 00000100:00100000:2.0:1786015408.432127:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 250 00000100:00100000:2.0:1786015408.432145:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280466816:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015408.432175:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015408.432271:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075b2724f/0xb1a5ef690c5015de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e865e expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015408.432325:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786015408.432358:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=643s v=(0 0) 00010000:00010000:2.0:1786015408.432364:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015408.432376:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075b2724f/0xb1a5ef690c5015de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e865e expref: 9 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.432435:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075b2724f/0xb1a5ef690c5015de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e865e expref: 9 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.432452:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906400, rc 0) 00000100:00100000:2.0:1786015408.432662:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280466816:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 520us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015408.432671:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 250 00000100:00100000:1.0:1786015408.449080:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015408.449610:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280467072 00000100:00100000:0.0:1786015408.449626:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280467072 00000100:00100000:0.0:1786015408.449713:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 977 00000100:00100000:0.0:1786015408.449725:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:26501:x1872772280467072:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015408.449932:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:26501:x1872772280467072:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 208us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015408.449941:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 977 00000100:00100000:1.0:1786015408.464689:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015408.464814:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280467200 00000100:00100000:2.0:1786015408.464827:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280467200 00000100:00100000:2.0:1786015408.464906:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 251 00000100:00100000:2.0:1786015408.464918:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:26501:x1872772280467200:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015408.464944:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015408.464968:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000069af577/0xb1a5ef690c5015e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8665 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.465007:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075b2724f/0xb1a5ef690c5015de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e865e expref: 10 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.465018:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015408.465023:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015408.465029:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000069af577/0xb1a5ef690c5015e5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8665 expref: 10 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.465069:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075b2724f/0xb1a5ef690c5015de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e865e expref: 10 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.465094:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075b2724f/0xb1a5ef690c5015de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e865e expref: 10 pid: 6591 timeout: 743 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015408.465112:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738374b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304400384:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015408.465461:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748827c240 going to sleep for 11 seconds 00000100:00100000:1.0:1786015408.474150:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015408.474202:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280467328 00000100:00100000:3.0:1786015408.474352:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738374b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304400384:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015408.474397:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000069af577/0xb1a5ef690c5015e5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8665 expref: 10 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.474444:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907600, rc 0) 00000100:00100000:3.0:1786015408.474533:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:26501:x1872772280467200:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 9616us (9854us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015408.474543:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 251 00000100:00100000:1.0:1786015408.474986:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280467328 00010000:00010000:1.0:1786015408.475037:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075b2724f/0xb1a5ef690c5015de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e865e expref: 10 pid: 6591 timeout: 743 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015408.475085:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 296 00000100:00100000:1.0:1786015408.475096:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280467328:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015408.475114:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015408.475143:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075b2724f/0xb1a5ef690c5015de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e865e expref: 10 pid: 6591 timeout: 743 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.475165:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075b2724f/0xb1a5ef690c5015de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e865e expref: 10 pid: 6591 timeout: 743 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.475194:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075b2724f/0xb1a5ef690c5015de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e865e expref: 10 pid: 6591 timeout: 743 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.475324:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015408.475330:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015408.475341:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000069af577/0xb1a5ef690c5015e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8665 expref: 9 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.475354:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000069af577/0xb1a5ef690c5015e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8665 expref: 9 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.475417:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000069af577/0xb1a5ef690c5015e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8665 expref: 9 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015408.475435:0:5781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aaf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5781:1872772304400512:192.168.202.56@tcp:105: 00000100:00100000:1.0:1786015408.475519:0:5781:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b8d19840 going to sleep for 11 seconds 00000100:00100000:3.0:1786015408.488400:0:5781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aaf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5781:1872772304400512:192.168.202.56@tcp:105: 00010000:00010000:3.0:1786015408.488443:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015408.488533:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280467328:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 13438us (14396us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015408.488548:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 296 00000100:00100000:1.0:1786015408.489570:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015408.490462:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280467456 00000100:00100000:3.0:1786015408.490479:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280467456 00002000:00100000:3.0:1786015408.490564:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x13:0x0] (0->157) req@ffff8b7383aac000 x1872772280467456/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:254/0 lens 648/0 e 0 to 0 dl 1786015419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015408.490577:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7383aac000 with x1872772280467456 ext(0->157) 00002000:00010000:3.0:1786015408.490584:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7383aac000 00000100:00100000:3.0:1786015408.490620:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 91 00000100:00100000:3.0:1786015408.490631:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280467456:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1786015408.491915:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280467456:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 1276us (2340us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1786015408.491930:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 91 00002000:00100000:3.0:1786015408.491943:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x13:0x0] (0->157) req@ffff8b7383aac000 x1872772280467456/t4294967345(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:254/0 lens 648/448 e 0 to 0 dl 1786015419 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015408.491969:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7383aac000 with x1872772280467456 ext(0->157) 00002000:00010000:3.0:1786015408.491976:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7383aac000 00000100:00100000:2.0:1786015408.508620:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015408.508695:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280467584 00000100:00100000:3.0:1786015408.508712:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280467584 00000100:00100000:3.0:1786015408.508813:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 978 00000100:00100000:3.0:1786015408.508825:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:26501:x1872772280467584:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1786015408.616350:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:26501:x1872772280467584:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 107512us (107730us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015408.616368:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 978 00000001:00080000:1.0:1786015408.616432:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967924 is committed 00000001:00080000:1.0:1786015408.616446:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967916 is committed 00000001:00080000:1.0:1786015408.616478:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967927 is committed 00000001:00080000:1.0:1786015408.616501:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967921 is committed 00000004:00080000:1.0:1786015408.616505:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 16 committed 00000020:00080000:1.0:1786015408.616524:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b748827c6c0 refcount 2 committed 0 result 0 batchid 15 00000020:00080000:1.0:1786015408.616529:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74b0987a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b748827ccc0 00000020:00080000:1.0:1786015408.616532:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74b0987800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74b8c3f400 00000100:00100000:1.0:1786015408.617155:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304400640:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786015408.617234:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015408.617337:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304400640 00000100:00100000:1.0:1786015408.617349:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304400640 00000100:00100000:1.0:1786015408.617609:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1786015408.617622:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304400640:12345-0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1786015408.617742:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 15 committed batchid 14 00000020:00080000:2.0:1786015408.618054:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 14 00002000:00080000:1.0:1786015408.618942:0:11384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:21 count 1 00002000:00010000:1.0:1786015408.619007:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 158, mtime: 0x6a746eae, atime: 0x0, ctime: 0x6a746eae, blocks: 0x1 00010000:00010000:1.0:1786015408.619017:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d6b9677/0xb1a5ef690c5015ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.619040:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=643s v=(0 0) 00010000:00010000:1.0:1786015408.619045:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015408.619052:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d6b9677/0xb1a5ef690c5015ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.619065:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d6b9677/0xb1a5ef690c5015ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.619074:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d6b9677/0xb1a5ef690c5015ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.619080:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d6b9677/0xb1a5ef690c5015ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.619100:0:11384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786015408.619158:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786015408.619174:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d6b9677/0xb1a5ef690c5015ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.619201:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47400 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015408.619216:0:6606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d6b9677/0xb1a5ef690c5015ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.619230:0:6606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d6b9677/0xb1a5ef690c5015ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.619253:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d6b9677/0xb1a5ef690c5015ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.619260:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d6b9677/0xb1a5ef690c5015ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.619284:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015408.619286:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015408.619289:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015408.620078:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015408.620340:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280467712 00000100:00100000:0.0:1786015408.620355:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280467712 00000100:00100000:0.0:1786015408.620428:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 253 00000100:00100000:0.0:1786015408.620439:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280467712:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1786015408.623468:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304400640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5830us (6214us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1786015408.623494:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000004:00080000:0.0:1786015408.628889:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b7383aadc00/2, rc 0, transno 4294967353 00000100:00100000:0.0:1786015408.628912:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304400640:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1786015408.751253:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967345 is committed 00000100:00100000:0.0:1786015408.751736:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280467712:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 131287us (131653us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015408.751785:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 253 00000100:00100000:3.0:1786015408.760662:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015408.761391:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280467968 00000100:00100000:0.0:1786015408.761410:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280467968 00000100:00100000:0.0:1786015408.761492:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 979 00000100:00100000:0.0:1786015408.761506:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+42:26501:x1872772280467968:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786015408.761585:0:12526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015408.761688:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5015d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8657 expref: 42 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.761710:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:0.0:1786015408.761716:0:12526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015408.761789:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5015f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.761808:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5015f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.761820:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5015f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015408.762071:0:12526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e0c1c1fd reply state 00000000a99b0dce transno 4294967928 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5015f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015408.762083:0:12526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015408.762360:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+43:26501:x1872772280467968:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 856us (1708us total) trans 4294967928 rc 0/0 00000100:00100000:0.0:1786015408.762372:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 979 00000100:00100000:2.0:1786015408.768537:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:0.0:1786015408.769124:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5015f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.769149:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5015f3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.769169:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5015f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.769176:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc20624f0) 00000100:00100000:1.0:1786015408.769180:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280468096 00010000:00010000:0.0:1786015408.769182:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5015f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.769194:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5015f3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015408.769195:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280468096 00010000:00010000:0.0:1786015408.769216:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:0.0:1786015408.769220:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015408.769225:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5015f3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.769232:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5015f3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015408.769274:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 980 00000100:00100000:1.0:1786015408.769289:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+42:26501:x1872772280468096:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015408.772819:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015408.772870:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5015fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e866c expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.773118:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5015fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e866c expref: 43 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.773214:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5015fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e866c expref: 43 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.773243:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:1.0:1786015408.773248:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015408.773252:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46e00, rc 0) 00000100:00100000:1.0:1786015408.773561:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:26501:x1872772280468096:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 4275us (5032us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015408.773572:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 980 00000100:00100000:2.0:1786015408.780337:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015408.780631:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280468224 00000100:00100000:1.0:1786015408.780645:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280468224 00000100:00100000:1.0:1786015408.780719:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 254 00000100:00100000:1.0:1786015408.780731:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280468224:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1786015408.781088:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1786015408.781092:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb mtime from disk: 0 -> 1786015406 00002000:00010000:1.0:1786015408.781095:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb atime from disk: 0 -> 1786015406 00002000:00010000:1.0:1786015408.781098:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb ctime from disk: 0 -> 1786015406 00002000:00010000:1.0:1786015408.781100:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1786015408.781177:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280468224:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 448us (855us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1786015408.781196:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 254 00000100:00100000:0.0:1786015408.788200:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015408.788668:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280468480 00000100:00100000:1.0:1786015408.788685:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280468480 00000100:00100000:1.0:1786015408.788819:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 981 00000100:00100000:1.0:1786015408.788832:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+43:26501:x1872772280468480:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1786015408.788929:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501601 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.788951:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5015a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8642 expref: 43 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.788960:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501601 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.789008:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5015a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8642 expref: 43 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.789025:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5015a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8642 expref: 43 pid: 5795 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015408.789044:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aadf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304400768:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015408.789163:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce1600 going to sleep for 11 seconds 00000100:00100000:3.0:1786015408.793956:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aadf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304400768:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015408.793998:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501601 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015408.798036:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015408.801995:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280468608 00000100:00100000:2.0:1786015408.802020:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280468608 00010000:00010000:2.0:1786015408.802086:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5015a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8642 expref: 44 pid: 5795 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015408.802141:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 297 00000100:00100000:2.0:1786015408.802154:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2354:x1872772280468608:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015408.802174:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015408.802182:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5015a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8642 expref: 44 pid: 5795 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.802199:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5015a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8642 expref: 44 pid: 5795 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.802245:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5015a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8642 expref: 44 pid: 5795 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.802263:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:2.0:1786015408.802268:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501601 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.802280:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501601 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.802289:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501601 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.803747:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015408.803873:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+43:2354:x1872772280468608:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1714us (5843us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015408.803887:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 297 00010000:00010000:3.0:1786015408.804746:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501601 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.804777:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501601 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.804822:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501601 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.804830:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501601 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.804837:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501601 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.804844:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015408.804866:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501601 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.804875:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501601 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.804896:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:3.0:1786015408.804899:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1786015408.804904:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501601 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.804912:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501601 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015408.804986:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+42:26501:x1872772280468480:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 16155us (16799us total) trans 0 rc -22/-22 00000100:00100000:3.0:1786015408.804997:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 981 00000100:00100000:2.0:1786015408.809586:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015408.809714:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280468736 00000100:00100000:0.0:1786015408.809727:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280468736 00000100:00100000:0.0:1786015408.809814:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 255 00000100:00100000:0.0:1786015408.809825:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280468736:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786015408.809886:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501608 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.809925:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000069af577/0xb1a5ef690c5015e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8665 expref: 10 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.809933:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x13:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786015408.809938:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015408.809943:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501608 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.809995:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000069af577/0xb1a5ef690c5015e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8665 expref: 10 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.810012:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000069af577/0xb1a5ef690c5015e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8665 expref: 10 pid: 6592 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015408.810030:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383949880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304400896:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015408.810132:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b73826a4000 going to sleep for 11 seconds 00000100:00100000:2.0:1786015408.813042:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304401024:0@lo:400:kworker.0 00000100:00100000:2.0:1786015408.813133:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015408.813175:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304401536:0@lo:400:kworker.0 00000100:00100000:2.0:1786015408.813204:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015408.813235:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786015408.813241:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304401408:0@lo:400:kworker.0 00000100:00100000:2.0:1786015408.813272:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015408.813319:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304401536 00000100:00100000:2.0:1786015408.813328:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304401536 00000100:00100000:1.0:1786015408.813441:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304401152:0@lo:400:kworker.0 00000100:00100000:1.0:1786015408.813478:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015408.813511:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304401664:0@lo:400:kworker.0 00000100:00100000:1.0:1786015408.813534:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015408.813560:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015408.813566:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304401280:0@lo:400:kworker.0 00000100:00100000:1.0:1786015408.813601:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015408.813637:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304401152 00000100:00100000:1.0:1786015408.813641:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304401152 00000100:00100000:1.0:1786015408.813689:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304401280 00000100:00100000:1.0:1786015408.813691:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304401280 00000100:00100000:1.0:1786015408.813723:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1786015408.813731:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304401152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015408.813816:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304401152:12345-0@lo:400:kworker.0 Request processed in 85us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015408.813824:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1786015408.813841:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1786015408.813846:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304401280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015408.813869:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304401280:12345-0@lo:400:kworker.0 Request processed in 23us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015408.813874:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1786015408.813891:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304401408 00000100:00100000:1.0:1786015408.813894:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304401408 00000100:00100000:1.0:1786015408.813913:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304401664 00000100:00100000:1.0:1786015408.813915:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304401664 00000100:00100000:1.0:1786015408.813930:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1786015408.813935:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304401408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015408.813966:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304401408:12345-0@lo:400:kworker.0 Request processed in 31us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015408.813972:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1786015408.813981:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1786015408.813985:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1872772304401664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015408.814016:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1872772304401664:12345-0@lo:400:kworker.0 Request processed in 30us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015408.814022:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00080000:1.0:1786015408.814041:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015408.814071:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304401280:0@lo:400:kworker.0 00000100:00100000:1.0:1786015408.814080:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304401152:0@lo:400:kworker.0 00000100:00100000:1.0:1786015408.814089:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304401664:0@lo:400:kworker.0 00000100:00100000:1.0:1786015408.814126:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304401408:0@lo:400:kworker.0 00000100:00100000:2.0:1786015408.814528:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1786015408.814536:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304401536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015408.814721:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304401536:12345-0@lo:400:kworker.0 Request processed in 185us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015408.814727:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1786015408.814812:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304401536:0@lo:400:kworker.0 00000100:00080000:1.0:1786015408.814893:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015408.815856:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304401024 00000100:00100000:3.0:1786015408.815870:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304401024 00000100:00100000:3.0:1786015408.815925:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1786015408.815934:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304401024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015408.816021:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304401024:12345-0@lo:400:kworker.0 Request processed in 88us (2888us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015408.816028:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1786015408.816079:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304401024:0@lo:400:kworker.0 00000100:00100000:3.0:1786015408.830662:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383949880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304400896:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015408.830704:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501608 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015408.833496:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015408.836003:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280468864 00000100:00100000:0.0:1786015408.836024:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280468864 00010000:00010000:0.0:1786015408.836085:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000069af577/0xb1a5ef690c5015e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8665 expref: 11 pid: 6592 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015408.836140:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 298 00000100:00100000:0.0:1786015408.836152:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280468864:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015408.836186:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015408.836217:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000069af577/0xb1a5ef690c5015e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8665 expref: 11 pid: 6592 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.836234:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000069af577/0xb1a5ef690c5015e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8665 expref: 11 pid: 6592 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.836265:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000069af577/0xb1a5ef690c5015e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8665 expref: 11 pid: 6592 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.836283:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015408.836287:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015408.836294:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501608 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.836315:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501608 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015408.836354:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015408.836482:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501608 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.836493:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501608 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.836524:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501608 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.836533:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501608 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.836541:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501608 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.836549:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015408.836553:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501608 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.836563:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501608 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.836575:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501608 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015408.836595:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501608 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786015408.837818:0:18970:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015408.837828:0:18970:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015408.837888:0:18970:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 26 count 4 00000040:00080000:1.0:1786015408.837894:0:18970:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015408.839113:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280468864:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 2951us (5625us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015408.839130:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 298 00000100:00100000:3.0:1786015408.839594:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280468736:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 29767us (30016us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015408.839605:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 255 00000100:00100000:3.0:1786015408.841994:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015408.842137:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280469120 00000100:00100000:1.0:1786015408.842150:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280469120 00000100:00100000:1.0:1786015408.842223:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 982 00000100:00100000:1.0:1786015408.842235:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+42:26501:x1872772280469120:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786015408.842480:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c50160f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.842503:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c50160f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.842518:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c50160f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.842904:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501616 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.842931:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5015fa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e866c expref: 43 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.842940:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501616 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.842999:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5015fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e866c expref: 43 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.843016:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5015fa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e866c expref: 43 pid: 5795 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015408.843034:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aaf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304401792:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015408.843147:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce1600 going to sleep for 11 seconds 00000100:00100000:0.0:1786015408.846011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015408.848234:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aaf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304401792:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015408.848274:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501616 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015408.849894:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280469248 00000100:00100000:1.0:1786015408.849910:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280469248 00010000:00010000:1.0:1786015408.849975:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5015fa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e866c expref: 44 pid: 5795 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015408.850025:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 299 00000100:00100000:1.0:1786015408.850036:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b024e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2353:x1872772280469248:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015408.850060:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015408.850085:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5015fa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e866c expref: 44 pid: 5795 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.850100:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5015fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e866c expref: 44 pid: 5795 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.850130:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5015fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e866c expref: 44 pid: 5795 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.850150:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:1.0:1786015408.850156:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501616 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.850167:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501616 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.850177:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501616 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.850209:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015408.850292:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b024e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:2353:x1872772280469248:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 256us (4292us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015408.850300:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 299 00010000:00010000:1.0:1786015408.850554:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501616 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.850564:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501616 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786015408.851796:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967929 00000001:00080000:1.0:1786015408.851977:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967930 00000001:00080000:1.0:1786015408.852045:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967931 00000100:00100000:1.0:1786015408.852150:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aaea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304401920:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786015408.852232:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015408.852278:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482b33d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786015408.852542:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304401920 00000100:00100000:2.0:1786015408.852552:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304401920 00000100:00100000:2.0:1786015408.852616:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1786015408.852626:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1872772304401920:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786015408.852718:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1872772304401920:12345-0@lo:1000:mdt00_001.0 Request processed in 93us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015408.852726:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1786015408.856925:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aaea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304401920:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1786015408.857829:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967932 00000100:00100000:2.0:1786015408.858045:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304402048:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786015408.858150:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015408.858197:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748570ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1786015408.858232:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304402048 00000100:00100000:2.0:1786015408.858240:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304402048 00000100:00100000:2.0:1786015408.858321:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1786015408.858332:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1872772304402048:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786015408.859234:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5795:x1872772304402048:12345-0@lo:1000:mdt00_001.0 Request processed in 899us (1079us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1786015408.859246:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1786015408.859336:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304402048:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1786015408.859601:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967933 00010000:00010000:1.0:1786015408.859648:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501616 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.859661:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501616 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.859670:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501616 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.859678:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015408.859683:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501616 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.859692:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501616 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.859710:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:1.0:1786015408.859714:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015408.859719:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501616 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.859726:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501616 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.859841:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50154b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.859863:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50154b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.859869:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50154b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.859875:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015408.859878:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50154b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.859885:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50154b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.859894:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b748f24af00) 00010000:00010000:1.0:1786015408.859897:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015408.859900:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50154b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.859906:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50154b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.859932:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50161d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.860434:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50161d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.860450:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50161d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.860458:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50161d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.860470:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50161d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.860477:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50161d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.860481:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015408.860484:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50161d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.860554:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50161d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.860565:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b748f24af00) 00010000:00010000:1.0:1786015408.860568:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015408.860571:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50161d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.860576:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50161d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.860587:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c50160f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.860593:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c50160f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.860599:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c50160f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.860605:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015408.860613:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c50160f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.860620:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c50160f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.860628:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b748f24af00) 00010000:00010000:1.0:1786015408.860631:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015408.860634:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c50160f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.860639:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c50160f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015408.861465:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:26501:x1872772280469120:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 19220us (19475us total) trans 4294967934 rc 0/0 00000100:00100000:2.0:1786015408.861611:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 982 00000020:00080000:2.0:1786015408.861619:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:3.0:1786015408.862473:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015408.862480:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015408.863324:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1786015408.863337:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015408.871319:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015408.871383:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280469504 00000100:00100000:2.0:1786015408.871397:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280469504 00000100:00100000:2.0:1786015408.871489:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 196 00000100:00100000:2.0:1786015408.871502:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:26501:x1872772280469504:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1786015408.872325:0:5798:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x1a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1786015408.872460:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967935 00010000:00010000:2.0:1786015408.872522:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501624 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.872543:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501624 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.872559:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501624 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.872570:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501624 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.872577:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501624 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.872583:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501624 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015408.872859:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786015408.872986:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:26501:x1872772280469504:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1483us (1690us total) trans 4294967936 rc 0/0 00000100:00100000:2.0:1786015408.873007:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 196 00000020:00080000:2.0:1786015408.873014:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786015408.875179:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786015408.875199:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501624 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.875215:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906e00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015408.875221:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501624 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.875233:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501624 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.875255:0:8308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:1.0:1786015408.875259:0:8308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786015408.875264:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501624 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.875270:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501624 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015408.875302:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015408.875304:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015408.875320:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015409.009513:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015409.324706:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015409.324739:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304402176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015409.324857:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015409.324980:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304402176 00000100:00100000:3.0:1786015409.324990:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304402176 00000100:00100000:3.0:1786015409.325062:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1786015409.325075:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1872772304402176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015409.325120:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 74776576 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015409.325177:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1872772304402176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015409.325185:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1786015409.325244:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304402176:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1786015409.325292:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1786015409.439449:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967353 is committed 00000001:00080000:0.0:1786015409.441554:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967351 is committed 00010000:00010000:1.0:1786015410.033622:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015410.675680:0:19024:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015410.675691:0:19024:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015410.675738:0:19024:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 26 count 4 00000040:00080000:1.0:1786015410.675745:0:19024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015410.858108:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015410.858182:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280469760 00000100:00100000:1.0:1786015410.858193:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280469760 00000100:00080000:3.0:1786015410.858254:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015410.858272:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 983 00000100:00100000:1.0:1786015410.858283:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+85:26513:x1872772280469760:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015410.858316:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015410.858344:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c50162b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8673 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.858444:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501632 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.858460:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501632 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.858484:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501632 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.858519:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501639 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.858527:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.858546:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.858931:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c501640 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.858940:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c501640 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.858948:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c501640 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015410.858960:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00010000:00010000:1.0:1786015410.859059:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501632 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.859067:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501632 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.859073:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501632 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.859079:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015410.859084:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501632 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.859090:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501632 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.859102:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8b7499c59c00) 00010000:00010000:1.0:1786015410.859104:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015410.859115:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501632 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.859122:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501632 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.859134:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.859140:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501639 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.859146:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.859151:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015410.859154:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.859160:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.859168:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff8b7483ee6e00) 00010000:00010000:1.0:1786015410.859170:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015410.859173:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501639 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.859179:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501639 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.859222:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46c00/0xb1a5ef690c50162b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8673 expref: 88 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.859247:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47800/0xb1a5ef690c501640 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8673 expref: 87 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.859255:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:1.0:1786015410.859257:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015410.859260:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47800, rc 0) 00000100:00100000:1.0:1786015410.859340:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+87:26513:x1872772280469760:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1058us (1241us total) trans 4294967937 rc 0/0 00000100:00100000:1.0:1786015410.859348:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 983 00000100:00100000:0.0:1786015410.871453:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015410.871532:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280469888 00000100:00100000:2.0:1786015410.871551:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280469888 00000100:00100000:2.0:1786015410.871609:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 984 00000100:00100000:2.0:1786015410.871618:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+87:26513:x1872772280469888:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:2.0:1786015410.871696:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50164e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015410.871714:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50164e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015410.871727:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50164e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015410.871757:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50164e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015410.871798:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50164e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015410.871805:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50164e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015410.871812:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015410.871816:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50164e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015410.871823:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50164e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015410.871845:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:2.0:1786015410.871847:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786015410.871852:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50164e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015410.871857:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50164e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015410.871930:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+87:26513:x1872772280469888:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 312us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015410.871938:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 984 00000100:00100000:3.0:1786015410.881364:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015410.881445:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280470144 00000100:00100000:2.0:1786015410.881456:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280470144 00000100:00100000:2.0:1786015410.881533:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 197 00000100:00100000:2.0:1786015410.881543:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+87:26513:x1872772280470144:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1786015410.881822:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+88:26513:x1872772280470144:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 280us (466us total) trans 4294967938 rc 0/0 00000100:00100000:2.0:1786015410.881830:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 197 00000100:00100000:3.0:1786015410.981210:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015410.981320:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280470272 00000100:00100000:1.0:1786015410.981332:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280470272 00000100:00100000:1.0:1786015410.981410:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 256 00000100:00100000:1.0:1786015410.981420:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280470272:12345-192.168.202.56@tcp:101:diff.0 00010000:00010000:1.0:1786015410.981438:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015410.981461:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000744169b3/0xb1a5ef690c501655 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e867a expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015410.981488:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 158, mtime: 0x6a746eae, atime: 0x6a746eae, ctime: 0x6a746eae, blocks: 0xb 00010000:00010000:1.0:1786015410.981508:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=646s v=(0 0) 00010000:00010000:1.0:1786015410.981513:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015410.981523:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000744169b3/0xb1a5ef690c501655 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e867a expref: 13 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.981544:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000744169b3/0xb1a5ef690c501655 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e867a expref: 13 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015410.981580:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46c00, rc 0) 00000100:00100000:1.0:1786015410.981651:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+13:2352:x1872772280470272:12345-192.168.202.56@tcp:101:diff.0 Request processed in 232us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015410.981659:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 256 00000100:00080000:3.0:1786015410.982145:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015410.985853:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015410.985943:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280470528 00000100:00100000:0.0:1786015410.985954:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280470528 00000100:00100000:0.0:1786015410.986037:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 985 00000100:00100000:0.0:1786015410.986048:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+88:26518:x1872772280470528:12345-192.168.202.56@tcp:101:diff.0 00010000:00010000:0.0:1786015410.986078:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015410.986105:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50165c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8681 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015410.986217:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501663 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015410.986233:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015410.986244:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015410.986257:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00010000:00010000:0.0:1786015410.986400:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50165c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8681 expref: 91 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015410.986417:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501663 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8681 expref: 90 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015410.986426:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:0.0:1786015410.986429:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015410.986433:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afcc00, rc 0) 00000100:00100000:0.0:1786015410.986503:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+90:26518:x1872772280470528:12345-192.168.202.56@tcp:101:diff.0 Request processed in 456us (659us total) trans 4294967939 rc 0/0 00000100:00100000:0.0:1786015410.986528:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 985 00000100:00100000:0.0:1786015410.994234:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015410.994299:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015410.994380:0:17969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280470784 00000100:00100000:1.0:1786015410.994393:0:17969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280470784 00002000:00100000:1.0:1786015410.994455:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x13:0x0] (0->4095) req@ffff8b74aef02300 x1872772280470784/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:256/0 lens 488/0 e 0 to 0 dl 1786015421 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015410.994468:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aef02300 with x1872772280470784 ext(0->4095) 00002000:00010000:1.0:1786015410.994476:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74aef02300 00000100:00100000:1.0:1786015410.994521:0:17969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 92 00000100:00100000:1.0:1786015410.994532:0:17969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41677fca-39fb-471c-b582-96bce6540a36+13:2353:x1872772280470784:12345-192.168.202.56@tcp:3:diff.0 00000100:00100000:1.0:1786015410.994799:0:17969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41677fca-39fb-471c-b582-96bce6540a36+13:2353:x1872772280470784:12345-192.168.202.56@tcp:3:diff.0 Request processed in 268us (498us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786015410.994807:0:17969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 92 00002000:00100000:1.0:1786015410.994815:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x13:0x0] (0->4095) req@ffff8b74aef02300 x1872772280470784/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:256/0 lens 488/4536 e 0 to 0 dl 1786015421 ref 1 fl Complete:/600/0 rc 4096/4096 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015410.994823:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aef02300 with x1872772280470784 ext(0->4095) 00002000:00010000:1.0:1786015410.994826:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74aef02300 00000100:00100000:2.0:1786015410.994942:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280470656 00000100:00100000:2.0:1786015410.994946:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280470656 00000100:00100000:2.0:1786015410.994998:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:2.0:1786015410.995005:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+90:2354:x1872772280470656:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015410.995015:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015410.995041:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501663 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8681 expref: 90 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015410.995073:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8b7483ee6b00) 00010000:00010000:2.0:1786015410.995078:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015410.995118:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+89:2354:x1872772280470656:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 112us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015410.995125:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:0.0:1786015411.004046:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015411.004204:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280471040 00000100:00100000:2.0:1786015411.004218:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280471040 00000100:00100000:2.0:1786015411.004302:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 198 00000100:00100000:2.0:1786015411.004316:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+89:26518:x1872772280471040:12345-192.168.202.56@tcp:35:diff.0 00000100:00100000:2.0:1786015411.004630:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+90:26518:x1872772280471040:12345-192.168.202.56@tcp:35:diff.0 Request processed in 313us (592us total) trans 4294967940 rc 0/0 00000100:00100000:2.0:1786015411.004641:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 198 00010000:00010000:0.0:1786015411.052309:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015412.076513:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015412.287403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015412.287446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015412.287488:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015412.287511:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015412.287543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015412.287560:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015412.287586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015412.287612:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280471424 00000100:00100000:1.0:1786015412.287622:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280471424 00000100:00100000:1.0:1786015412.287673:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280471936 00000100:00100000:1.0:1786015412.287676:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280471936 00000100:00100000:1.0:1786015412.287690:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280471552 00000100:00100000:1.0:1786015412.287693:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280471552 00000100:00100000:1.0:1786015412.287704:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280471808 00000100:00100000:1.0:1786015412.287706:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280471808 00000100:00100000:1.0:1786015412.287722:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 387 00000100:00100000:1.0:1786015412.287732:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+13:2351:x1872772280471424:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015412.287832:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+13:2351:x1872772280471424:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 101us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015412.287840:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 387 00000100:00100000:1.0:1786015412.287856:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 388 00000100:00100000:1.0:1786015412.287862:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280471936:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015412.287887:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280471936:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015412.287892:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 388 00000100:00100000:1.0:1786015412.287902:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 389 00000100:00100000:1.0:1786015412.287907:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+12:2351:x1872772280471552:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015412.287925:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+12:2351:x1872772280471552:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 19us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015412.287931:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 389 00000100:00100000:1.0:1786015412.287967:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 390 00000100:00100000:1.0:1786015412.287974:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280471808:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015412.287998:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280471808:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015412.288004:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 390 00000100:00100000:1.0:1786015412.288023:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280471680 00000100:00100000:1.0:1786015412.288027:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280471680 00000100:00100000:1.0:1786015412.288053:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280471296 00000100:00100000:1.0:1786015412.288056:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280471296 00000100:00100000:1.0:1786015412.288075:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 412 00000100:00100000:1.0:1786015412.288080:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+49:2351:x1872772280471680:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015412.288111:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+49:2351:x1872772280471680:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015412.288118:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 412 00000100:00100000:1.0:1786015412.288130:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 413 00000100:00100000:1.0:1786015412.288136:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+90:2351:x1872772280471296:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015412.288160:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+90:2351:x1872772280471296:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015412.288166:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 413 00000100:00080000:1.0:1786015412.288187:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015412.288191:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015412.288193:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015412.288941:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280471168 00000100:00100000:2.0:1786015412.288948:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280471168 00000100:00100000:2.0:1786015412.288988:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 567 00000100:00100000:2.0:1786015412.288995:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280471168:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015412.289038:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280471168:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 44us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015412.289044:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 567 00000100:00100000:1.0:1786015412.396656:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786015412.396679:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304402304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015412.396754:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015412.397573:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304402304 00000100:00100000:1.0:1786015412.397599:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304402304 00000100:00100000:1.0:1786015412.397675:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1786015412.397685:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304402304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015412.397721:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 78184448 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015412.397831:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304402304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015412.397838:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1786015412.397888:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304402304:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786015412.398469:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786015413.100119:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015413.937630:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786015413.937656:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304402432:0@lo:400:kworker.0 00000100:00100000:1.0:1786015413.937746:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015413.937858:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304402432 00000100:00100000:1.0:1786015413.937866:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304402432 00000100:00100000:1.0:1786015413.937912:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:1.0:1786015413.937921:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304402432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015413.937969:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304402432:12345-0@lo:400:kworker.0 Request processed in 49us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015413.937976:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:1.0:1786015413.938050:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304402432:0@lo:400:kworker.0 00000100:00100000:1.0:1786015413.938108:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304402816:0@lo:400:kworker.0 00000100:00100000:1.0:1786015413.938135:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015413.938164:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304402816 00000100:00100000:1.0:1786015413.938168:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304402816 00000100:00100000:1.0:1786015413.938193:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1786015413.938200:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304402816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015413.938235:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304402816:12345-0@lo:400:kworker.0 Request processed in 35us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015413.938268:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1786015413.938299:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304402816:0@lo:400:kworker.0 00000100:00100000:1.0:1786015413.938324:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786015413.938330:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304402944:0@lo:400:kworker.0 00000100:00100000:1.0:1786015413.938368:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015413.940983:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304402944 00000100:00100000:0.0:1786015413.941010:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304402944 00000100:00100000:0.0:1786015413.941097:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1786015413.941110:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304402944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015413.941209:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304402944:12345-0@lo:400:kworker.0 Request processed in 104us (2840us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015413.941217:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1786015413.941281:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304402944:0@lo:400:kworker.0 00000100:00100000:2.0:1786015413.941492:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304402560:0@lo:400:kworker.0 00000100:00100000:2.0:1786015413.941543:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015413.941568:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304403072:0@lo:400:kworker.0 00000100:00100000:2.0:1786015413.941593:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015413.941629:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786015413.941636:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304402688:0@lo:400:kworker.0 00000100:00100000:2.0:1786015413.941658:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786015413.942316:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015413.942333:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304402560 00000100:00100000:1.0:1786015413.942340:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304402560 00000100:00100000:1.0:1786015413.942428:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304402688 00000100:00100000:1.0:1786015413.942432:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304402688 00000100:00100000:3.0:1786015413.945719:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304403072 00000100:00100000:3.0:1786015413.945734:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304403072 00000100:00100000:3.0:1786015413.945815:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1786015413.945826:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304403072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015413.945988:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304403072:12345-0@lo:400:kworker.0 Request processed in 165us (4393us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015413.945995:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1786015413.946521:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967353 gen 2 00000004:00080000:3.0:1786015413.946528:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967352 committed transno 4294967353 00000004:00080000:3.0:1786015413.946551:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b7383aadc00, transno 4294967353 00000100:00100000:3.0:1786015413.946568:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304403072:0@lo:400:kworker.0 00000100:00100000:0.0:1786015413.951049:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1786015413.951135:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304402560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015413.951269:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304402560:12345-0@lo:400:kworker.0 Request processed in 196us (9714us total) trans 0 rc 0/0 00000100:00080000:1.0:1786015413.951421:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015413.951429:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015413.951532:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1786015413.951591:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1786015413.951606:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304402688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015413.951650:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304402688:12345-0@lo:400:kworker.0 Request processed in 49us (9990us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015413.951657:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1786015413.954803:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304402688:0@lo:400:kworker.0 00000100:00100000:3.0:1786015413.954825:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304402560:0@lo:400:kworker.0 00000001:00080000:1.0:1786015414.017028:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967939 is committed 00000001:00080000:1.0:1786015414.017056:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967928 is committed 00000001:00080000:1.0:1786015414.017070:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967934 is committed 00000001:00080000:1.0:1786015414.017089:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967940 is committed 00000001:00080000:1.0:1786015414.017099:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967936 is committed 00000020:00080000:1.0:1786015414.017110:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b748570aa80 refcount 2 committed 0 result 0 batchid 16 00000020:00080000:1.0:1786015414.017116:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74b0987200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b748570a780 00000020:00080000:1.0:1786015414.017120:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74b0987c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74c20cdc00 00000020:00080000:1.0:1786015414.017134:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 15 batchid updated 00000020:00080000:1.0:1786015414.017227:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 16 committed batchid 15 00000020:00080000:1.0:1786015414.017435:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 15 00000001:00080000:2.0:1786015414.032395:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967346 is committed 00000001:00080000:2.0:1786015414.032420:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967347 is committed 00010000:00010000:1.0:1786015414.132732:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015414.457650:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304403200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015414.458669:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015414.459172:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304403200 00000100:00100000:3.0:1786015414.459182:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304403200 00000100:00100000:3.0:1786015414.459245:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1786015414.459268:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304403200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015414.459310:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 73072640 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015414.459376:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304403200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015414.459384:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1786015414.460577:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304403200:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1786015415.020075:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015415.020085:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015415.020414:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 26 count 3 00000040:00080000:0.0:1786015415.020424:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015415.148289:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015416.172090:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015416.393839:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015416.395466:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280472064 00000100:00100000:0.0:1786015416.395485:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280472064 00000100:00100000:0.0:1786015416.395590:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 986 00000100:00100000:0.0:1786015416.395605:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+40:26472:x1872772280472064:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1786015416.395792:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+40:26472:x1872772280472064:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 191us (1970us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015416.395800:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 986 00000100:00080000:3.0:1786015416.396565:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786015417.197736:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015417.410128:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015417.410184:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015417.410234:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015417.410259:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015417.410276:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015417.410294:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015417.410318:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015417.410381:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280472448 00000100:00100000:2.0:1786015417.410395:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280472448 00000100:00100000:0.0:1786015417.410499:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280472192 00000100:00100000:0.0:1786015417.410504:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280472192 00000100:00100000:0.0:1786015417.410563:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 569 00000100:00100000:0.0:1786015417.410576:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280472192:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015417.410694:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280472192:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 120us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015417.410702:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 569 00000100:00100000:2.0:1786015417.410901:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280472960 00000100:00100000:2.0:1786015417.410905:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280472960 00000100:00100000:2.0:1786015417.410919:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280472576 00000100:00100000:2.0:1786015417.410921:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280472576 00000100:00100000:2.0:1786015417.410935:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280472832 00000100:00100000:2.0:1786015417.410937:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280472832 00000100:00100000:2.0:1786015417.410952:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 393 00000100:00100000:2.0:1786015417.410958:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+13:2354:x1872772280472448:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015417.411013:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+13:2354:x1872772280472448:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 53us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015417.411020:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 393 00000100:00100000:2.0:1786015417.411040:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 394 00000100:00100000:2.0:1786015417.411046:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280472960:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015417.411069:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280472960:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015417.411075:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 394 00000100:00100000:2.0:1786015417.411087:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 395 00000100:00100000:2.0:1786015417.411093:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280472576:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015417.411116:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280472576:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015417.411122:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 395 00000100:00100000:2.0:1786015417.411133:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 396 00000100:00100000:2.0:1786015417.411139:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280472832:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015417.411164:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280472832:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015417.411170:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 396 00000100:00100000:2.0:1786015417.411911:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280472704 00000100:00100000:2.0:1786015417.411921:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280472704 00000100:00100000:2.0:1786015417.411959:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280472320 00000100:00100000:2.0:1786015417.411963:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280472320 00000100:00100000:2.0:1786015417.411992:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 417 00000100:00100000:2.0:1786015417.412000:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+40:2354:x1872772280472704:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015417.412064:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+40:2354:x1872772280472704:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 64us (1838us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015417.412073:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 417 00000100:00100000:2.0:1786015417.412088:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 418 00000100:00100000:2.0:1786015417.412094:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+86:2354:x1872772280472320:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015417.412120:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+86:2354:x1872772280472320:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015417.412126:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 418 00000100:00080000:0.0:1786015417.413382:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015417.413395:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015417.413400:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015417.518720:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381306680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304403328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015417.518836:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015417.518926:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304403328 00000100:00100000:2.0:1786015417.518936:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304403328 00000100:00100000:2.0:1786015417.519005:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1786015417.519014:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304403328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015417.519059:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 78184448 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015417.519109:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304403328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015417.519117:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:2.0:1786015417.519138:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015417.519174:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967347 gen 2 00000004:00080000:2.0:1786015417.519182:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967347 committed transno 4294967347 00000100:00100000:2.0:1786015417.519214:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381306680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304403328:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1786015418.045931:0:19224:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12g: Restore a released file implicitly ========================================================== 07:23:36 (1786015416) 00010000:00010000:1.0:1786015418.220135:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015418.450511:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015418.452392:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280473088 00000100:00100000:0.0:1786015418.452412:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280473088 00000100:00100000:0.0:1786015418.452526:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 987 00000100:00100000:0.0:1786015418.452537:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+40:27121:x1872772280473088:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1786015418.452699:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+40:27121:x1872772280473088:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 162us (2202us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015418.452708:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 987 00000100:00080000:2.0:1786015418.452786:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015418.502636:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015418.502910:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280473216 00000100:00100000:0.0:1786015418.502931:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280473216 00000100:00100000:0.0:1786015418.503012:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 988 00000100:00100000:0.0:1786015418.503026:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+86:27122:x1872772280473216:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015418.503057:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015418.503088:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501671 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8688 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.503186:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501678 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.503224:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.503240:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.505927:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50167f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.505956:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50167f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.505969:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50167f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.506357:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.506367:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501678 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.506375:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501678 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.506389:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015418.506394:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501678 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.506403:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501678 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.506417:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:0.0:1786015418.506421:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015418.506425:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501678 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.506433:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501678 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.506447:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50167f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.506453:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50167f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.506459:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50167f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.506465:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015418.506468:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50167f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.506475:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50167f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.506493:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c43700b (ffff8b748f24a600) 00010000:00010000:0.0:1786015418.506495:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015418.506498:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50167f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.506506:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50167f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.506551:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501671 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8688 expref: 87 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.506561:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:0.0:1786015418.506564:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015418.506567:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501671 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8688 expref: 87 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.506576:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd800, rc 0) 00000100:00100000:0.0:1786015418.506848:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+86:27122:x1872772280473216:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3822us (4226us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015418.506858:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 988 00000100:00100000:3.0:1786015418.518528:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015418.518635:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280473472 00000100:00100000:0.0:1786015418.518645:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280473472 00000100:00100000:0.0:1786015418.518712:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 989 00000100:00100000:0.0:1786015418.518721:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+86:27122:x1872772280473472:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:0.0:1786015418.518822:0:7673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015418.518851:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5013a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e859a expref: 86 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.518891:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:0.0:1786015418.518896:0:7673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015418.519371:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501686 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.519387:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c5013e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85af expref: 39 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.519397:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501686 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.519433:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c5013e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85af expref: 39 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.519447:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c5013e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85af expref: 39 pid: 12526 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015418.519463:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304403456:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015418.519683:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d2240 going to sleep for 11 seconds 00000100:00100000:0.0:1786015418.539096:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304403456:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015418.539140:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501686 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015418.539814:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015418.540202:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280473600 00000100:00100000:1.0:1786015418.540222:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280473600 00010000:00010000:1.0:1786015418.540272:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c5013e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85af expref: 40 pid: 12526 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015418.541184:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 300 00000100:00100000:1.0:1786015418.541200:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+40:2354:x1872772280473600:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015418.541227:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015418.541237:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c5013e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85af expref: 40 pid: 12526 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.541251:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c5013e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85af expref: 40 pid: 12526 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.541272:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c5013e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e85af expref: 40 pid: 12526 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.541287:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:1.0:1786015418.541292:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501686 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.541484:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501686 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.541491:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501686 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.541512:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015418.541573:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+39:2354:x1872772280473600:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 381us (1764us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015418.541578:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 300 00010000:00010000:2.0:1786015418.541654:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501686 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.541660:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501686 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.541682:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50168d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.541690:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50168d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.541695:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50168d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015418.545714:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3e:0x0]: returning size 512 00010000:00010000:2.0:1786015418.545735:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501686 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.545745:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501686 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.545753:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501686 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.545926:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015418.545932:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501686 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.545941:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501686 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.545972:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:2.0:1786015418.545975:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015418.546087:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501686 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.546095:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501686 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015418.546119:0:7673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad6cb2e9 reply state 00000000ca06ce22 transno 4294967941 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50168d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015418.546198:0:7673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786015418.546450:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+87:27122:x1872772280473472:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 27724us (27927us total) trans 4294967941 rc 0/0 00000100:00100000:2.0:1786015418.546460:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 989 00010000:00010000:0.0:1786015418.555570:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50168d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.555589:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50168d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.555610:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50168d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.555616:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015418.555621:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50168d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.555629:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50168d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.555646:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c43700b (ffff8b7499c59e00) 00010000:00010000:0.0:1786015418.555649:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015418.555654:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50168d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.555660:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50168d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015418.568455:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015418.568548:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280473728 00000100:00100000:1.0:1786015418.568612:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280473728 00000100:00100000:1.0:1786015418.568678:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 990 00000100:00100000:1.0:1786015418.568689:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+86:27123:x1872772280473728:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1786015418.568717:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015418.568743:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c501694 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e868f expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.570083:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50169b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.570101:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50169b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.570113:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50169b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015418.570239:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1786015418.570244:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 26 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015418.570268:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50169b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.570293:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c501694 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e868f expref: 88 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.570330:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50169b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e868f expref: 87 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.570338:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:2.0:1786015418.570341:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015418.570345:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906000, rc 0) 00000100:00100000:2.0:1786015418.570420:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+87:27123:x1872772280473728:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1732us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015418.570428:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 990 00000100:00100000:2.0:1786015418.576414:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015418.576511:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280473856 00000100:00100000:0.0:1786015418.576521:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280473856 00000100:00100000:0.0:1786015418.576578:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 991 00000100:00100000:0.0:1786015418.576588:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+87:27123:x1872772280473856:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1786015418.576614:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015418.576637:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5016a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8696 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.576704:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.576735:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.576748:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.576963:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c5016b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.576973:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c5016b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577053:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c5016b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577320:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c5016b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577329:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c5016b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577336:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c5016b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015418.577371:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3e:0x0]: returning size 512 00000004:00200000:0.0:1786015418.577375:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015418.577397:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c5016b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577411:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577429:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577436:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577443:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015418.577447:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577455:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577468:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:0.0:1786015418.577472:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015418.577476:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577483:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577495:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c5016b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577502:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c5016b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577507:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c5016b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577513:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015418.577521:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c5016b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577528:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c5016b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577536:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c43700b (ffff8b748f24a600) 00010000:00010000:0.0:1786015418.577539:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015418.577541:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c5016b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577547:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c5016b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577579:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5016a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8696 expref: 89 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577594:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc400/0xb1a5ef690c5016b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8696 expref: 88 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.577601:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:0.0:1786015418.577603:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786015418.577605:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc400, rc 0) 00000100:00100000:0.0:1786015418.577712:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+88:27123:x1872772280473856:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1124us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015418.577721:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 991 00000100:00100000:3.0:1786015418.583828:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015418.584398:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280473984 00000100:00100000:2.0:1786015418.584410:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280473984 00000100:00100000:2.0:1786015418.584518:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 992 00000100:00100000:2.0:1786015418.584529:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+88:27123:x1872772280473984:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1786015418.584550:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015418.584570:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c5016be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e869d expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584637:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584651:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584662:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584695:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584703:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584710:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584815:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584829:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584836:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584843:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015418.584848:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584856:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584868:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:2.0:1786015418.584871:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015418.584876:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584883:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584901:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584908:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584915:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584920:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015418.584923:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584928:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584936:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff8b7499c59600) 00010000:00010000:2.0:1786015418.584938:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015418.584941:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584946:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.584990:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c5016be lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e869d expref: 89 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.585002:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:2.0:1786015418.588410:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015418.588449:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c5016be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e869d expref: 89 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.588474:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907e00, rc 0) 00000100:00100000:2.0:1786015418.588558:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+88:27123:x1872772280473984:12345-192.168.202.56@tcp:101:bash.0 Request processed in 4030us (4740us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015418.588568:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 992 00000100:00100000:2.0:1786015418.599506:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015418.599618:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280474112 00000100:00100000:0.0:1786015418.599628:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280474112 00000100:00100000:0.0:1786015418.599688:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 993 00000100:00100000:0.0:1786015418.599697:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+39:27124:x1872772280474112:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:0.0:1786015418.599733:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015418.599755:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c5016d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e86a4 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.599876:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.599890:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.599902:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015418.599964:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1786015418.599969:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 26 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015418.600008:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.600032:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c5016d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86a4 expref: 41 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.600050:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86a4 expref: 40 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.600058:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:0.0:1786015418.600061:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015418.600064:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd200, rc 0) 00000100:00100000:0.0:1786015418.600136:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+40:27124:x1872772280474112:12345-192.168.202.56@tcp:101:rm.0 Request processed in 440us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015418.600144:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 993 00000100:00100000:0.0:1786015418.603479:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015418.603597:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280474240 00000100:00100000:2.0:1786015418.603606:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280474240 00000100:00100000:2.0:1786015418.603705:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 994 00000100:00100000:2.0:1786015418.603715:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+40:27124:x1872772280474240:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015418.603736:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015418.603758:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c5016e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e86ab expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.603865:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.603879:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.603892:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.603907:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.603915:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.603941:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604347:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c5016f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604358:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c5016f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604366:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c5016f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015418.604400:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3e:0x0]: returning size 512 00000004:00200000:2.0:1786015418.604404:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015418.604429:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c5016f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604442:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604449:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604456:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604462:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015418.604467:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604476:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604497:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:2.0:1786015418.604500:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015418.604505:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604512:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5016e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604525:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604531:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604537:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604543:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015418.604546:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604552:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604558:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c43700b (ffff8b7499c59600) 00010000:00010000:2.0:1786015418.604561:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015418.604563:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604569:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5016ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604611:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c5016e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86ab expref: 42 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604625:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907200/0xb1a5ef690c5016f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86ab expref: 41 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.604633:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:2.0:1786015418.604635:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786015418.604638:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907200, rc 0) 00000100:00100000:2.0:1786015418.604717:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+41:27124:x1872772280474240:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1003us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015418.604725:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 994 00000100:00100000:3.0:1786015418.613508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015418.613589:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280474368 00000100:00100000:2.0:1786015418.613600:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280474368 00000100:00100000:2.0:1786015418.613661:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 995 00000100:00100000:2.0:1786015418.613670:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+41:27124:x1872772280474368:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015418.613693:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015418.613716:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5016fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e86b2 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614033:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501704 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614049:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501704 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614060:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501704 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614084:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c50170b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614093:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c50170b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614100:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c50170b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614169:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501704 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614177:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501704 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614183:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501704 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614189:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015418.614193:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501704 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614202:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501704 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614226:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:2.0:1786015418.614229:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015418.614235:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501704 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614242:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501704 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614264:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c50170b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614271:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c50170b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614277:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c50170b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614282:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7381935200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015418.614285:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c50170b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614291:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c50170b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614299:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff8b7499c59500) 00010000:00010000:2.0:1786015418.614301:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015418.614304:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c50170b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614310:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c50170b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614348:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5016fd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86b2 expref: 42 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614360:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:2.0:1786015418.614363:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015418.614372:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5016fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86b2 expref: 42 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.614382:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906e00, rc 0) 00000100:00100000:3.0:1786015418.619093:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+41:27124:x1872772280474368:12345-192.168.202.56@tcp:101:rm.0 Request processed in 5410us (5580us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015418.619107:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 995 00000100:00100000:3.0:1786015418.632652:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015418.632814:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280474496 00000100:00100000:2.0:1786015418.632835:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280474496 00000100:00100000:2.0:1786015418.632943:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 996 00000100:00100000:2.0:1786015418.632954:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+41:27124:x1872772280474496:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015418.632978:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015418.633000:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501712 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e86b9 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633073:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501719 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633089:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501719 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633102:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501719 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633118:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501720 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633125:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633133:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633204:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501719 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633239:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501719 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633247:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501719 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633253:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015418.633258:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501719 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633266:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501719 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633278:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:2.0:1786015418.633281:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015418.633285:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501719 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633292:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c501719 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633305:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633311:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501720 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633317:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501720 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633322:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015418.633332:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501720 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633338:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501720 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633345:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff8b7499c59500) 00010000:00010000:2.0:1786015418.633348:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015418.633351:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501720 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633356:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501720 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633395:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501712 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86b9 expref: 42 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633406:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:2.0:1786015418.633408:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015418.633411:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501712 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86b9 expref: 42 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.633420:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906e00, rc 0) 00000100:00100000:2.0:1786015418.633488:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+41:27124:x1872772280474496:12345-192.168.202.56@tcp:101:rm.0 Request processed in 536us (844us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015418.633496:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 996 00000100:00100000:2.0:1786015418.665331:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015418.666305:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280474624 00000100:00100000:0.0:1786015418.666317:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280474624 00000100:00100000:1.0:1786015418.666557:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 997 00000100:00100000:1.0:1786015418.666582:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+41:27125:x1872772280474624:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015418.666612:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015418.666644:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501727 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e86c0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667004:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50172e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667022:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50172e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667036:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50172e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667054:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501735 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667062:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667069:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667182:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50172e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667190:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50172e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667196:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50172e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667202:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015418.667207:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50172e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667248:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50172e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667263:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:1.0:1786015418.667266:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015418.667272:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50172e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667278:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50172e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667293:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667310:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501735 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667318:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501735 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667331:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015418.667334:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501735 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667342:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501735 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667350:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff8b7483ee6500) 00010000:00010000:1.0:1786015418.667353:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015418.667356:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501735 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667362:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501735 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667406:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501727 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86c0 expref: 42 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667417:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:1.0:1786015418.667420:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015418.667423:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501727 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86c0 expref: 42 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.667433:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46400, rc 0) 00000100:00100000:1.0:1786015418.667529:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+41:27125:x1872772280474624:12345-192.168.202.56@tcp:101:cp.0 Request processed in 957us (2207us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015418.667539:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 997 00000100:00100000:3.0:1786015418.672280:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015418.673934:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280474752 00000100:00100000:0.0:1786015418.673955:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280474752 00000100:00100000:0.0:1786015418.674052:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 998 00000100:00100000:0.0:1786015418.674064:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+41:27125:x1872772280474752:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015418.674093:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015418.674123:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c50173c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e86c7 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674224:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501743 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674243:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501743 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674258:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501743 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674276:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50174a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674283:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50174a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674290:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50174a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674375:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501743 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674404:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501743 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674411:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501743 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674418:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015418.674424:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501743 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674432:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501743 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674446:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:0.0:1786015418.674450:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015418.674455:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501743 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674461:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501743 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674477:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50174a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674483:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50174a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674489:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50174a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674495:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015418.674505:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50174a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674512:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50174a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674520:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff8b748f24a600) 00010000:00010000:0.0:1786015418.674523:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015418.674526:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50174a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674532:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50174a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674577:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c50173c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86c7 expref: 42 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674589:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:0.0:1786015418.674592:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015418.674595:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c50173c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86c7 expref: 42 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.674606:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd600, rc 0) 00000100:00100000:0.0:1786015418.678071:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+41:27125:x1872772280474752:12345-192.168.202.56@tcp:101:cp.0 Request processed in 3990us (5786us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015418.678090:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 998 00000100:00100000:3.0:1786015418.682035:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015418.682233:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280475008 00000100:00100000:2.0:1786015418.682247:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280475008 00000100:00100000:2.0:1786015418.682327:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 999 00000100:00100000:2.0:1786015418.682357:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+41:27125:x1872772280475008:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015418.682389:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015418.682421:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501751 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e86ce expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.682600:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501758 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.682619:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501758 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.682633:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501758 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.682651:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c50175f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.682671:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c50175f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.684441:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c50175f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786015418.685464:0:5796:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x16:0x0], index 1: 0 00010000:00010000:2.0:1786015418.685712:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501766 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.685730:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.685745:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.685838:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501758 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.685846:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501758 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.685854:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501758 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.685862:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015418.685867:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501758 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.685876:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501758 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.685891:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:2.0:1786015418.685895:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015418.685900:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501758 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.685907:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501758 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015418.685923:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000068d7045d reply state 00000000e2e52fb6 transno 4294967942 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c50175f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015418.685934:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786015418.685984:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501751 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86ce expref: 44 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.686012:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501766 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86ce expref: 43 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.686021:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:2.0:1786015418.686023:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015418.686026:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907600, rc 0) 00000100:00100000:2.0:1786015418.686131:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+44:27125:x1872772280475008:12345-192.168.202.56@tcp:101:cp.0 Request processed in 3776us (4108us total) trans 4294967942 rc 0/0 00000100:00100000:2.0:1786015418.686141:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 999 00010000:00010000:0.0:1786015418.690512:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c50175f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.690546:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c50175f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.690575:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c50175f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.690583:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015418.690589:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c50175f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.690599:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c50175f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.690620:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff8b7499c59500) 00010000:00010000:0.0:1786015418.690624:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015418.690630:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c50175f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.690637:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906400/0xb1a5ef690c50175f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015418.695367:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015418.696487:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280475136 00000100:00100000:2.0:1786015418.696508:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280475136 00000100:00100000:2.0:1786015418.696606:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 257 00000100:00100000:2.0:1786015418.696619:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2352:x1872772280475136:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015418.696648:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015418.696690:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501774 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e86d5 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015418.696727:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786015418.696756:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=653s v=(0 0) 00010000:00010000:2.0:1786015418.696806:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015418.696819:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501774 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86d5 expref: 11 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.696854:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501774 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86d5 expref: 11 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.696901:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906e00, rc 0) 00000100:00100000:2.0:1786015418.696993:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280475136:12345-192.168.202.56@tcp:101:cp.0 Request processed in 377us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015418.697001:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 257 00000100:00100000:3.0:1786015418.702459:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015418.702851:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280475264 00000100:00100000:2.0:1786015418.702865:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280475264 00000100:00100000:1.0:1786015418.703037:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 258 00000100:00100000:1.0:1786015418.703083:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:27125:x1872772280475264:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015418.703106:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015418.703130:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c50177b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e86dc expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.703165:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501774 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86d5 expref: 12 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.703175:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015418.703179:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015418.703184:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c50177b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86dc expref: 12 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.703228:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501774 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86d5 expref: 12 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.703243:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501774 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86d5 expref: 12 pid: 6592 timeout: 753 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015418.703257:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304403584:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015418.703373:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf5ec900 going to sleep for 11 seconds 00000100:00100000:1.0:1786015418.707872:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304403584:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015418.707910:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c50177b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86dc expref: 12 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.707953:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46400, rc 0) 00000100:00100000:1.0:1786015418.708013:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+12:27125:x1872772280475264:12345-192.168.202.56@tcp:101:cp.0 Request processed in 4943us (5570us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015418.708023:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 258 00000100:00100000:3.0:1786015418.708990:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015418.709095:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280475392 00000100:00100000:2.0:1786015418.709108:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280475392 00010000:00010000:2.0:1786015418.709164:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501774 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86d5 expref: 12 pid: 6592 timeout: 753 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015418.709223:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 301 00000100:00100000:2.0:1786015418.709235:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280475392:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015418.709253:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015418.709283:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501774 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86d5 expref: 12 pid: 6592 timeout: 753 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.709298:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501774 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86d5 expref: 12 pid: 6592 timeout: 753 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.709327:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501774 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86d5 expref: 12 pid: 6592 timeout: 753 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.709348:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015418.709369:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015418.709380:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c50177b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86dc expref: 11 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.709392:0:17038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c50177b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86dc expref: 11 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015418.709622:0:17038:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c50177b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86dc expref: 11 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015418.709638:0:17038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381307480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17038:1872772304403712:192.168.202.56@tcp:105: 00000100:00100000:3.0:1786015418.710192:0:17038:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb4240 going to sleep for 11 seconds 00000100:00100000:3.0:1786015418.715044:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015418.715176:0:17038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381307480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17038:1872772304403712:192.168.202.56@tcp:105: 00010000:00010000:1.0:1786015418.715232:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015418.715301:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280475392:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 6068us (6321us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015418.715314:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 301 00000100:00100000:2.0:1786015418.715700:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280475648 00000100:00100000:2.0:1786015418.715711:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280475648 00000100:00100000:2.0:1786015418.715809:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 199 00000100:00100000:2.0:1786015418.715819:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:27125:x1872772280475648:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:2.0:1786015418.716261:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+44:27125:x1872772280475648:12345-192.168.202.56@tcp:35:cp.0 Request processed in 442us (1230us total) trans 4294967943 rc 0/0 00000100:00100000:2.0:1786015418.716270:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 199 00000100:00100000:3.0:1786015418.788184:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015418.798124:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280475776 00000100:00100000:1.0:1786015418.798148:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280475776 00000100:00100000:1.0:1786015418.798274:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1000 00000100:00100000:1.0:1786015418.798289:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+88:27128:x1872772280475776:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015418.798320:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015418.798352:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501782 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e86e3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798457:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501789 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798476:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501789 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798492:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501789 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798540:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501790 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798549:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798556:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798690:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501797 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798699:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798706:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015418.798748:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00000004:00200000:1.0:1786015418.798754:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015418.798808:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798823:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798833:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501789 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798840:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501789 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798859:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501789 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798867:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015418.798872:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501789 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798881:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501789 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798896:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:1.0:1786015418.798900:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015418.798906:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501789 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798913:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501789 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798929:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798935:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501790 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798940:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501790 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798945:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015418.798947:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501790 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798963:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501790 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798970:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff8b7483ee6500) 00010000:00010000:1.0:1786015418.798973:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015418.798975:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501790 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.798981:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501790 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.799019:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501782 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86e3 expref: 90 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.799036:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501797 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86e3 expref: 89 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.799045:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:1.0:1786015418.799048:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015418.799051:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47600, rc 0) 00000100:00100000:1.0:1786015418.799153:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+89:27128:x1872772280475776:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 866us (10983us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015418.799161:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1000 00000100:00100000:0.0:1786015418.807030:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015418.807363:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280475904 00000100:00100000:1.0:1786015418.807378:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280475904 00000100:00100000:1.0:1786015418.807464:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 259 00000100:00100000:1.0:1786015418.807477:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280475904:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015418.807526:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015418.807553:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c50179e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e86ea expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015418.807626:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304403840:192.168.202.56@tcp:106: 00000100:00100000:1.0:1786015418.807749:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf5ec900 going to sleep for 11 seconds 00002000:00010000:1.0:1786015418.818271:0:6590:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1786015418.818285:0:6590:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb mtime: 0 -> 1786015418 00002000:00010000:1.0:1786015418.818288:0:6590:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb atime: 0 -> 1786015418 00002000:00010000:1.0:1786015418.818291:0:6590:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb ctime: 0 -> 1786015418 00000100:00100000:1.0:1786015418.818604:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304403840:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015418.818657:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c50179e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86ea expref: 13 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.819199:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c50179e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86ea expref: 13 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015418.819227:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47a00, rc 0) 00000100:00100000:2.0:1786015418.825881:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280475904:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 18388us (18850us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015418.825901:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 259 00000100:00100000:3.0:1786015418.844903:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015418.848412:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280476032 00000100:00100000:0.0:1786015418.848436:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280476032 00000100:00100000:0.0:1786015418.848555:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1001 00000100:00100000:0.0:1786015418.848568:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+89:27128:x1872772280476032:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015418.848597:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015418.848628:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5017a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e86f1 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.848752:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5017ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.848815:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5017ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.848829:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5017ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015418.848906:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3e:0x0]: returning size 512 00000004:00200000:0.0:1786015418.848911:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015418.848938:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5017ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.848969:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5017a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86f1 expref: 91 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.848993:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5017ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86f1 expref: 90 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.849004:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:0.0:1786015418.849007:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015418.849012:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afda00, rc 0) 00000100:00100000:0.0:1786015418.850672:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+90:27128:x1872772280476032:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 2092us (5769us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015418.850688:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1001 00000100:00100000:0.0:1786015418.859967:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015418.860430:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280476160 00000100:00100000:3.0:1786015418.860445:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280476160 00000100:00100000:3.0:1786015418.860524:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 260 00000100:00100000:3.0:1786015418.860534:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+12:2351:x1872772280476160:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015418.860558:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015418.860579:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5017b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e86f8 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015418.860670:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304403968:192.168.202.56@tcp:106: 00000100:00100000:3.0:1786015418.860817:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748570a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015418.866979:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304403968:192.168.202.56@tcp:106: 00010000:00010000:0.0:1786015418.867026:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5017b3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86f8 expref: 13 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.867091:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c5017b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86f8 expref: 13 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015418.867105:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbde00, rc 0) 00000100:00100000:0.0:1786015418.867177:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+12:2351:x1872772280476160:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 6643us (7225us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015418.867188:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 260 00000100:00100000:0.0:1786015418.878828:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015418.878940:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280476416 00000100:00100000:2.0:1786015418.878953:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280476416 00000100:00100000:2.0:1786015418.879018:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1002 00000100:00100000:2.0:1786015418.879029:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+90:27128:x1872772280476416:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:2.0:1786015418.879408:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].26, 136 off11728 00000100:00100000:2.0:1786015418.879551:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+90:27128:x1872772280476416:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 523us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015418.879560:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1002 00000100:00100000:3.0:1786015419.053456:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304404096:0@lo:400:kworker.0 00000100:00100000:3.0:1786015419.053575:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015419.053644:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304404608:0@lo:400:kworker.0 00000100:00100000:3.0:1786015419.053673:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015419.053709:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786015419.053716:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304404480:0@lo:400:kworker.0 00000100:00100000:3.0:1786015419.053748:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015419.053806:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304404224:0@lo:400:kworker.0 00000100:00100000:3.0:1786015419.053828:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015419.053845:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304404352:0@lo:400:kworker.0 00000100:00100000:3.0:1786015419.053848:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304404736:0@lo:400:kworker.0 00000100:00100000:3.0:1786015419.053870:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015419.053901:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304404480 00000100:00100000:3.0:1786015419.053911:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304404480 00000100:00100000:3.0:1786015419.053978:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304404736 00000100:00100000:3.0:1786015419.053981:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304404736 00000100:00100000:3.0:1786015419.054004:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1786015419.054012:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304404480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015419.054177:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015419.054232:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304404608 00000100:00100000:0.0:1786015419.054238:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304404608 00000100:00100000:0.0:1786015419.054276:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304404224 00000100:00100000:0.0:1786015419.054279:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304404224 00000100:00100000:1.0:1786015419.055424:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304404096 00000100:00100000:0.0:1786015419.055431:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304404352 00000100:00100000:1.0:1786015419.055437:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304404096 00000100:00100000:1.0:1786015419.055493:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:1.0:1786015419.055504:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304404096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015419.055573:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304404352 00000100:00100000:1.0:1786015419.055604:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304404096:12345-0@lo:400:kworker.0 Request processed in 103us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015419.055613:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:1.0:1786015419.056958:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304404096:0@lo:400:kworker.0 00000100:00100000:1.0:1786015419.057017:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1786015419.057033:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304404736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015419.057141:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304404736:12345-0@lo:400:kworker.0 Request processed in 114us (3268us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015419.057149:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1786015419.057198:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304404736:0@lo:400:kworker.0 00000100:00100000:0.0:1786015419.057251:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1786015419.058116:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1786015419.058131:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304404224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015419.058230:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304404224:12345-0@lo:400:kworker.0 Request processed in 104us (4400us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015419.058238:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1786015419.058299:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304404224:0@lo:400:kworker.0 00000100:00100000:1.0:1786015419.058333:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00080000:3.0:1786015419.058405:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015419.058414:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015419.058418:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015419.058580:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304404480:12345-0@lo:400:kworker.0 Request processed in 4567us (4829us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015419.058588:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1786015419.058711:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304404352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015419.059324:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304404480:0@lo:400:kworker.0 00000100:00100000:1.0:1786015419.059405:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304404352:12345-0@lo:400:kworker.0 Request processed in 1064us (5228us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015419.059415:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:1.0:1786015419.059454:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304404352:0@lo:400:kworker.0 00000100:00100000:1.0:1786015419.059500:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304404608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015419.059858:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304404608:0@lo:400:kworker.0 00000100:00100000:1.0:1786015419.060898:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304404608:12345-0@lo:400:kworker.0 Request processed in 3620us (7215us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015419.060921:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000040:00080000:0.0:1786015419.119579:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015419.119593:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015419.119643:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 27 count 4 00000040:00080000:0.0:1786015419.119651:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015419.121198:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa475880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304404864:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786015419.124175:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015419.135461:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa475880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304404864:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786015419.142672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015419.142824:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280476544 00000100:00100000:3.0:1786015419.142837:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280476544 00000100:00100000:3.0:1786015419.142914:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1003 00000100:00100000:3.0:1786015419.142925:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+44:27138:x1872772280476544:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015419.142981:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015419.143118:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+44:27138:x1872772280476544:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 194us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015419.143126:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1003 00000100:00100000:3.0:1786015419.158291:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015419.158346:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280476800 00000100:00100000:0.0:1786015419.158366:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280476800 00000100:00100000:0.0:1786015419.158450:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1004 00000100:00100000:0.0:1786015419.158462:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+44:27138:x1872772280476800:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015419.158491:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015419.158520:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5017ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e86ff expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.158657:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5017c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.158675:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5017c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.158691:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5017c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015419.158705:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00010000:00010000:0.0:1786015419.159004:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5017ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86ff expref: 47 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.159023:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5017c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86ff expref: 46 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.159034:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:0.0:1786015419.159037:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015419.159042:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc200, rc 0) 00000100:00100000:0.0:1786015419.159127:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+46:27138:x1872772280476800:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 667us (851us total) trans 4294967944 rc 0/0 00000100:00100000:0.0:1786015419.159148:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1004 00000100:00100000:1.0:1786015419.166748:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015419.167055:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015419.167095:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280476928 00000100:00100000:1.0:1786015419.167108:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280476928 00000100:00100000:1.0:1786015419.167189:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:1.0:1786015419.167202:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+46:2354:x1872772280476928:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015419.167236:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015419.167276:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5017c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86ff expref: 46 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.167300:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:1.0:1786015419.167307:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015419.167375:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+45:2354:x1872772280476928:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 176us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015419.167383:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:1.0:1786015419.167471:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280477056 00000100:00100000:1.0:1786015419.167476:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280477056 00000100:00100000:1.0:1786015419.167518:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 261 00000100:00100000:1.0:1786015419.167526:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280477056:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015419.167580:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c5017cf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.167604:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c50177b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86dc expref: 11 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.167637:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x16:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786015419.167642:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015419.167647:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c5017cf lrc: 4/1,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.167691:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c50177b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86dc expref: 11 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.167707:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c50177b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86dc expref: 11 pid: 11384 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015419.167725:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304404992:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015419.168293:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce00c0 going to sleep for 11 seconds 00000100:00080000:1.0:1786015419.168319:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015419.179686:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015419.179736:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280477184 00000100:00100000:1.0:1786015419.179749:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280477184 00002000:00100000:1.0:1786015419.182971:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x16:0x0] (0->157) req@ffff8b74c103d180 x1872772280477184/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:265/0 lens 648/0 e 0 to 0 dl 1786015430 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015419.182991:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c103d180 with x1872772280477184 ext(0->157) 00010000:00010000:1.0:1786015419.183007:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c50177b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86dc expref: 12 pid: 11384 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.183029:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c50177b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86dc expref: 12 pid: 11384 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015419.183072:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b74c103d180 00000100:00100000:1.0:1786015419.183185:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:1.0:1786015419.183198:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280477184:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:1.0:1786015419.184757:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2354:x1872772280477184:12345-192.168.202.56@tcp:4:cp.0 Request processed in 1551us (5075us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1786015419.184874:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00002000:00100000:1.0:1786015419.184889:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x16:0x0] (0->157) req@ffff8b74c103d180 x1872772280477184/t4294967354(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:265/0 lens 648/448 e 0 to 0 dl 1786015430 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015419.184901:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c103d180 with x1872772280477184 ext(0->157) 00010000:00010000:1.0:1786015419.184912:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c50177b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86dc expref: 14 pid: 11384 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.184933:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c50177b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86dc expref: 14 pid: 11384 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015419.184941:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b74c103d180 00000100:00100000:3.0:1786015419.185074:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304404992:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015419.185105:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c5017cf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1786015419.192072:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 16 batchid updated 00000001:00080000:1.0:1786015419.192137:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967943 is committed 00000001:00080000:1.0:1786015419.192147:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967941 is committed 00000020:00080000:0.0:1786015419.192500:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16 00000020:00080000:0.0:1786015419.192516:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16 00000100:00100000:0.0:1786015419.197576:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015419.200791:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280477312 00000100:00100000:1.0:1786015419.200809:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280477312 00010000:00010000:0.0:1786015419.200988:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c50177b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86dc expref: 14 pid: 11384 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015419.201048:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 302 00000100:00100000:0.0:1786015419.201061:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2352:x1872772280477312:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015419.201085:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015419.201118:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c50177b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86dc expref: 14 pid: 11384 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.201136:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c50177b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86dc expref: 14 pid: 11384 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.201168:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c50177b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86dc expref: 14 pid: 11384 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.201186:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015419.201191:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015419.201199:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c5017cf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.201220:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c5017cf lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.201267:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015419.201347:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2352:x1872772280477312:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 288us (3786us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015419.201356:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 302 00010000:00010000:2.0:1786015419.201812:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c5017cf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.201825:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c5017cf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.201862:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c5017cf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.201871:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c5017cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.201878:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c5017cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.201886:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47a00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015419.201890:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c5017cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.201901:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c5017cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.201916:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c5017cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.201936:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c5017cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015419.202003:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2351:x1872772280477056:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 34477us (34948us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015419.202013:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 261 00000100:00100000:1.0:1786015419.204440:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015419.204566:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280477568 00000100:00100000:2.0:1786015419.204580:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280477568 00000100:00100000:2.0:1786015419.204658:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1005 00000100:00100000:2.0:1786015419.204669:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:27138:x1872772280477568:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015419.204860:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:27138:x1872772280477568:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 192us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015419.204868:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1005 00000100:00100000:1.0:1786015419.212451:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015419.212589:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280477696 00000100:00100000:3.0:1786015419.212602:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280477696 00000100:00100000:3.0:1786015419.212688:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 262 00000100:00100000:3.0:1786015419.212700:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280477696:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015419.212728:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015419.212757:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e1205ff/0xb1a5ef690c5017d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8706 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015419.212839:0:14547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 158, mtime: 0x6a746eba, atime: 0x0, ctime: 0x6a746eba, blocks: 0x1 00010000:00010000:3.0:1786015419.212867:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=654s v=(0 0) 00010000:00010000:3.0:1786015419.212872:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015419.212894:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e1205ff/0xb1a5ef690c5017d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8706 expref: 13 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015419.212915:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006e1205ff/0xb1a5ef690c5017d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8706 expref: 13 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015419.212933:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc800, rc 0) 00000100:00100000:3.0:1786015419.213009:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280477696:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 311us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015419.213016:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 262 00000100:00100000:1.0:1786015419.216018:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015419.216231:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280477952 00000100:00100000:0.0:1786015419.216244:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280477952 00000100:00100000:0.0:1786015419.216847:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1006 00000100:00100000:0.0:1786015419.216870:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+43:27138:x1872772280477952:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015419.217040:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+43:27138:x1872772280477952:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 177us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015419.217049:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1006 00000100:00100000:2.0:1786015419.221633:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015419.222885:0:17969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280478080 00000100:00100000:1.0:1786015419.222904:0:17969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280478080 00002000:00100000:1.0:1786015419.222980:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x16:0x0] (0->4095) req@ffff8b7381304e00 x1872772280478080/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:265/0 lens 488/0 e 0 to 0 dl 1786015430 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015419.222993:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381304e00 with x1872772280478080 ext(0->4095) 00002000:00010000:1.0:1786015419.223001:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7381304e00 00000100:00100000:1.0:1786015419.223038:0:17969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 93 00000100:00100000:1.0:1786015419.223049:0:17969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280478080:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1786015419.223405:0:17969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280478080:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 358us (1783us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786015419.223415:0:17969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 93 00002000:00100000:1.0:1786015419.223423:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x16:0x0] (0->4095) req@ffff8b7381304e00 x1872772280478080/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:265/0 lens 488/4536 e 0 to 0 dl 1786015430 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015419.223431:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381304e00 with x1872772280478080 ext(0->4095) 00002000:00010000:1.0:1786015419.223435:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7381304e00 00000100:00100000:3.0:1786015419.236238:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015419.236999:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280478208 00000100:00100000:1.0:1786015419.237014:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280478208 00000100:00100000:1.0:1786015419.237099:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1007 00000100:00100000:1.0:1786015419.237112:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+43:27138:x1872772280478208:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015419.237145:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015419.237175:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5017dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e870d expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.237236:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5017e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.237281:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5017e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.237305:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5017e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.237456:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5017dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e870d expref: 45 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.237478:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5017e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e870d expref: 44 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.237488:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:1.0:1786015419.237491:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015419.237496:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46e00, rc 0) 00000100:00100000:1.0:1786015419.237594:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:27138:x1872772280478208:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 484us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015419.237603:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1007 00000100:00100000:3.0:1786015419.244299:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015419.244410:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280478336 00000100:00100000:2.0:1786015419.244425:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280478336 00000100:00100000:2.0:1786015419.244502:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1008 00000100:00100000:2.0:1786015419.244514:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+44:27138:x1872772280478336:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015419.244559:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015419.244699:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+44:27138:x1872772280478336:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 188us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015419.244708:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1008 00010000:00010000:1.0:1786015419.246115:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015419.251514:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015419.251806:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280478464 00000100:00100000:2.0:1786015419.251820:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280478464 00000100:00100000:2.0:1786015419.251916:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 263 00000100:00100000:2.0:1786015419.252100:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2352:x1872772280478464:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786015419.252162:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c5017eb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.252183:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015419.252188:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015419.252196:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c5017eb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.252240:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c5017eb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.252283:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c5017eb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.252291:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c5017eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.252300:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c5017eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.252308:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906e00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015419.252313:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c5017eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.252323:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c5017eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.252350:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c5017eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.252359:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c5017eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015419.252571:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2352:x1872772280478464:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 475us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015419.252579:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 263 00000100:00100000:2.0:1786015419.258476:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015419.258741:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280478720 00000100:00100000:1.0:1786015419.258755:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280478720 00000100:00100000:1.0:1786015419.258862:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1009 00000100:00100000:1.0:1786015419.258874:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+44:27138:x1872772280478720:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786015419.258987:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5017f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.259009:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5017e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e870d expref: 44 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.259040:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5017f2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.259089:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5017e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e870d expref: 44 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.259109:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5017e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e870d expref: 44 pid: 7673 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015419.259130:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304405120:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015419.261475:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786015419.268387:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015419.268498:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304405120:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015419.268538:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5017f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015419.270669:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280478848 00000100:00100000:1.0:1786015419.270957:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280478848 00010000:00010000:1.0:1786015419.271023:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5017e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e870d expref: 45 pid: 7673 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015419.272470:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 303 00000100:00100000:1.0:1786015419.272496:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:2354:x1872772280478848:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015419.272523:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015419.272536:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5017e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e870d expref: 45 pid: 7673 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.272556:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5017e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e870d expref: 45 pid: 7673 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.272585:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5017e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e870d expref: 45 pid: 7673 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.272627:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:1.0:1786015419.272634:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5017f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.272645:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5017f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.272655:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5017f2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.272699:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015419.272807:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2354:x1872772280478848:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 322us (4433us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015419.272816:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 303 00010000:00010000:0.0:1786015419.276306:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5017f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.276332:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5017f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.276634:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5017f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.276644:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5017f2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.276662:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5017f2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.276668:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015419.276673:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5017f2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.276693:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5017f2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.276715:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:0.0:1786015419.276718:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015419.276724:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5017f2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.276731:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c5017f2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015419.276981:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+44:27138:x1872772280478720:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 18102us (18513us total) trans 4294967945 rc 0/0 00000100:00100000:0.0:1786015419.276994:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1009 00000040:00080000:3.0:1786015419.277218:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015419.277224:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015419.277714:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1786015419.277725:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015419.288566:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015419.288608:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280479104 00000100:00100000:3.0:1786015419.288623:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280479104 00000100:00100000:3.0:1786015419.288723:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 200 00000100:00100000:3.0:1786015419.288736:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+44:27138:x1872772280479104:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786015419.289311:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:27138:x1872772280479104:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 577us (758us total) trans 4294967946 rc 0/0 00000100:00100000:3.0:1786015419.289321:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 200 00000100:00100000:1.0:1786015419.571606:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304405248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015419.571681:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015419.571798:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304405248 00000100:00100000:3.0:1786015419.571817:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304405248 00000100:00100000:3.0:1786015419.571879:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1786015419.571890:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304405248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015419.571915:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 76480512 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015419.573691:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304405248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1795us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015419.573704:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1786015419.574232:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304405248:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1786015419.605106:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967354 is committed 00000040:00080000:3.0:1786015419.786581:0:19277:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015419.786590:0:19277:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015419.786634:0:19277:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 27 count 4 00000040:00080000:3.0:1786015419.786639:0:19277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015419.856537:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015419.856714:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280479232 00000100:00100000:2.0:1786015419.856726:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280479232 00000100:00100000:2.0:1786015419.856851:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 264 00000100:00100000:2.0:1786015419.856860:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280479232:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015419.856878:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015419.856900:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ab306ff/0xb1a5ef690c5017f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8714 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.856926:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786015419.856930:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015419.856939:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ab306ff/0xb1a5ef690c5017f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8714 expref: 13 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.856970:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ab306ff/0xb1a5ef690c5017f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8714 expref: 13 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.856999:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907e00, rc 0) 00000100:00100000:2.0:1786015419.857053:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+13:2353:x1872772280479232:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 194us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015419.857060:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 264 00000100:00080000:1.0:1786015419.866703:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015419.866818:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015419.867002:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280479488 00000100:00100000:1.0:1786015419.867012:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280479488 00000100:00100000:1.0:1786015419.867090:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1010 00000100:00100000:1.0:1786015419.867100:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+89:27139:x1872772280479488:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015419.867123:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015419.867153:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501800 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e871b expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786015419.867229:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786015419.867498:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501807 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.867514:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501807 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.867528:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501807 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015419.867542:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00010000:00010000:1.0:1786015419.868380:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501800 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e871b expref: 92 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.868476:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501807 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e871b expref: 91 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.868485:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:1.0:1786015419.868489:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786015419.868492:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46e00, rc 0) 00000100:00100000:1.0:1786015419.868567:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+91:27139:x1872772280479488:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1467us (1754us total) trans 4294967947 rc 0/0 00000100:00100000:1.0:1786015419.868576:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1010 00000100:00100000:1.0:1786015419.871578:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015419.871844:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280479616 00000100:00100000:3.0:1786015419.871854:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280479616 00000100:00100000:3.0:1786015419.872514:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 265 00000100:00100000:3.0:1786015419.872525:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+13:2354:x1872772280479616:12345-192.168.202.56@tcp:1:lfs.0 00010000:00010000:3.0:1786015419.872566:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b666d611/0xb1a5ef690c501815 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015419.872582:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006e1205ff/0xb1a5ef690c5017d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8706 expref: 10 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015419.872588:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ab306ff/0xb1a5ef690c5017f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8714 expref: 13 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015419.872593:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015419.872596:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015419.872605:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b666d611/0xb1a5ef690c501815 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015419.872635:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ab306ff/0xb1a5ef690c5017f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8714 expref: 13 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015419.872648:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ab306ff/0xb1a5ef690c5017f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8714 expref: 13 pid: 6591 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015419.872663:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1221880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304405376:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015419.872784:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006e1205ff/0xb1a5ef690c5017d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8706 expref: 10 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015419.872793:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006e1205ff/0xb1a5ef690c5017d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8706 expref: 10 pid: 14547 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015419.872803:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1220a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304405504:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015419.872831:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0175300 going to sleep for 11 seconds 00000100:00100000:3.0:1786015419.878637:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015419.878817:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1221880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304405376:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015419.879061:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280479744 00000100:00100000:0.0:1786015419.879069:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280479744 00010000:00010000:0.0:1786015419.879107:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ab306ff/0xb1a5ef690c5017f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8714 expref: 14 pid: 6591 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015419.881798:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 304 00000100:00100000:0.0:1786015419.881815:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b024cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+14:2353:x1872772280479744:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015419.881846:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786015419.881867:0:5781:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1786015419.881873:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ab306ff/0xb1a5ef690c5017f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8714 expref: 14 pid: 6591 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.881887:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ab306ff/0xb1a5ef690c5017f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8714 expref: 14 pid: 6591 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.881906:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ab306ff/0xb1a5ef690c5017f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8714 expref: 14 pid: 6591 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.881918:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015419.881986:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b024cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+13:2353:x1872772280479744:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 177us (3358us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015419.881995:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 304 00000100:00100000:1.0:1786015419.891219:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015419.891271:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1220a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304405504:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015419.891352:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b666d611/0xb1a5ef690c501815 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015419.891386:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280479872 00000100:00100000:1.0:1786015419.891393:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280479872 00010000:00010000:1.0:1786015419.891429:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006e1205ff/0xb1a5ef690c5017d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8706 expref: 11 pid: 14547 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015419.893034:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 305 00000100:00100000:1.0:1786015419.893054:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280479872:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015419.893073:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015419.893102:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006e1205ff/0xb1a5ef690c5017d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8706 expref: 11 pid: 14547 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.893120:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006e1205ff/0xb1a5ef690c5017d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8706 expref: 11 pid: 14547 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.893146:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e1205ff/0xb1a5ef690c5017d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8706 expref: 11 pid: 14547 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.893165:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015419.893170:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015419.893176:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b666d611/0xb1a5ef690c501815 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.893188:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b666d611/0xb1a5ef690c501815 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.893237:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015419.893308:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280479872:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 264us (2106us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015419.893316:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 305 00010000:00010000:1.0:1786015419.893350:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b666d611/0xb1a5ef690c501815 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.893359:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b666d611/0xb1a5ef690c501815 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.893383:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b666d611/0xb1a5ef690c501815 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.893392:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b666d611/0xb1a5ef690c501815 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.893400:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b666d611/0xb1a5ef690c501815 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.893408:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd800 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015419.893412:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b666d611/0xb1a5ef690c501815 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.893421:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b666d611/0xb1a5ef690c501815 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.893860:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b666d611/0xb1a5ef690c501815 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.893869:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b666d611/0xb1a5ef690c501815 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015419.893924:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280479616:12345-192.168.202.56@tcp:1:lfs.0 Request processed in 21400us (22353us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015419.893932:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 265 00000100:00100000:1.0:1786015419.902399:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015419.902980:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280480128 00000100:00100000:0.0:1786015419.902993:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280480128 00000100:00100000:0.0:1786015419.903066:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 201 00000100:00100000:0.0:1786015419.903075:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916b6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+91:27139:x1872772280480128:12345-192.168.202.56@tcp:35:lfs.0 00000004:00010000:0.0:1786015419.903135:0:5797:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x1b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501807 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e871b expref: 91 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786015419.903377:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967948 00000001:00080000:0.0:1786015419.904356:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967949 00010000:00010000:0.0:1786015419.904426:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50181c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.904455:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501766 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86ce expref: 44 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.904465:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501797 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86e3 expref: 94 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.904473:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50181c lrc: 5/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.904511:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501797 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86e3 expref: 94 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.904527:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501797 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86e3 expref: 94 pid: 5794 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015419.904543:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa474e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304405632:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015419.904645:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501766 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86ce expref: 44 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.904654:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501766 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86ce expref: 44 pid: 5796 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015419.904664:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa477b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304405760:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015419.904688:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482d789c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015419.912945:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa474e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304405632:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015419.912963:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa477b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304405760:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015419.912999:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50181c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015419.913685:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015419.918474:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280480256 00000100:00100000:1.0:1786015419.918492:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280480256 00010000:00010000:2.0:1786015419.918622:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501797 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86e3 expref: 95 pid: 5794 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015419.918663:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 306 00000100:00100000:2.0:1786015419.918674:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+95:2353:x1872772280480256:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015419.918692:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015419.918700:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501797 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86e3 expref: 95 pid: 5794 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.918713:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501797 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86e3 expref: 95 pid: 5794 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.918736:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501797 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86e3 expref: 95 pid: 5794 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.918750:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:2.0:1786015419.918755:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50181c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.918799:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50181c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.918816:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015419.918880:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+94:2353:x1872772280480256:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 207us (5197us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015419.918888:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 306 00000100:00100000:1.0:1786015419.918941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015419.919282:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280480384 00000100:00100000:2.0:1786015419.919287:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280480384 00010000:00010000:2.0:1786015419.919305:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501766 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86ce expref: 45 pid: 5796 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015419.919334:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 307 00000100:00100000:2.0:1786015419.919341:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+45:2353:x1872772280480384:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015419.919349:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015419.919353:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501766 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86ce expref: 45 pid: 5796 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.919362:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501766 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86ce expref: 45 pid: 5796 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.919375:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501766 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86ce expref: 45 pid: 5796 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.919396:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:2.0:1786015419.919400:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50181c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.919408:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50181c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.919421:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50181c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.919546:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015419.919575:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2353:x1872772280480384:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 235us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015419.919582:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 307 00010000:00010000:2.0:1786015419.919621:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50181c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.919629:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50181c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786015419.919757:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967950 00000001:00080000:2.0:1786015419.920080:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967951 00000001:00080000:2.0:1786015419.920135:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967952 00000100:00100000:2.0:1786015419.920228:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381306d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304405888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1786015419.920291:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015419.920319:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c0f0a180 going to sleep for 11 seconds 00000100:00100000:2.0:1786015419.920340:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304405888 00000100:00100000:2.0:1786015419.920345:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304405888 00000100:00100000:2.0:1786015419.920377:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1786015419.920570:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1872772304405888:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1786015419.920682:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1872772304405888:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 298us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015419.920690:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1786015419.923055:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381306d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304405888:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1786015419.923679:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967953 00000100:00100000:0.0:1786015419.923859:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa477b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304406016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1786015419.923922:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015419.924028:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce1540 going to sleep for 11 seconds 00000100:00100000:3.0:1786015419.926630:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304406016 00000100:00100000:3.0:1786015419.926644:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304406016 00000100:00100000:3.0:1786015419.926710:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1786015419.926721:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1872772304406016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1786015419.928600:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5797:x1872772304406016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1874us (4670us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1786015419.928625:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1786015419.930798:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa477b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304406016:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:0.0:1786015419.934781:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50181c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.934800:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50181c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.934808:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50181c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.934815:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015419.934820:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50181c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.934829:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50181c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.934846:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:0.0:1786015419.934849:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1786015419.934854:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50181c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.934861:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50181c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786015419.935144:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x3f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1786015419.935521:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].13, 64 off9096 00000004:00080000:0.0:1786015419.935535:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 655186772922ns, next at 656186769667ns, rc = 0 00000001:00080000:0.0:1786015419.935544:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967954 00010000:00010000:0.0:1786015419.935600:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b7499c59600) 00010000:00010000:0.0:1786015419.935604:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786015419.935613:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501807 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e871b expref: 98 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015419.935745:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916b6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+97:27139:x1872772280480128:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 32669us (33354us total) trans 4294967955 rc 0/0 00000100:00100000:0.0:1786015419.935755:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 201 00000020:00080000:0.0:1786015419.935780:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:2.0:1786015419.950856:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015419.951136:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280480512 00000100:00100000:1.0:1786015419.951149:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280480512 00000100:00100000:1.0:1786015419.951216:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1011 00000100:00100000:1.0:1786015419.951228:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+97:27141:x1872772280480512:12345-192.168.202.56@tcp:101:diff.0 00010000:00010000:1.0:1786015419.951255:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015419.951276:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c501823 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8722 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.951366:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50182a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.951390:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50182a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.951408:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50182a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.951424:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501831 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.951432:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.951438:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952017:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501838 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952026:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952034:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015419.952071:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00000004:00200000:1.0:1786015419.952075:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015419.952098:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952110:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952119:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50182a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952135:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50182a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952141:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50182a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952147:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015419.952152:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50182a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952160:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50182a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952173:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:1.0:1786015419.952177:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015419.952181:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50182a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952188:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c50182a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952209:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952216:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501831 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952222:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501831 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952227:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015419.952236:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501831 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952243:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501831 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952251:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff8b7483ee6500) 00010000:00010000:1.0:1786015419.952254:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015419.952257:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501831 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952263:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501831 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952304:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c501823 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8722 expref: 99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952318:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501838 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8722 expref: 98 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.952326:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b7483ee6200) 00010000:00010000:1.0:1786015419.952328:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015419.952330:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46600, rc 0) 00000100:00100000:1.0:1786015419.952822:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+98:27141:x1872772280480512:12345-192.168.202.56@tcp:101:diff.0 Request processed in 1593us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015419.952830:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1011 00000100:00100000:1.0:1786015419.958628:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015419.959185:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280480768 00000100:00100000:0.0:1786015419.959195:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280480768 00000100:00100000:0.0:1786015419.960577:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1012 00000100:00100000:0.0:1786015419.960594:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+98:27141:x1872772280480768:12345-192.168.202.56@tcp:101:diff.0 00010000:00010000:0.0:1786015419.960617:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015419.960640:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50183f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8729 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.960745:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501846 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.960772:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501846 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.960785:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501846 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015419.960806:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00010000:00010000:0.0:1786015419.960935:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50183f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8729 expref: 101 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.960952:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501846 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8729 expref: 100 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.960960:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b7483ee6200) 00010000:00010000:0.0:1786015419.960963:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015419.960967:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afca00, rc 0) 00000100:00100000:0.0:1786015419.961031:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+100:27141:x1872772280480768:12345-192.168.202.56@tcp:101:diff.0 Request processed in 442us (2412us total) trans 4294967956 rc 0/0 00000100:00100000:0.0:1786015419.961038:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1012 00000100:00100000:1.0:1786015419.966533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015419.966587:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015419.966619:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280480896 00000100:00100000:1.0:1786015419.966644:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280480896 00000100:00100000:2.0:1786015419.966749:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280481152 00000100:00100000:2.0:1786015419.966779:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280481152 00000100:00100000:2.0:1786015419.966822:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:2.0:1786015419.966832:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+101:27141:x1872772280481152:12345-192.168.202.56@tcp:103:diff.0 00010000:00010000:2.0:1786015419.966849:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015419.966874:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501838 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8722 expref: 101 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015419.966893:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b7483ee6200) 00010000:00010000:2.0:1786015419.966897:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015419.966947:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+100:27141:x1872772280481152:12345-192.168.202.56@tcp:103:diff.0 Request processed in 116us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015419.966968:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:1.0:1786015419.967992:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:1.0:1786015419.968005:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+99:2353:x1872772280480896:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015419.968016:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015419.968033:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501846 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8729 expref: 99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.968051:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b7483ee6200) 00010000:00010000:1.0:1786015419.968063:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015419.968101:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+98:2353:x1872772280480896:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 100us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015419.968108:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:2.0:1786015419.971124:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015419.971622:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280481280 00000100:00100000:0.0:1786015419.971633:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280481280 00000100:00100000:0.0:1786015419.971687:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1013 00000100:00100000:0.0:1786015419.971698:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+98:27141:x1872772280481280:12345-192.168.202.56@tcp:58:diff.0 00010000:00010000:0.0:1786015419.971825:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501854 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.971841:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501854 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015419.971853:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501854 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786015419.972105:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].27, 136 off11864 00000100:00100000:0.0:1786015419.972219:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+98:27141:x1872772280481280:12345-192.168.202.56@tcp:58:diff.0 Request processed in 522us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015419.972227:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1013 00000100:00100000:0.0:1786015419.979744:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015419.980253:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280481408 00000100:00100000:1.0:1786015419.980264:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280481408 00000100:00100000:1.0:1786015419.980324:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1014 00000100:00100000:1.0:1786015419.980334:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+98:27141:x1872772280481408:12345-192.168.202.56@tcp:101:diff.0 00010000:00010000:1.0:1786015419.980358:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015419.980394:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50185b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8730 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.980631:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501854 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.980644:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50185b lrc: 4/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8730 expref: 99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.980666:0:7673:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501854 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.980696:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50185b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8730 expref: 99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.980712:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b748f24a400) 00010000:00010000:1.0:1786015419.980715:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015419.980719:0:7673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50185b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8730 expref: 99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015419.980728:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46000, rc 0) 00000100:00100000:1.0:1786015419.980818:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+99:27141:x1872772280481408:12345-192.168.202.56@tcp:101:diff.0 Request processed in 483us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015419.980826:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1014 00010000:00010000:0.0:1786015420.268010:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015420.332013:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015420.332027:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015420.332070:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 28 count 5 00000040:00080000:3.0:1786015420.332078:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015420.332247:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1222680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304406144:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015420.332382:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786015420.337161:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1222680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304406144:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015420.340830:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015420.341104:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280481536 00000100:00100000:0.0:1786015420.341117:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280481536 00000100:00100000:0.0:1786015420.341215:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1015 00000100:00100000:0.0:1786015420.341238:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+44:27142:x1872772280481536:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000100:00080000:3.0:1786015420.341531:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:0.0:1786015420.341644:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015420.341796:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+44:27142:x1872772280481536:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 538us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015420.341807:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1015 00000100:00100000:0.0:1786015420.346420:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015420.346529:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280481664 00000100:00100000:1.0:1786015420.346540:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280481664 00000100:00100000:1.0:1786015420.346606:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1016 00000100:00100000:1.0:1786015420.346616:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:27142:x1872772280481664:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1786015420.346708:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501862 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.346726:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501862 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.346738:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501862 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.346754:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501869 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.346818:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501869 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.346826:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501869 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.346853:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501870 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.346862:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.346869:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015420.346908:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00000004:00200000:1.0:1786015420.346913:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015420.346927:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.346938:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501862 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.346944:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501862 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.346951:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501862 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.346956:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015420.346961:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501862 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.346974:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501862 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.346987:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:1.0:1786015420.346990:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015420.346994:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501862 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.347001:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501862 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.347014:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501869 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.347020:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501869 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.347026:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501869 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.347031:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015420.347034:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501869 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.347039:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501869 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.347046:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x2b74b2f9 (ffff8b7483ee6200) 00010000:00010000:1.0:1786015420.347049:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015420.347051:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501869 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.347066:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501869 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.347081:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.347086:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501870 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.347092:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501870 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.347097:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015420.347100:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501870 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.347105:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501870 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.347112:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b748f24a400) 00010000:00010000:1.0:1786015420.347114:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015420.347117:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501870 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.347123:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501870 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015420.347211:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:27142:x1872772280481664:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 584us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015420.347219:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1016 00000100:00100000:2.0:1786015420.350865:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015420.351038:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280481920 00000100:00100000:0.0:1786015420.351048:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280481920 00000100:00100000:0.0:1786015420.351113:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1017 00000100:00100000:0.0:1786015420.351123:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+44:27142:x1872772280481920:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015420.351148:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015420.351172:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501877 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8737 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.351288:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c50187e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.351303:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c50187e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.351331:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c50187e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015420.351345:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00010000:00010000:0.0:1786015420.351452:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c50187e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.351461:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c50187e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.351467:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c50187e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.351473:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015420.351477:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c50187e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.351484:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c50187e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.351497:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b748f24a400) 00010000:00010000:0.0:1786015420.351500:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015420.351505:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c50187e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.351511:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c50187e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.351554:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501877 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8737 expref: 46 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.351577:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:0.0:1786015420.351580:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015420.351584:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501877 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8737 expref: 46 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.351603:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afcc00, rc 0) 00000100:00100000:0.0:1786015420.351670:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:27142:x1872772280481920:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 548us (812us total) trans 4294967957 rc 301/301 00000100:00100000:0.0:1786015420.351677:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1017 00000100:00100000:3.0:1786015420.359667:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015420.359749:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280482048 00000100:00100000:0.0:1786015420.359818:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280482048 00000100:00100000:0.0:1786015420.359897:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1018 00000100:00100000:0.0:1786015420.359915:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+45:27142:x1872772280482048:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015420.359967:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015420.360123:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+45:27142:x1872772280482048:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 210us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015420.360131:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1018 00000100:00100000:2.0:1786015420.366271:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015420.366903:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280482304 00000100:00100000:0.0:1786015420.366913:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280482304 00000100:00100000:0.0:1786015420.366995:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1019 00000100:00100000:0.0:1786015420.367004:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+45:27142:x1872772280482304:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015420.367023:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015420.367043:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50188c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e873e expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.367856:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c501893 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.367868:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c501893 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.367877:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c501893 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015420.367883:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1c:0x0]: returning size 0 00010000:00010000:0.0:1786015420.367918:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50188c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e873e expref: 48 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.367931:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c501893 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e873e expref: 47 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.367938:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8b748f24a300) 00010000:00010000:0.0:1786015420.367940:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015420.367942:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc600, rc 0) 00000100:00100000:0.0:1786015420.368084:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+47:27142:x1872772280482304:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1081us (1823us total) trans 4294967958 rc 0/0 00000100:00100000:0.0:1786015420.368090:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1019 00000100:00100000:2.0:1786015420.373987:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015420.374069:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280482560 00000100:00100000:1.0:1786015420.374078:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280482560 00000100:00100000:1.0:1786015420.374169:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1020 00000100:00100000:1.0:1786015420.374180:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:27142:x1872772280482560:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786015420.374266:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015420.374297:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c501893 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e873e expref: 47 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.374317:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8b748f24a300) 00010000:00010000:1.0:1786015420.374328:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015420.374351:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5018a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.374535:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5017ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86f1 expref: 98 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.374546:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5018a1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.374580:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5017ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86f1 expref: 98 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.374595:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5017ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86f1 expref: 98 pid: 7673 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015420.374611:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304406272:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015420.374784:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce0540 going to sleep for 11 seconds 00000100:00100000:3.0:1786015420.384298:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015420.384582:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280482688 00000100:00100000:0.0:1786015420.384592:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280482688 00010000:00010000:0.0:1786015420.384636:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5017ac lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86f1 expref: 99 pid: 7673 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015420.384692:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 308 00000100:00100000:0.0:1786015420.384717:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+99:2354:x1872772280482688:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015420.384732:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015420.384739:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5017ac lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86f1 expref: 99 pid: 7673 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.384753:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5017ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86f1 expref: 99 pid: 7673 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.384816:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:0.0:1786015420.384822:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5018a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.384833:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5018a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.384841:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5018a1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.384863:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015420.384919:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+99:2354:x1872772280482688:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 204us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015420.384926:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 308 00010000:00010000:1.0:1786015420.390671:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5017ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86f1 expref: 98 pid: 7673 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015420.390719:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304406272:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015420.390745:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5018a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.391023:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5018a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.391031:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5018a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.391058:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3e:0x0].0xed9941d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.391083:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0xed9941d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.391094:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0xed9941d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.391704:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5018a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.391715:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5018a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.391722:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5018a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.391729:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015420.391734:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5018a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.391741:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5018a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.391756:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:0.0:1786015420.391793:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015420.391800:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5018a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.391806:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5018a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.391817:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0xed9941d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.391827:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0xed9941d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.391830:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0xed9941d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.391833:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015420.391835:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0xed9941d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.391839:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0xed9941d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.391845:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0xed9941d7 (ffff8b748f24a000) 00010000:00010000:0.0:1786015420.391846:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015420.391847:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0xed9941d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.391851:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0xed9941d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015420.391985:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+46:27142:x1872772280482560:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 17806us (18007us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786015420.391992:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1020 00000100:00100000:3.0:1786015420.400086:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015420.401086:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280482816 00000100:00100000:0.0:1786015420.401097:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280482816 00000100:00100000:2.0:1786015420.401602:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1021 00000100:00100000:2.0:1786015420.401613:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+46:27142:x1872772280482816:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015420.401634:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015420.401658:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5018af lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8745 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.401699:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5018b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.401712:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5018b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.401885:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5018b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.401979:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5018af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8745 expref: 48 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.401997:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5018b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8745 expref: 47 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.402005:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8b749232d000) 00010000:00010000:2.0:1786015420.402008:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015420.402011:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907600, rc 0) 00000100:00100000:2.0:1786015420.402078:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+47:27142:x1872772280482816:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 467us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015420.402086:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1021 00000100:00100000:2.0:1786015420.407439:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015420.407582:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280483072 00000100:00100000:0.0:1786015420.407594:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280483072 00000100:00100000:0.0:1786015420.407688:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1022 00000100:00100000:0.0:1786015420.407699:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+47:27142:x1872772280483072:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786015420.407817:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.407832:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.407844:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015420.408041:0:7673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000066a4cd0c reply state 00000000bb299f7e transno 4294967959 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015420.408051:0:7673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015420.408148:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+49:27142:x1872772280483072:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 451us (920us total) trans 4294967959 rc 0/0 00000100:00100000:0.0:1786015420.408156:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1022 00010000:00010000:1.0:1786015420.414503:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.414524:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.414533:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.414539:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015420.414546:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.414553:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018bd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.414571:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8b749232d000) 00010000:00010000:1.0:1786015420.414575:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786015420.414581:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018bd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.414588:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5018bd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015420.414960:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015420.415853:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280483200 00000100:00100000:3.0:1786015420.415869:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280483200 00000100:00100000:3.0:1786015420.415938:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1023 00000100:00100000:3.0:1786015420.415951:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:27142:x1872772280483200:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015420.415981:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015420.416005:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5018c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e874c expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.416074:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5018c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e874c expref: 49 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.416094:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5018c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e874c expref: 49 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.416129:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8b749232d000) 00010000:00010000:3.0:1786015420.416132:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015420.416136:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd600, rc 0) 00000100:00100000:3.0:1786015420.416216:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:27142:x1872772280483200:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 267us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015420.416224:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1023 00000100:00100000:3.0:1786015420.419367:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015420.419505:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280483328 00000100:00100000:2.0:1786015420.419516:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280483328 00000100:00100000:2.0:1786015420.419587:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 202 00000100:00100000:2.0:1786015420.419597:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:27142:x1872772280483328:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1786015420.419724:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:27142:x1872772280483328:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 Request processed in 128us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015420.419732:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 202 00000100:00100000:3.0:1786015420.423074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015420.423172:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280483584 00000100:00100000:2.0:1786015420.423182:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280483584 00000100:00100000:2.0:1786015420.423279:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 203 00000100:00100000:2.0:1786015420.423291:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:27142:x1872772280483584:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015420.423647:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:27142:x1872772280483584:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 358us (580us total) trans 4294967960 rc 0/0 00000100:00100000:2.0:1786015420.423655:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 203 00000100:00100000:3.0:1786015420.426326:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015420.426565:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280483840 00000100:00100000:2.0:1786015420.426575:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280483840 00000100:00100000:2.0:1786015420.426687:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1024 00000100:00100000:2.0:1786015420.426698:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+50:27142:x1872772280483840:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015420.426831:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+50:27142:x1872772280483840:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 134us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015420.426838:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1024 00000100:00100000:3.0:1786015420.429974:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015420.431073:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280484096 00000100:00100000:0.0:1786015420.431086:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280484096 00000100:00100000:0.0:1786015420.431152:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1025 00000100:00100000:0.0:1786015420.431162:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+50:27142:x1872772280484096:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015420.431183:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015420.431221:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5018cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8753 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.431368:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5018d2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.431392:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5018c4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e874c expref: 51 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.431412:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5018d2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.431448:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5018c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e874c expref: 51 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.431635:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5018c4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e874c expref: 51 pid: 5795 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015420.431652:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa474380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304406400:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015420.431753:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7487d6a780 going to sleep for 11 seconds 00000100:00100000:3.0:1786015420.435996:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015420.436948:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280484224 00000100:00100000:1.0:1786015420.436975:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280484224 00010000:00010000:1.0:1786015420.437017:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5018c4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e874c expref: 52 pid: 5795 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015420.437063:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 309 00000100:00100000:1.0:1786015420.437073:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b024c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+52:2353:x1872772280484224:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015420.437088:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015420.437095:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5018c4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e874c expref: 52 pid: 5795 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.437108:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5018c4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e874c expref: 52 pid: 5795 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.437133:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8b749232d000) 00010000:00010000:1.0:1786015420.437139:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5018d2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.437150:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5018d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.437159:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5018d2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.437179:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015420.437253:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b024c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+52:2353:x1872772280484224:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 181us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015420.437261:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 309 00010000:00010000:0.0:1786015420.438758:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5018c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e874c expref: 51 pid: 5795 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015420.438815:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa474380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304406400:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015420.438839:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5018d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.438848:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5018d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.438854:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5018d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015420.438876:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1c:0x0]: returning size 0 00000004:00080000:0.0:1786015420.439212:0:5796:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x14:0x0], index 0: 0 00010000:00010000:0.0:1786015420.439953:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5018d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.439978:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5018d2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.439985:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5018d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.439991:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015420.439996:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5018d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.440004:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5018d2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.440018:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8b749232d000) 00010000:00010000:0.0:1786015420.440020:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015420.440023:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5018d2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.440028:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5018d2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.440075:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5018cb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8753 expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.440082:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8b748f24ad00) 00010000:00010000:0.0:1786015420.440083:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015420.440085:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5018cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8753 expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.440092:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc200, rc 0) 00000100:00100000:0.0:1786015420.440162:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+50:27142:x1872772280484096:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 9001us (10197us total) trans 4294967961 rc 301/301 00000100:00100000:0.0:1786015420.440169:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1025 00000100:00100000:3.0:1786015420.443576:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015420.443746:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280484480 00000100:00100000:2.0:1786015420.443757:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280484480 00000100:00100000:2.0:1786015420.443958:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 204 00000100:00100000:2.0:1786015420.443970:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:27142:x1872772280484480:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015420.444415:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+51:27142:x1872772280484480:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 446us (848us total) trans 4294967962 rc 0/0 00000100:00100000:2.0:1786015420.444423:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 204 00000100:00100000:3.0:1786015420.450802:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015420.450895:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280484608 00000100:00100000:1.0:1786015420.450905:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280484608 00000100:00100000:1.0:1786015420.450980:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1026 00000100:00100000:1.0:1786015420.450990:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+51:27142:x1872772280484608:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015420.451015:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015420.451038:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c5018e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e875a expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.451106:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c5018e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.451119:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c5018e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.451130:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c5018e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015420.451165:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1c:0x0]: returning size 0 00000004:00200000:1.0:1786015420.451168:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015420.451187:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c5018e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.451226:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c5018e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e875a expref: 53 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.451253:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c5018e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e875a expref: 52 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.451262:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8b749232d000) 00010000:00010000:1.0:1786015420.451265:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786015420.451269:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47a00, rc 0) 00000100:00100000:1.0:1786015420.451337:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+52:27142:x1872772280484608:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 349us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015420.451350:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1026 00000100:00100000:3.0:1786015420.455476:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015420.455660:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280484736 00000100:00100000:1.0:1786015420.455670:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280484736 00000100:00100000:1.0:1786015420.455738:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 266 00000100:00100000:1.0:1786015420.455749:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2351:x1872772280484736:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015420.455798:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015420.455821:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d6b9677/0xb1a5ef690c5018ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8761 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015420.455853:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786015420.455876:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=655s v=(0 0) 00010000:00010000:1.0:1786015420.455882:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015420.455893:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d6b9677/0xb1a5ef690c5018ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8761 expref: 9 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.455910:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002d6b9677/0xb1a5ef690c5018ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8761 expref: 9 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.455923:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47400, rc 0) 00000100:00100000:1.0:1786015420.455984:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280484736:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 237us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015420.455991:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 266 00000100:00080000:3.0:1786015420.456537:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015420.461697:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015420.462283:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280484992 00000100:00100000:2.0:1786015420.462303:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280484992 00000100:00100000:2.0:1786015420.462371:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1027 00000100:00100000:2.0:1786015420.462390:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+52:27142:x1872772280484992:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015420.462527:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+52:27142:x1872772280484992:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 139us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015420.462553:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1027 00000100:00100000:0.0:1786015420.468009:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015420.468150:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280485120 00000100:00100000:2.0:1786015420.468161:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280485120 00000100:00100000:2.0:1786015420.468225:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 267 00000100:00100000:2.0:1786015420.468242:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:27142:x1872772280485120:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015420.468264:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015420.468292:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c5018f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8768 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.468329:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d6b9677/0xb1a5ef690c5018ee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8761 expref: 10 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.468339:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015420.468344:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015420.468349:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c5018f5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8768 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.468397:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d6b9677/0xb1a5ef690c5018ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8761 expref: 10 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.468413:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d6b9677/0xb1a5ef690c5018ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8761 expref: 10 pid: 11384 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015420.468427:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b748825a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304406528:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015420.468671:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872840 going to sleep for 11 seconds 00000100:00100000:3.0:1786015420.472582:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015420.472710:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b748825a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304406528:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015420.472746:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c5018f5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8768 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.472809:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906e00, rc 0) 00000100:00100000:2.0:1786015420.472862:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:27142:x1872772280485120:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 4627us (4861us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015420.472870:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 267 00000100:00100000:1.0:1786015420.474943:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280485248 00000100:00100000:1.0:1786015420.475150:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280485248 00010000:00010000:0.0:1786015420.475539:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d6b9677/0xb1a5ef690c5018ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8761 expref: 10 pid: 11384 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015420.475628:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 310 00000100:00100000:0.0:1786015420.475639:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280485248:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015420.475656:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015420.475692:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d6b9677/0xb1a5ef690c5018ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8761 expref: 10 pid: 11384 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.475707:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d6b9677/0xb1a5ef690c5018ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8761 expref: 10 pid: 11384 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.475730:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d6b9677/0xb1a5ef690c5018ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8761 expref: 10 pid: 11384 timeout: 755 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.475745:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015420.475749:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015420.475757:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c5018f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8768 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.475810:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c5018f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8768 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.475862:0:6607:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c5018f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8768 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015420.475877:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa477800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304406656:192.168.202.56@tcp:105: 00000100:00100000:0.0:1786015420.475966:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7499a01600 going to sleep for 11 seconds 00000100:00100000:2.0:1786015420.480371:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa477800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304406656:192.168.202.56@tcp:105: 00010000:00010000:2.0:1786015420.480409:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015420.480479:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280485248:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 4842us (7907us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015420.480491:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 310 00000100:00100000:3.0:1786015420.486672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015420.486919:0:17970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280485376 00000100:00100000:1.0:1786015420.486932:0:17970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280485376 00002000:00100000:2.0:1786015420.487105:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x14:0x0] (0->157) req@ffff8b74c0cf1880 x1872772280485376/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:266/0 lens 648/0 e 0 to 0 dl 1786015431 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015420.487116:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c0cf1880 with x1872772280485376 ext(0->157) 00002000:00010000:2.0:1786015420.487122:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74c0cf1880 00000100:00100000:2.0:1786015420.487206:0:17970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 94 00000100:00100000:2.0:1786015420.487216:0:17970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280485376:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1786015420.487790:0:17970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280485376:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 572us (1124us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1786015420.487797:0:17970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 94 00002000:00100000:2.0:1786015420.487803:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x14:0x0] (0->157) req@ffff8b74c0cf1880 x1872772280485376/t4294967348(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:266/0 lens 648/448 e 0 to 0 dl 1786015431 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015420.487818:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c0cf1880 with x1872772280485376 ext(0->157) 00002000:00010000:2.0:1786015420.487821:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74c0cf1880 00000100:00100000:3.0:1786015420.491836:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015420.491974:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280485504 00000100:00100000:2.0:1786015420.491985:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280485504 00000100:00100000:2.0:1786015420.492045:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1028 00000100:00100000:2.0:1786015420.492056:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+52:27142:x1872772280485504:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1786015420.518159:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967961 is committed 00000001:00080000:1.0:1786015420.518185:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967956 is committed 00000004:00080000:1.0:1786015420.518192:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 17 committed 00000100:00100000:2.0:1786015420.518434:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+48:27142:x1872772280485504:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 26364us (26592us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015420.518446:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1028 00000020:00080000:1.0:1786015420.521636:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b7482d78b40 refcount 2 committed 0 result 0 batchid 17 00000020:00080000:1.0:1786015420.521647:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b7491d58500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b7482d789c0 00000020:00080000:1.0:1786015420.521651:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b7491d58800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74b8c3cc00 00000001:00080000:1.0:1786015420.521708:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967962 is committed 00000020:00080000:2.0:1786015420.521785:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 17 committed batchid 16 00000020:00080000:2.0:1786015420.522008:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16 00000100:00100000:2.0:1786015420.522232:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304406784:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786015420.522316:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015420.522517:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304406784 00000100:00100000:0.0:1786015420.522525:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304406784 00000100:00100000:0.0:1786015420.522568:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1786015420.522577:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304406784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786015420.522611:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:22 count 1 00002000:00010000:0.0:1786015420.522651:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 158, mtime: 0x6a746eba, atime: 0x0, ctime: 0x6a746eba, blocks: 0xb 00010000:00010000:0.0:1786015420.522660:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c5018fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.522678:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=655s v=(0 0) 00010000:00010000:0.0:1786015420.522683:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015420.522689:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c5018fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.522704:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c5018fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.522714:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c5018fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.522742:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c5018fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.522782:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786015420.523237:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304406784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 659us (919us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1786015420.523246:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00010000:00010000:0.0:1786015420.523270:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786015420.523277:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c5018fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786015420.523416:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b74aa474a80/2, rc 0, transno 4294967356 00000100:00100000:2.0:1786015420.523424:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304406784:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1786015420.523527:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015420.523532:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c5018fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.523543:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c5018fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.523563:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c5018fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.523570:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c5018fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.523594:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015420.523603:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015420.523605:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015420.523754:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015420.524021:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280485632 00000100:00100000:2.0:1786015420.524027:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280485632 00000100:00100000:2.0:1786015420.524098:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 269 00000100:00100000:2.0:1786015420.524108:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280485632:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1786015420.558264:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967348 is committed 00000100:00100000:2.0:1786015420.558525:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280485632:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 34412us (34765us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015420.558539:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 269 00000100:00100000:2.0:1786015420.565223:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015420.565337:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280485888 00000100:00100000:3.0:1786015420.565351:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280485888 00000100:00100000:3.0:1786015420.565420:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1029 00000100:00100000:3.0:1786015420.565431:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:27142:x1872772280485888:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786015420.565500:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015420.565528:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c5018e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e875a expref: 43 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.565560:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8b749232d000) 00010000:00010000:3.0:1786015420.565565:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015420.565598:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501903 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.565610:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501903 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.565620:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501903 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015420.566318:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007fa4dd6b reply state 0000000052b6154b transno 4294967963 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501903 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015420.566330:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015420.566456:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+44:27142:x1872772280485888:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 1025us (1245us total) trans 4294967963 rc 0/0 00000100:00100000:3.0:1786015420.566465:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1029 00010000:00010000:0.0:1786015420.573842:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501903 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.573861:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501903 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.573869:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501903 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.573875:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbdc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015420.573881:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501903 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.573888:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501903 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.573906:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8b749232d000) 00010000:00010000:0.0:1786015420.573909:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015420.573914:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501903 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.573920:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501903 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015420.577364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015420.577934:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280486016 00000100:00100000:0.0:1786015420.577955:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280486016 00000100:00100000:0.0:1786015420.578009:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1030 00000100:00100000:0.0:1786015420.578016:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+43:27142:x1872772280486016:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015420.578039:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015420.578063:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50190a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e876f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.578120:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50190a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e876f expref: 44 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.578136:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50190a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e876f expref: 44 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.578156:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8b749232d000) 00010000:00010000:0.0:1786015420.578160:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015420.578164:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afda00, rc 0) 00000100:00100000:0.0:1786015420.578464:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+44:27142:x1872772280486016:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 447us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015420.578470:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1030 00000100:00100000:3.0:1786015420.583162:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015420.583282:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280486144 00000100:00100000:2.0:1786015420.583354:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280486144 00000100:00100000:2.0:1786015420.583505:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 270 00000100:00100000:2.0:1786015420.583517:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280486144:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1786015420.583818:0:14547:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1786015420.583822:0:14547:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb mtime from disk: 0 -> 1786015418 00002000:00010000:2.0:1786015420.583824:0:14547:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb atime from disk: 0 -> 1786015418 00002000:00010000:2.0:1786015420.583826:0:14547:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb ctime from disk: 0 -> 1786015418 00002000:00010000:2.0:1786015420.583828:0:14547:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1786015420.584205:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280486144:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 680us (1051us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1786015420.584215:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 270 00000100:00100000:3.0:1786015420.591314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015420.591918:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280486400 00000100:00100000:1.0:1786015420.591930:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280486400 00000100:00100000:1.0:1786015420.592023:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1031 00000100:00100000:1.0:1786015420.592034:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:27142:x1872772280486400:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1786015420.592099:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501911 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.592116:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5018b6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8745 expref: 44 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.592126:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501911 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.592163:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5018b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8745 expref: 44 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.592178:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5018b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8745 expref: 44 pid: 5794 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015420.592191:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304406912:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015420.592401:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482dfd840 going to sleep for 11 seconds 00000100:00100000:1.0:1786015420.595863:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304406912:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015420.595894:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501911 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015420.596471:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015420.596725:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280486528 00000100:00100000:2.0:1786015420.596734:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280486528 00010000:00010000:2.0:1786015420.596814:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5018b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8745 expref: 45 pid: 5794 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015420.596856:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 311 00000100:00100000:2.0:1786015420.596867:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+45:2354:x1872772280486528:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015420.596884:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015420.596891:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5018b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8745 expref: 45 pid: 5794 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.596904:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5018b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8745 expref: 45 pid: 5794 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.596930:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5018b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8745 expref: 45 pid: 5794 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.596964:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8b749232d000) 00010000:00010000:2.0:1786015420.596969:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501911 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.596979:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501911 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.596986:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501911 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.597021:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015420.597068:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2354:x1872772280486528:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 203us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015420.597075:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 311 00010000:00010000:3.0:1786015420.597492:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501911 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.597501:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501911 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.597535:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501911 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.597553:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501911 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.597559:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501911 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.597565:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015420.597569:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501911 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.597578:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501911 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.597588:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8b749232d000) 00010000:00010000:3.0:1786015420.597591:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1786015420.597594:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501911 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.597600:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501911 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015420.597661:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+43:27142:x1872772280486400:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 5628us (6356us total) trans 0 rc -22/-22 00000100:00100000:3.0:1786015420.597671:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1031 00000100:00100000:3.0:1786015420.601556:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015420.601670:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280486656 00000100:00100000:1.0:1786015420.601690:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280486656 00000100:00100000:1.0:1786015420.601754:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 271 00000100:00100000:1.0:1786015420.601931:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280486656:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015420.601980:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b223b20f/0xb1a5ef690c501918 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.602003:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c5018f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8768 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.602012:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015420.602016:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015420.602020:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b223b20f/0xb1a5ef690c501918 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.602056:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c5018f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8768 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.602072:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c5018f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8768 expref: 10 pid: 14547 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015420.602087:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304407040:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015420.602170:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482dfd840 going to sleep for 11 seconds 00000100:00100000:0.0:1786015420.605950:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015420.606042:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280486784 00000100:00100000:3.0:1786015420.606053:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280486784 00010000:00010000:3.0:1786015420.606101:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c5018f5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8768 expref: 11 pid: 14547 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015420.606173:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 312 00000100:00100000:3.0:1786015420.606182:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280486784:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015420.606209:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015420.606237:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c5018f5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8768 expref: 11 pid: 14547 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.606252:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c5018f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8768 expref: 11 pid: 14547 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.606278:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015420.606283:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015420.606289:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b223b20f/0xb1a5ef690c501918 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.606300:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b223b20f/0xb1a5ef690c501918 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.606321:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015420.606387:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280486784:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 198us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015420.606395:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 312 00010000:00010000:1.0:1786015420.606829:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c5018f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8768 expref: 10 pid: 14547 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015420.606845:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304407040:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015420.606866:0:11384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b223b20f/0xb1a5ef690c501918 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.606877:0:11384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b223b20f/0xb1a5ef690c501918 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.606884:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b223b20f/0xb1a5ef690c501918 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.606911:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b223b20f/0xb1a5ef690c501918 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.606920:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b223b20f/0xb1a5ef690c501918 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.606928:0:11384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b223b20f/0xb1a5ef690c501918 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.606935:0:11384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46800 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015420.606938:0:11384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b223b20f/0xb1a5ef690c501918 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.606961:0:11384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b223b20f/0xb1a5ef690c501918 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.606974:0:11384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b223b20f/0xb1a5ef690c501918 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.606983:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b223b20f/0xb1a5ef690c501918 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015420.607040:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280486656:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 5277us (5492us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015420.607049:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 271 00000100:00100000:0.0:1786015420.610869:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015420.611184:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280487040 00000100:00100000:3.0:1786015420.611203:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280487040 00000100:00100000:3.0:1786015420.611264:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1032 00000100:00100000:3.0:1786015420.611275:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:27142:x1872772280487040:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786015420.611382:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c50191f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.611399:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c50191f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.611412:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c50191f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.611655:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501926 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.611667:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50190a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e876f expref: 44 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.611676:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501926 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.611728:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50190a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e876f expref: 44 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.611744:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50190a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e876f expref: 44 pid: 5796 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015420.611758:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304407168:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015420.611887:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d2480 going to sleep for 11 seconds 00000100:00100000:3.0:1786015420.616374:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015420.616467:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280487168 00000100:00100000:2.0:1786015420.616478:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280487168 00010000:00010000:2.0:1786015420.616522:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50190a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e876f expref: 45 pid: 5796 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015420.616571:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 313 00000100:00100000:2.0:1786015420.616583:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+45:2353:x1872772280487168:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015420.616601:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015420.616608:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50190a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e876f expref: 45 pid: 5796 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.616622:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50190a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e876f expref: 45 pid: 5796 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.616667:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8b749232d000) 00010000:00010000:2.0:1786015420.616673:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501926 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.616683:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501926 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.616691:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501926 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.616711:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015420.616803:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+45:2353:x1872772280487168:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 220us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015420.616812:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 313 00010000:00010000:0.0:1786015420.617254:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50190a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e876f expref: 44 pid: 5796 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015420.617272:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304407168:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015420.617293:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501926 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.617301:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501926 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.617307:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501926 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786015420.617525:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967964 00000001:00080000:0.0:1786015420.617675:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967965 00000001:00080000:0.0:1786015420.617720:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967966 00000100:00100000:0.0:1786015420.617853:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa476300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304407296:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786015420.617911:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015420.617937:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7485926780 going to sleep for 11 seconds 00000100:00100000:1.0:1786015420.618001:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304407296 00000100:00100000:1.0:1786015420.618007:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304407296 00000100:00100000:1.0:1786015420.618049:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1786015420.618057:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1872772304407296:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786015420.618128:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1872772304407296:12345-0@lo:1000:mdt00_001.0 Request processed in 71us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015420.618135:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1786015420.618266:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa476300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304407296:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1786015420.618741:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967967 00000100:00100000:0.0:1786015420.618832:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa476300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304407424:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786015420.618862:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015420.618877:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce1480 going to sleep for 11 seconds 00000100:00100000:1.0:1786015420.618989:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304407424 00000100:00100000:1.0:1786015420.618995:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304407424 00000100:00100000:1.0:1786015420.619029:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1786015420.619036:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1872772304407424:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786015420.619215:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5795:x1872772304407424:12345-0@lo:1000:mdt00_001.0 Request processed in 178us (351us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1786015420.619231:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1786015420.619315:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa476300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304407424:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1786015420.619398:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967968 00010000:00010000:3.0:1786015420.619436:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501926 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.619446:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501926 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.619452:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501926 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.619459:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015420.619463:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501926 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.619471:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501926 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.619487:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8b749232d000) 00010000:00010000:3.0:1786015420.619489:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015420.619494:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501926 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.619499:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501926 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.619526:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501854 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.619531:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501854 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.619537:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501854 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.619541:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015420.619551:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501854 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.619558:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501854 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.619565:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b748f24a400) 00010000:00010000:3.0:1786015420.619568:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015420.619576:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50185b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8730 expref: 87 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.619587:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50185b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8730 expref: 87 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.619596:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50185b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8730 expref: 87 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015420.619623:0:5795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46000/0xb1a5ef690c50185b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8730 expref: 87 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015420.619635:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304407552:192.168.202.56@tcp:105: 00000100:00100000:3.0:1786015420.619715:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015420.623935:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304407552:192.168.202.56@tcp:105: 00010000:00010000:0.0:1786015420.623967:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501854 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.623977:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501854 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.624013:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50192d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.624026:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50192d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.624037:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50192d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.624048:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50192d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.624069:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50192d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.624075:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50192d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.624082:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015420.624086:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50192d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.624093:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50192d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.624105:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b748f24a400) 00010000:00010000:0.0:1786015420.624109:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015420.624112:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50192d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.624118:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50192d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.624129:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c50191f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.624135:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c50191f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.624140:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c50191f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.624145:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015420.624154:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c50191f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.624161:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c50191f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.624170:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8b748f24a400) 00010000:00010000:0.0:1786015420.624172:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015420.624175:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c50191f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.624180:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c50191f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015420.624439:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:27142:x1872772280487040:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 13164us (13581us total) trans 4294967969 rc 0/0 00000100:00100000:0.0:1786015420.624449:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1032 00000020:00080000:0.0:1786015420.624454:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:3.0:1786015420.625186:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015420.625192:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015420.625656:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:3.0:1786015420.625664:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015420.628347:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015420.628406:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015420.628630:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280487296 00000100:00100000:0.0:1786015420.628641:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280487296 00000100:00100000:0.0:1786015420.628697:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280487552 00000100:00100000:0.0:1786015420.628701:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280487552 00000100:00100000:0.0:1786015420.628722:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 205 00000100:00100000:0.0:1786015420.628731:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+88:27141:x1872772280487296:12345-192.168.202.56@tcp:49:diff.0 00000100:00100000:0.0:1786015420.628899:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+88:27141:x1872772280487296:12345-192.168.202.56@tcp:49:diff.0 Request processed in 168us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015420.628907:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 205 00000100:00100000:0.0:1786015420.628924:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 206 00000100:00100000:0.0:1786015420.628930:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916b7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+48:27142:x1872772280487552:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1786015420.630016:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x1c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1786015420.630127:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967970 00010000:00010000:0.0:1786015420.630182:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501934 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.630209:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501934 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.630222:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501934 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.630231:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501934 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.630237:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501934 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.630244:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501934 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015420.630260:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786015420.630482:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786015420.630491:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501934 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.630499:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015420.630503:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501934 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.630512:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501934 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.630527:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:1.0:1786015420.630530:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786015420.630535:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501934 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.630540:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501934 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015420.630558:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015420.630560:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015420.630562:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015420.631786:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916b7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+50:27142:x1872772280487552:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 2823us (3347us total) trans 4294967971 rc 0/0 00000100:00100000:0.0:1786015420.631798:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 206 00000020:00080000:0.0:1786015420.631804:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786015420.636179:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015420.638269:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280487680 00000100:00100000:2.0:1786015420.638294:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280487680 00000100:00100000:2.0:1786015420.638369:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 272 00000100:00100000:2.0:1786015420.638392:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+13:27141:x1872772280487680:12345-192.168.202.56@tcp:101:diff.0 00010000:00010000:2.0:1786015420.638412:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015420.638435:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075b2724f/0xb1a5ef690c50193b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8776 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015420.638463:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 158, mtime: 0x6a746eba, atime: 0x6a746eba, ctime: 0x6a746eba, blocks: 0xb 00010000:00010000:2.0:1786015420.638491:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=655s v=(0 0) 00010000:00010000:2.0:1786015420.638495:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015420.638506:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075b2724f/0xb1a5ef690c50193b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8776 expref: 14 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.638544:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075b2724f/0xb1a5ef690c50193b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8776 expref: 14 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015420.638559:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906400, rc 0) 00000100:00100000:2.0:1786015420.638632:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+14:27141:x1872772280487680:12345-192.168.202.56@tcp:101:diff.0 Request processed in 243us (2462us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015420.638639:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 272 00000100:00080000:3.0:1786015420.641157:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015420.642996:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015420.643096:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280487808 00000100:00100000:1.0:1786015420.643106:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280487808 00002000:00100000:1.0:1786015420.643156:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x14:0x0] (0->4095) req@ffff8b74bf39df80 x1872772280487808/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:266/0 lens 488/0 e 0 to 0 dl 1786015431 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015420.643167:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74bf39df80 with x1872772280487808 ext(0->4095) 00002000:00010000:1.0:1786015420.643179:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74bf39df80 00000100:00100000:1.0:1786015420.643225:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 95 00000100:00100000:1.0:1786015420.643235:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+14:2353:x1872772280487808:12345-192.168.202.56@tcp:3:diff.0 00000100:00100000:1.0:1786015420.643620:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+14:2353:x1872772280487808:12345-192.168.202.56@tcp:3:diff.0 Request processed in 385us (630us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786015420.643630:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 95 00002000:00100000:1.0:1786015420.643637:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x14:0x0] (0->4095) req@ffff8b74bf39df80 x1872772280487808/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:266/0 lens 488/4536 e 0 to 0 dl 1786015431 ref 1 fl Complete:/600/0 rc 4096/4096 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015420.643645:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74bf39df80 with x1872772280487808 ext(0->4095) 00002000:00010000:1.0:1786015420.643648:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74bf39df80 00000100:00100000:1.0:1786015420.649651:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015420.650078:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280488064 00000100:00100000:2.0:1786015420.650089:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280488064 00000100:00100000:2.0:1786015420.650164:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 207 00000100:00100000:2.0:1786015420.650172:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+88:27141:x1872772280488064:12345-192.168.202.56@tcp:35:diff.0 00000100:00100000:2.0:1786015420.650649:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+89:27141:x1872772280488064:12345-192.168.202.56@tcp:35:diff.0 Request processed in 475us (1004us total) trans 4294967972 rc 0/0 00000100:00100000:2.0:1786015420.650658:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 207 00010000:00010000:1.0:1786015421.295750:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015421.517138:0:19328:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015421.517149:0:19328:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015421.527080:0:19328:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 28 count 5 00000040:00080000:2.0:1786015421.527090:0:19328:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015422.316988:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015422.535968:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015422.536008:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015422.536042:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015422.536065:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015422.536083:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015422.536103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015422.536123:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015422.536172:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280488704 00000100:00100000:2.0:1786015422.536191:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280488704 00000100:00100000:2.0:1786015422.536259:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280488320 00000100:00100000:2.0:1786015422.536263:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280488320 00000100:00100000:2.0:1786015422.536286:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 422 00000100:00100000:2.0:1786015422.536296:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+50:2351:x1872772280488704:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015422.536382:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+50:2351:x1872772280488704:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 88us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015422.536390:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 422 00000100:00100000:2.0:1786015422.536406:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 423 00000100:00100000:2.0:1786015422.536413:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+89:2351:x1872772280488320:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015422.536455:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+89:2351:x1872772280488320:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 42us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015422.536461:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 423 00000100:00100000:2.0:1786015422.536480:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280488448 00000100:00100000:2.0:1786015422.536483:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280488448 00000100:00100000:2.0:1786015422.536509:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280488960 00000100:00100000:2.0:1786015422.536523:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280488960 00000100:00100000:2.0:1786015422.536539:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280488576 00000100:00100000:2.0:1786015422.536542:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280488576 00000100:00100000:2.0:1786015422.536554:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280488832 00000100:00100000:2.0:1786015422.536556:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280488832 00000100:00100000:2.0:1786015422.536571:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 399 00000100:00100000:2.0:1786015422.536577:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+14:2351:x1872772280488448:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015422.536605:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+14:2351:x1872772280488448:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015422.536611:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 399 00000100:00100000:2.0:1786015422.536631:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 400 00000100:00100000:2.0:1786015422.536650:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280488960:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015422.536678:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280488960:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015422.536685:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 400 00000100:00100000:2.0:1786015422.536696:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 401 00000100:00100000:2.0:1786015422.536702:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2351:x1872772280488576:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015422.536727:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2351:x1872772280488576:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015422.536733:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 401 00000100:00100000:2.0:1786015422.536744:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 402 00000100:00100000:2.0:1786015422.536750:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280488832:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015422.536833:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280488832:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 82us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015422.536840:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 402 00000100:00080000:2.0:1786015422.536897:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015422.536901:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015422.536904:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015422.537835:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280488192 00000100:00100000:1.0:1786015422.537845:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280488192 00000100:00100000:1.0:1786015422.537889:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 571 00000100:00100000:1.0:1786015422.537908:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280488192:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015422.537956:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280488192:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 60us (1997us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015422.537962:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 571 00000100:00100000:2.0:1786015422.636606:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786015422.636628:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7488259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304407680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015422.636701:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015422.636782:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304407680 00000100:00100000:2.0:1786015422.636789:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304407680 00000100:00100000:2.0:1786015422.636845:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1786015422.636853:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304407680:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786015422.636975:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1786015422.637377:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015422.640099:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304407680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3236us (3387us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015422.640117:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1786015422.649887:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7488259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304407680:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786015423.340942:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015424.172014:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304407936:0@lo:400:kworker.0 00000100:00100000:3.0:1786015424.172105:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015424.172178:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304408448:0@lo:400:kworker.0 00000100:00100000:3.0:1786015424.172209:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015424.172243:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786015424.172259:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304407808:0@lo:400:kworker.0 00000100:00100000:3.0:1786015424.172289:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015424.172309:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304408320:0@lo:400:kworker.0 00000100:00100000:3.0:1786015424.172329:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015424.172370:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304408448 00000100:00100000:3.0:1786015424.172379:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304408448 00000100:00100000:3.0:1786015424.172445:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1786015424.172454:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1872772304408448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015424.172510:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1872772304408448:12345-0@lo:400:kworker.0 Request processed in 57us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015424.172518:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1786015424.172542:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304407808 00000100:00100000:3.0:1786015424.172545:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304407808 00000100:00100000:3.0:1786015424.172568:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:3.0:1786015424.172573:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304407808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015424.172600:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304407808:12345-0@lo:400:kworker.0 Request processed in 27us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015424.172606:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:3.0:1786015424.172633:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304407936 00000100:00100000:3.0:1786015424.172637:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304407936 00000100:00100000:3.0:1786015424.172676:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304408320 00000100:00100000:3.0:1786015424.172700:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304408320 00000100:00100000:3.0:1786015424.172727:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1786015424.172732:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304407936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015424.172789:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304407936:12345-0@lo:400:kworker.0 Request processed in 56us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015424.172795:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1786015424.172806:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1786015424.172811:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304408320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015424.172835:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304408320:12345-0@lo:400:kworker.0 Request processed in 24us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015424.172841:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1786015424.172894:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304407808:0@lo:400:kworker.0 00000100:00100000:3.0:1786015424.172907:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304408320:0@lo:400:kworker.0 00000100:00100000:3.0:1786015424.172916:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304407936:0@lo:400:kworker.0 00000100:00100000:3.0:1786015424.172925:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304408448:0@lo:400:kworker.0 00000100:00100000:0.0:1786015424.173452:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304408064:0@lo:400:kworker.0 00000100:00100000:0.0:1786015424.173527:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015424.173561:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786015424.173567:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304408192:0@lo:400:kworker.0 00000100:00100000:0.0:1786015424.173593:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015424.173633:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304408064 00000100:00100000:0.0:1786015424.173638:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304408064 00000100:00100000:0.0:1786015424.173702:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1786015424.173710:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304408064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015424.173758:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304408064:12345-0@lo:400:kworker.0 Request processed in 49us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015424.173781:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00080000:0.0:1786015424.173802:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015424.173808:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015424.173825:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304408192 00000100:00100000:0.0:1786015424.173830:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304408192 00000100:00100000:0.0:1786015424.173861:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1786015424.173867:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304408192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015424.173901:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304408192:12345-0@lo:400:kworker.0 Request processed in 34us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015424.173906:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00080000:0.0:1786015424.173923:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015424.173961:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304408192:0@lo:400:kworker.0 00000100:00100000:0.0:1786015424.173971:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304408064:0@lo:400:kworker.0 00010000:00010000:1.0:1786015424.364262:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015424.686933:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7488259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304408576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015424.687011:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015424.690516:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304408576 00000100:00100000:3.0:1786015424.690533:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304408576 00000100:00100000:3.0:1786015424.690606:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1786015424.690617:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304408576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015424.690660:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 74776576 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015424.691365:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304408576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 748us (4351us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015424.691375:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1786015424.696359:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7488259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304408576:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1786015424.759848:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967356 is committed 00010000:00010000:1.0:1786015425.391618:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015425.772072:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015425.772081:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015425.776738:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 28 count 3 00000040:00080000:1.0:1786015425.776756:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1786015425.777139:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967350 is committed 00000001:00080000:0.0:1786015425.777164:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967349 is committed 00000001:00080000:1.0:1786015425.784472:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967971 is committed 00000020:00080000:1.0:1786015425.784495:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b74b014f6c0 refcount 2 committed 0 result 0 batchid 18 00000020:00080000:1.0:1786015425.784500:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b7491d58000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b74b014f300 00000020:00080000:1.0:1786015425.784503:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b7491d58e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74afab2000 00000020:00080000:2.0:1786015425.784588:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 18 committed batchid 16 00000020:00080000:2.0:1786015425.784799:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16 00000001:00080000:1.0:1786015425.784919:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967972 is committed 00000020:00080000:1.0:1786015425.784927:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 17 batchid updated 00010000:00010000:0.0:1786015426.419789:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015427.436199:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015427.664735:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015427.664820:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015427.664854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015427.664892:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015427.664947:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280489088 00000100:00100000:0.0:1786015427.664957:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280489088 00000100:00100000:0.0:1786015427.665008:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 573 00000100:00100000:0.0:1786015427.665018:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280489088:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015427.665092:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280489088:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 75us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015427.665099:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 573 00000100:00100000:2.0:1786015427.665351:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280489600 00000100:00100000:2.0:1786015427.665356:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280489600 00000100:00100000:2.0:1786015427.665398:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 427 00000100:00100000:2.0:1786015427.665406:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+41:2352:x1872772280489600:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015427.665447:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+41:2352:x1872772280489600:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 42us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015427.665454:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 427 00000100:00080000:2.0:1786015427.665496:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015427.668340:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280489344 00000100:00100000:1.0:1786015427.668357:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280489344 00000100:00100000:1.0:1786015427.668450:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280489856 00000100:00100000:1.0:1786015427.668453:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280489856 00000100:00100000:1.0:1786015427.668493:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 405 00000100:00100000:1.0:1786015427.668503:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+14:2352:x1872772280489344:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015427.668595:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+14:2352:x1872772280489344:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 85us (3765us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015427.668603:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 405 00000100:00100000:1.0:1786015427.668621:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 406 00000100:00100000:1.0:1786015427.668627:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2352:x1872772280489856:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015427.668652:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2352:x1872772280489856:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (3759us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015427.668658:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 406 00000100:00080000:2.0:1786015427.669431:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015427.669438:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015427.670256:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015427.670298:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015427.670325:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015427.670449:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280489216 00000100:00100000:3.0:1786015427.670459:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280489216 00000100:00100000:3.0:1786015427.670521:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 428 00000100:00100000:3.0:1786015427.670530:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+88:2352:x1872772280489216:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015427.670604:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+88:2352:x1872772280489216:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 75us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015427.670610:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 428 00000100:00100000:1.0:1786015427.670912:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280489472 00000100:00100000:1.0:1786015427.670926:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280489472 00000100:00100000:1.0:1786015427.670960:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280489728 00000100:00100000:1.0:1786015427.670963:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280489728 00000100:00100000:1.0:1786015427.670985:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 407 00000100:00100000:1.0:1786015427.670991:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280489472:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015427.671039:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280489472:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 48us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015427.671046:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 407 00000100:00100000:1.0:1786015427.671059:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 408 00000100:00100000:1.0:1786015427.671065:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280489728:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015427.671088:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280489728:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015427.671094:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 408 00000100:00080000:2.0:1786015427.671503:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015427.671508:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015427.671511:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015427.704698:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015427.704876:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280489984 00000100:00100000:0.0:1786015427.704888:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280489984 00000100:00100000:0.0:1786015427.704954:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1033 00000100:00100000:0.0:1786015427.704966:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+41:27121:x1872772280489984:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1786015427.705570:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+41:27121:x1872772280489984:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 293us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015427.705579:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1033 00000100:00100000:0.0:1786015427.756032:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304408704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015427.756117:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015427.756261:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304408704 00000100:00100000:2.0:1786015427.756283:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304408704 00000100:00100000:2.0:1786015427.756499:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1786015427.756509:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304408704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015427.756542:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015427.756620:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304408704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015427.756628:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1786015427.756947:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967350 gen 2 00000004:00080000:1.0:1786015427.756953:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967350 committed transno 4294967350 00000100:00100000:1.0:1786015427.756980:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304408704:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786015427.757034:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786015428.468039:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015429.291996:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304408960:0@lo:400:kworker.0 00000100:00100000:3.0:1786015429.292016:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786015429.292036:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304409088:0@lo:400:kworker.0 00000100:00100000:1.0:1786015429.292085:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015429.292123:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015429.292180:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786015429.292198:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304409216:0@lo:400:kworker.0 00000100:00100000:1.0:1786015429.292265:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786015429.292272:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304408832:0@lo:400:kworker.0 00000100:00100000:3.0:1786015429.296386:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304408960 00000100:00100000:3.0:1786015429.296407:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304408960 00000100:00100000:3.0:1786015429.296477:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304409088 00000100:00100000:3.0:1786015429.296480:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304409088 00000100:00100000:3.0:1786015429.296828:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1786015429.296842:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304408960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015429.296855:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1786015429.296869:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304409088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015429.296956:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304409088:12345-0@lo:400:kworker.0 Request processed in 92us (4843us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015429.296964:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1786015429.297465:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304408960:12345-0@lo:400:kworker.0 Request processed in 456us (5208us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015429.297474:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00080000:3.0:1786015429.297557:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015429.297605:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304409088:0@lo:400:kworker.0 00000100:00100000:0.0:1786015429.298791:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304409344:0@lo:400:kworker.0 00000100:00100000:0.0:1786015429.298855:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015429.298900:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015429.298922:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304409472:0@lo:400:kworker.0 00000100:00100000:0.0:1786015429.298950:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015429.300015:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304409344 00000100:00100000:3.0:1786015429.300031:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304409344 00000100:00100000:3.0:1786015429.300100:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1786015429.300131:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304409344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015429.300282:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304409344:12345-0@lo:400:kworker.0 Request processed in 152us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015429.300289:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00080000:3.0:1786015429.300582:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015429.300622:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304409344:0@lo:400:kworker.0 00000100:00100000:0.0:1786015429.300829:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015429.301139:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304409472 00000100:00100000:2.0:1786015429.301145:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304409472 00000100:00100000:3.0:1786015429.301624:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304409216 00000100:00100000:3.0:1786015429.301629:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304409216 00000100:00100000:3.0:1786015429.301854:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1786015429.301868:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304409472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015429.302129:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304409472:12345-0@lo:400:kworker.0 Request processed in 263us (3175us total) trans 0 rc 0/0 00000100:00080000:2.0:1786015429.302154:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015429.302159:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015429.303668:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:0.0:1786015429.303691:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304409216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015429.303796:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304409216:12345-0@lo:400:kworker.0 Request processed in 117us (2968us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015429.303803:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:0.0:1786015429.303867:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304409216:0@lo:400:kworker.0 00000100:00100000:3.0:1786015429.305628:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1786015429.305716:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967356 gen 2 00000004:00080000:3.0:1786015429.305724:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967355 committed transno 4294967356 00000004:00080000:3.0:1786015429.305747:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b74aa474a80, transno 4294967356 00000100:00100000:3.0:1786015429.305788:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304409472:0@lo:400:kworker.0 00000100:00100000:0.0:1786015429.308864:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015429.308965:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304408960:0@lo:400:kworker.0 00000100:00100000:3.0:1786015429.309146:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304408832 00000100:00100000:3.0:1786015429.309154:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304408832 00000100:00100000:3.0:1786015429.309947:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:3.0:1786015429.309960:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304408832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015429.310055:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304408832:12345-0@lo:400:kworker.0 Request processed in 99us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015429.310063:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:3.0:1786015429.319748:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304408832:0@lo:400:kworker.0 00010000:00010000:2.0:1786015429.485421:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015429.804982:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786015429.805006:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304409600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015429.805068:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015429.805139:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304409600 00000100:00100000:3.0:1786015429.805146:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304409600 00000100:00100000:3.0:1786015429.805188:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1786015429.805196:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304409600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015429.805230:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 74776576 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015429.805268:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304409600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015429.805275:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1786015429.805325:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304409600:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1786015429.971816:0:19531:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12h: Restore a released file implicitly from a second node ========================================================== 07:23:48 (1786015428) 00010000:00010000:0.0:1786015430.510001:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1786015430.879793:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 18 batchid updated 00000020:00080000:0.0:1786015430.879872:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 18 00000020:00080000:0.0:1786015430.879886:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 18 00010000:00010000:0.0:1786015431.531908:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786015432.270903:0:19580:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-hsm test_12h Need 2 or more clients, have 1 00010000:00010000:2.0:1786015432.557588:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015432.768887:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015432.768937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015432.768966:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015432.768998:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015432.769021:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015432.769066:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015432.769107:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280490112 00000100:00100000:1.0:1786015432.769118:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280490112 00000100:00100000:1.0:1786015432.769168:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 575 00000100:00100000:1.0:1786015432.769179:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280490112:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015432.769268:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280490112:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 91us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015432.769276:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 575 00000100:00100000:1.0:1786015432.769313:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280490496 00000100:00100000:1.0:1786015432.769317:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280490496 00000100:00100000:1.0:1786015432.769353:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280490752 00000100:00100000:1.0:1786015432.769356:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280490752 00000100:00100000:1.0:1786015432.769374:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280490368 00000100:00100000:1.0:1786015432.769377:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280490368 00000100:00100000:1.0:1786015432.769392:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 411 00000100:00100000:1.0:1786015432.769398:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280490496:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015432.769430:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280490496:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015432.769436:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 411 00000100:00100000:1.0:1786015432.769447:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 412 00000100:00100000:1.0:1786015432.769452:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280490752:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015432.769475:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280490752:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015432.769480:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 412 00000100:00100000:1.0:1786015432.769489:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 413 00000100:00100000:1.0:1786015432.769494:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+14:2353:x1872772280490368:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015432.769525:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+14:2353:x1872772280490368:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015432.769532:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 413 00000100:00100000:1.0:1786015432.769551:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280490240 00000100:00100000:1.0:1786015432.769555:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280490240 00000100:00100000:1.0:1786015432.769583:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280490624 00000100:00100000:1.0:1786015432.769586:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280490624 00000100:00100000:1.0:1786015432.769608:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 432 00000100:00100000:1.0:1786015432.769614:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+88:2353:x1872772280490240:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015432.769643:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+88:2353:x1872772280490240:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015432.769650:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 432 00000100:00100000:1.0:1786015432.769661:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 433 00000100:00100000:1.0:1786015432.769666:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+41:2353:x1872772280490624:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015432.769689:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+41:2353:x1872772280490624:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015432.769694:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 433 00000100:00080000:1.0:1786015432.769888:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015432.769893:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015432.769895:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015432.776658:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015432.776750:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280490880 00000100:00100000:1.0:1786015432.776794:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280490880 00000100:00080000:2.0:1786015432.776909:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015432.776996:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 414 00000100:00100000:1.0:1786015432.777009:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280490880:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015432.777102:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280490880:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 95us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015432.777127:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 414 00000100:00100000:0.0:1786015432.876273:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786015432.876307:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304409728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015432.876398:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015432.877303:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304409728 00000100:00100000:1.0:1786015432.877320:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304409728 00000100:00100000:1.0:1786015432.877427:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1786015432.877439:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304409728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015432.877494:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00080000:2.0:1786015432.877809:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015432.878459:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304409728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1018us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015432.878472:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1786015432.878683:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304409728:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786015433.579939:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015434.412185:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304410240:0@lo:400:kworker.0 00000100:00100000:1.0:1786015434.412394:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304409984:0@lo:400:kworker.0 00000100:00100000:0.0:1786015434.412476:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304409856:0@lo:400:kworker.0 00000100:00100000:1.0:1786015434.415605:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015434.417945:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304410496:0@lo:400:kworker.0 00000100:00100000:1.0:1786015434.418033:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015434.423457:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304409984 00000100:00100000:2.0:1786015434.423480:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304409984 00000100:00100000:2.0:1786015434.423567:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1786015434.423581:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304409984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015434.423721:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304409984:12345-0@lo:400:kworker.0 Request processed in 144us (8129us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015434.423730:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1786015434.423831:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304409984:0@lo:400:kworker.0 00000100:00100000:2.0:1786015434.423887:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304410112:0@lo:400:kworker.0 00000100:00100000:2.0:1786015434.423935:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015434.423999:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304410112 00000100:00100000:2.0:1786015434.424004:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304410112 00000100:00100000:2.0:1786015434.424041:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1786015434.424048:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304410112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015434.424106:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304410112:12345-0@lo:400:kworker.0 Request processed in 58us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015434.424114:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00080000:2.0:1786015434.424133:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015434.424156:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304410112:0@lo:400:kworker.0 00000100:00100000:2.0:1786015434.424192:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304410496 00000100:00100000:2.0:1786015434.424196:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304410496 00000100:00100000:2.0:1786015434.424230:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1786015434.424236:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304410496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015434.424277:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304410496:12345-0@lo:400:kworker.0 Request processed in 41us (6244us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015434.424284:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00080000:2.0:1786015434.424301:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015434.424318:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304410496:0@lo:400:kworker.0 00000100:00100000:3.0:1786015434.427314:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015434.427420:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304410240 00000100:00100000:3.0:1786015434.427432:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304410240 00000100:00100000:3.0:1786015434.427507:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1786015434.427521:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304410240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015434.427603:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304410240:12345-0@lo:400:kworker.0 Request processed in 86us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015434.427611:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00080000:3.0:1786015434.427642:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015434.427850:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304410240:0@lo:400:kworker.0 00000100:00100000:0.0:1786015434.429079:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015434.429146:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304410368:0@lo:400:kworker.0 00000100:00100000:0.0:1786015434.429216:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015434.429267:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304410368 00000100:00100000:0.0:1786015434.429277:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304410368 00000100:00100000:0.0:1786015434.429360:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1786015434.429369:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304410368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015434.429432:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304410368:12345-0@lo:400:kworker.0 Request processed in 64us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015434.429441:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00080000:0.0:1786015434.429464:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015434.429497:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304410368:0@lo:400:kworker.0 00000100:00100000:2.0:1786015434.430969:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304409856 00000100:00100000:2.0:1786015434.430989:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304409856 00000100:00100000:2.0:1786015434.431055:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:2.0:1786015434.431076:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304409856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015434.431198:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304409856:12345-0@lo:400:kworker.0 Request processed in 134us (2133us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015434.431207:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:3.0:1786015434.432095:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304409856:0@lo:400:kworker.0 00010000:00010000:1.0:1786015434.604956:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786015434.613266:0:19628:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12m: Archive/release/implicit restore ========================================================== 07:23:52 (1786015432) 00000100:00100000:0.0:1786015434.931992:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304410624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015434.932124:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015434.932220:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304410624 00000100:00100000:0.0:1786015434.932230:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304410624 00000100:00100000:0.0:1786015434.932289:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1786015434.932299:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304410624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015434.932344:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 74776576 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015434.932396:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304410624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015434.932404:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1786015434.932456:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304410624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015435.070897:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015435.079845:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280491008 00000100:00100000:2.0:1786015435.079863:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280491008 00000100:00100000:2.0:1786015435.079967:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1034 00000100:00100000:2.0:1786015435.079981:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+41:28043:x1872772280491008:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1786015435.080110:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+41:28043:x1872772280491008:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 133us (9222us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015435.080119:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1034 00000100:00080000:0.0:1786015435.080224:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015435.101884:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015435.103396:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280491136 00000100:00100000:2.0:1786015435.103415:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280491136 00000100:00100000:2.0:1786015435.103544:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1035 00000100:00100000:2.0:1786015435.103745:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+88:28044:x1872772280491136:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015435.103816:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015435.103847:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501942 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e877d expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.103938:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501949 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.103955:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501949 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.103972:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501949 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.103993:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501950 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.104001:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.104008:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786015435.105848:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786015435.106616:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501949 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.106812:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501949 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.106820:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501949 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.106827:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015435.106832:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501949 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.106841:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501949 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.106861:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:2.0:1786015435.106865:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015435.106870:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501949 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.106876:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501949 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.106892:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.106898:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501950 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.106904:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501950 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.106918:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015435.106921:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501950 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.106927:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501950 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.106934:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2c7f40eb (ffff8b7499c59a00) 00010000:00010000:2.0:1786015435.106937:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015435.106940:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501950 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.106945:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501950 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.107005:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501942 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e877d expref: 89 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.107017:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:2.0:1786015435.107019:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015435.107023:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501942 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e877d expref: 89 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.107032:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906e00, rc 0) 00000100:00100000:2.0:1786015435.107256:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+88:28044:x1872772280491136:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3513us (5383us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015435.120048:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1035 00000100:00100000:3.0:1786015435.129041:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015435.129400:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280491392 00000100:00100000:0.0:1786015435.129414:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280491392 00000100:00100000:0.0:1786015435.129495:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1036 00000100:00100000:0.0:1786015435.129508:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+88:28044:x1872772280491392:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:0.0:1786015435.129605:0:7673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015435.130313:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50169b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e868f expref: 88 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.130342:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:0.0:1786015435.130348:0:7673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015435.130846:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501957 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.130863:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86a4 expref: 40 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.130873:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501957 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.130919:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86a4 expref: 40 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.130938:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86a4 expref: 40 pid: 12526 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015435.130958:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304410752:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015435.132490:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482dfd840 going to sleep for 11 seconds 00000100:00100000:0.0:1786015435.135470:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304410752:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015435.135511:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501957 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015435.139001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015435.139135:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280491520 00000100:00100000:1.0:1786015435.139159:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280491520 00010000:00010000:1.0:1786015435.139224:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86a4 expref: 41 pid: 12526 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015435.139277:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 314 00000100:00100000:1.0:1786015435.139289:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+41:2354:x1872772280491520:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015435.139308:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015435.139316:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86a4 expref: 41 pid: 12526 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.139351:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86a4 expref: 41 pid: 12526 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.139380:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5016da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e86a4 expref: 41 pid: 12526 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.139400:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:1.0:1786015435.139407:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501957 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.139418:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501957 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.139428:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501957 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.139468:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015435.139540:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+40:2354:x1872772280491520:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 253us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015435.139548:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 314 00010000:00010000:3.0:1786015435.139885:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501957 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.139896:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501957 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.139927:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50195e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.139938:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50195e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.139946:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50195e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015435.144318:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x40:0x0]: returning size 512 00010000:00010000:3.0:1786015435.144343:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501957 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.144356:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501957 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.144364:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501957 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.144370:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015435.144375:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501957 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.144383:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501957 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.144412:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6800) 00010000:00010000:3.0:1786015435.144415:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015435.144422:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501957 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.144428:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501957 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015435.144455:0:7673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ae4a46d5 reply state 000000006bfc3dac transno 4294967973 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50195e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015435.144465:0:7673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015435.144603:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+89:28044:x1872772280491392:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 15092us (15570us total) trans 4294967973 rc 0/0 00000100:00100000:3.0:1786015435.144613:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1036 00010000:00010000:0.0:1786015435.153091:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50195e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.153144:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50195e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.153153:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50195e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.153159:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015435.153165:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50195e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.153175:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50195e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.153198:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2c7f40eb (ffff8b74a04b5400) 00010000:00010000:0.0:1786015435.153201:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015435.153207:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50195e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.153213:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50195e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015435.155188:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015435.155315:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280491648 00000100:00100000:2.0:1786015435.155347:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280491648 00000100:00100000:2.0:1786015435.155426:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1037 00000100:00100000:2.0:1786015435.155438:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+88:28045:x1872772280491648:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1786015435.155472:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015435.155502:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501965 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8784 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.155589:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50196c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.155605:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50196c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.155618:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50196c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015435.155696:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1786015435.155700:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 27 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015435.155726:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50196c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.155754:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501965 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8784 expref: 90 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.155802:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50196c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8784 expref: 89 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.155813:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7499c59a00) 00010000:00010000:2.0:1786015435.155817:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015435.155821:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907e00, rc 0) 00000100:00100000:2.0:1786015435.155913:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+89:28045:x1872772280491648:12345-192.168.202.56@tcp:101:bash.0 Request processed in 477us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015435.155922:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1037 00000100:00100000:3.0:1786015435.159955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015435.160128:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280491776 00000100:00100000:2.0:1786015435.160153:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280491776 00000100:00100000:2.0:1786015435.160244:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1038 00000100:00100000:2.0:1786015435.160257:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+89:28045:x1872772280491776:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1786015435.160287:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015435.160315:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501973 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e878b expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.160408:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50197a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.160427:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50197a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.160442:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50197a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.160461:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501981 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.160469:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.160476:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.160636:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c501988 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.160663:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c501988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.160671:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c501988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015435.160715:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x40:0x0]: returning size 512 00000004:00200000:2.0:1786015435.160720:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015435.160748:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c501988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.163369:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50197a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.163394:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50197a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.163402:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50197a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.163409:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015435.163414:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50197a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.163423:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50197a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.163446:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7499c59a00) 00010000:00010000:2.0:1786015435.163449:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015435.163454:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50197a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.163488:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50197a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.163509:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.163515:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501981 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.163521:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501981 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.163526:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015435.163529:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501981 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.163535:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501981 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.163544:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2c7f40eb (ffff8b7499c59e00) 00010000:00010000:2.0:1786015435.163547:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015435.163550:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501981 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.163556:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501981 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.163623:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501973 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e878b expref: 91 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.163653:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381935200/0xb1a5ef690c501988 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e878b expref: 90 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.163662:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8b7499c59500) 00010000:00010000:2.0:1786015435.163664:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786015435.163667:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7381935200, rc 0) 00000100:00100000:0.0:1786015435.166518:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+90:28045:x1872772280491776:12345-192.168.202.56@tcp:101:bash.0 Request processed in 6243us (6557us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015435.166535:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1038 00000100:00100000:2.0:1786015435.171019:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015435.171196:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280491904 00000100:00100000:3.0:1786015435.171209:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280491904 00000100:00100000:3.0:1786015435.171292:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1039 00000100:00100000:3.0:1786015435.171304:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+90:28045:x1872772280491904:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1786015435.171336:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015435.171366:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c50198f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8792 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.171603:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501996 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.171621:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501996 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.171653:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501996 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.171671:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c50199d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.171689:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c50199d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.171697:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c50199d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.171933:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501996 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.171942:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501996 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.171949:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501996 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.171956:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015435.171961:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501996 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.171968:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501996 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.171984:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8b7499c59500) 00010000:00010000:3.0:1786015435.171987:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015435.171992:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501996 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.172007:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501996 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.172023:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c50199d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.172030:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c50199d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.172036:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c50199d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.172040:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015435.172043:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c50199d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.172049:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c50199d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.172066:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff8b74a04b5100) 00010000:00010000:3.0:1786015435.172069:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015435.172072:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c50199d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.172077:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c50199d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.172118:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c50198f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8792 expref: 91 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.172474:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8b7499c59500) 00010000:00010000:3.0:1786015435.172479:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015435.172485:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c50198f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8792 expref: 91 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.172498:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc800, rc 0) 00000100:00100000:3.0:1786015435.172591:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+90:28045:x1872772280491904:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1288us (1585us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015435.172600:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1039 00000100:00100000:3.0:1786015435.192470:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015435.192749:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280492032 00000100:00100000:0.0:1786015435.192805:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280492032 00000100:00100000:0.0:1786015435.192877:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1040 00000100:00100000:0.0:1786015435.192890:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+40:28046:x1872772280492032:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:0.0:1786015435.192921:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015435.192971:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5019a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8799 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.193079:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5019ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.193098:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5019ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.193113:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5019ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015435.193200:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1786015435.193204:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 27 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015435.193249:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5019ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.193279:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5019a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8799 expref: 42 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.193302:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5019ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8799 expref: 41 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.193312:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7499c59a00) 00010000:00010000:0.0:1786015435.193316:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015435.193321:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd800, rc 0) 00000100:00100000:0.0:1786015435.193531:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+41:28046:x1872772280492032:12345-192.168.202.56@tcp:101:rm.0 Request processed in 643us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015435.193540:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1040 00000100:00100000:0.0:1786015435.198406:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015435.198518:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280492160 00000100:00100000:1.0:1786015435.198540:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280492160 00000100:00100000:1.0:1786015435.198614:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1041 00000100:00100000:1.0:1786015435.198626:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+41:28046:x1872772280492160:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:1.0:1786015435.198657:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015435.198686:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5019b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e87a0 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.198808:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c5019b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.198827:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c5019b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.198841:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c5019b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.198859:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c5019c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.198866:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c5019c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.198873:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c5019c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199016:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c5019c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199026:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c5019c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199033:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c5019c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015435.199084:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x40:0x0]: returning size 512 00000004:00200000:1.0:1786015435.199089:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015435.199121:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c5019c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199157:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c5019b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199165:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c5019b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199173:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c5019b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199179:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015435.199184:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c5019b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199191:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c5019b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199205:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7499c59a00) 00010000:00010000:1.0:1786015435.199209:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015435.199214:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c5019b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199220:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c5019b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199659:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c5019c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199672:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c5019c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199679:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c5019c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199692:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015435.199696:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c5019c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199703:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c5019c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199714:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2c7f40eb (ffff8b7483ee6f00) 00010000:00010000:1.0:1786015435.199717:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015435.199720:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c5019c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199728:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c5019c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199862:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5019b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87a0 expref: 43 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199880:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47400/0xb1a5ef690c5019c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87a0 expref: 42 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.199889:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8b7499c59500) 00010000:00010000:1.0:1786015435.199891:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1786015435.199894:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47400, rc 0) 00000100:00100000:1.0:1786015435.199992:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28046:x1872772280492160:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1366us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015435.200000:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1041 00000100:00100000:1.0:1786015435.203623:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015435.203757:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280492288 00000100:00100000:3.0:1786015435.203796:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280492288 00000100:00100000:3.0:1786015435.203867:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1042 00000100:00100000:3.0:1786015435.203879:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28046:x1872772280492288:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015435.203908:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015435.203939:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5019ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e87a7 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204050:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5019d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204076:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5019d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204091:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5019d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204121:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5019dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204129:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5019dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204135:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5019dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204228:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5019d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204242:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5019d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204250:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5019d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204257:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015435.204261:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5019d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204270:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5019d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204286:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8b7499c59500) 00010000:00010000:3.0:1786015435.204290:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015435.204297:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5019d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204304:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c5019d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204328:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5019dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204335:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5019dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204341:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5019dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204347:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015435.204350:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5019dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204357:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5019dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204366:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff8b74a04b5100) 00010000:00010000:3.0:1786015435.204368:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015435.204371:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5019dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204377:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5019dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204418:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5019ce lrc: 1/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87a7 expref: 43 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204430:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8b7499c59500) 00010000:00010000:3.0:1786015435.204433:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015435.204443:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5019ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87a7 expref: 43 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.204452:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd200, rc 0) 00000100:00100000:3.0:1786015435.204542:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28046:x1872772280492288:12345-192.168.202.56@tcp:101:rm.0 Request processed in 664us (933us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015435.204550:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1042 00000100:00100000:3.0:1786015435.209376:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015435.209539:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280492416 00000100:00100000:0.0:1786015435.209553:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280492416 00000100:00100000:0.0:1786015435.209630:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1043 00000100:00100000:0.0:1786015435.209643:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28046:x1872772280492416:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:0.0:1786015435.209674:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015435.209711:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5019e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e87ae expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.209831:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5019ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.209849:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5019ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.209863:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5019ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.209881:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5019f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.209888:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5019f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.209896:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5019f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.209979:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5019ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.209987:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5019ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.210017:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5019ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.210025:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015435.210029:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5019ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.210038:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5019ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.210051:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8b7499c59500) 00010000:00010000:0.0:1786015435.210065:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015435.210071:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5019ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.210078:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5019ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.210094:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5019f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.210100:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5019f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.210107:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5019f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.210112:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015435.210115:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5019f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.210131:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5019f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.210139:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff8b748f24a000) 00010000:00010000:0.0:1786015435.210141:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015435.210144:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5019f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.210149:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5019f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.210189:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5019e3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87ae expref: 43 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.210200:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8b7499c59500) 00010000:00010000:0.0:1786015435.210203:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015435.210206:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c5019e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87ae expref: 43 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.210216:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd200, rc 0) 00000100:00100000:0.0:1786015435.210303:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28046:x1872772280492416:12345-192.168.202.56@tcp:101:rm.0 Request processed in 662us (941us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015435.210310:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1043 00000100:00100000:3.0:1786015435.244391:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015435.244595:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280492544 00000100:00100000:1.0:1786015435.244610:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280492544 00000100:00100000:1.0:1786015435.244690:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1044 00000100:00100000:1.0:1786015435.244702:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28047:x1872772280492544:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015435.244732:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015435.244803:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5019f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e87b5 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.244912:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5019ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.244929:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5019ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.244942:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5019ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.244958:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501a06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.244964:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.244970:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.245068:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5019ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.245078:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5019ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.245112:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5019ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.245119:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015435.245124:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5019ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.245133:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5019ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.245147:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8b7499c59500) 00010000:00010000:1.0:1786015435.245151:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015435.245160:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5019ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.245167:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c5019ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.245183:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.245189:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501a06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.245195:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.245200:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015435.245202:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.245220:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501a06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.245235:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff8b7483ee6f00) 00010000:00010000:1.0:1786015435.245237:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015435.245241:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501a06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.245247:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501a06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.245286:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5019f8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87b5 expref: 43 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.245298:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8b7499c59500) 00010000:00010000:1.0:1786015435.245301:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015435.245304:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5019f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87b5 expref: 43 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.245315:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47000, rc 0) 00000100:00100000:1.0:1786015435.245406:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28047:x1872772280492544:12345-192.168.202.56@tcp:101:cp.0 Request processed in 706us (1030us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015435.245414:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1044 00000100:00100000:2.0:1786015435.252657:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015435.252873:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280492672 00000100:00100000:1.0:1786015435.252887:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280492672 00000100:00100000:1.0:1786015435.252953:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1045 00000100:00100000:1.0:1786015435.252965:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28047:x1872772280492672:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015435.253013:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015435.253039:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501a0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e87bc expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.253134:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a14 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254341:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254360:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254391:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501a1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254398:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501a1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254405:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501a1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254493:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254500:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a14 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254507:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254513:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015435.254533:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254542:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a14 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254556:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8b7499c59500) 00010000:00010000:1.0:1786015435.254559:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015435.254565:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254575:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254591:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501a1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254596:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501a1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254602:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501a1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254607:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015435.254609:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501a1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254615:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501a1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254622:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff8b7483ee6500) 00010000:00010000:1.0:1786015435.254624:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015435.254634:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501a1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254639:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501a1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254690:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501a0d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87bc expref: 43 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254702:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8b7499c59500) 00010000:00010000:1.0:1786015435.254704:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015435.254708:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501a0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87bc expref: 43 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.254719:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46400, rc 0) 00000100:00100000:1.0:1786015435.258520:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28047:x1872772280492672:12345-192.168.202.56@tcp:101:cp.0 Request processed in 5536us (5858us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015435.258538:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1045 00000100:00100000:3.0:1786015435.262000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015435.265570:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280492928 00000100:00100000:2.0:1786015435.265591:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280492928 00000100:00100000:2.0:1786015435.265691:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1046 00000100:00100000:2.0:1786015435.265703:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28047:x1872772280492928:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015435.265733:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015435.265816:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501a22 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e87c3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.266133:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501a29 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.266152:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501a29 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.266165:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501a29 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.266183:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c501a30 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.266190:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c501a30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.266196:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c501a30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786015435.269729:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17:0x0], index 1: 0 00010000:00010000:3.0:1786015435.270252:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501a37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.270294:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501a37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.270310:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501a37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.270367:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501a29 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.270376:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501a29 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.270384:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501a29 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.270390:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015435.270395:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501a29 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.270404:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501a29 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.270418:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8b7499c59500) 00010000:00010000:3.0:1786015435.270422:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015435.270426:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501a29 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.270432:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501a29 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015435.270446:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000001a455ab reply state 000000005b2ad5e2 transno 4294967974 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c501a30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015435.270464:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786015435.272691:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501a22 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87c3 expref: 45 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.272732:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501a37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87c3 expref: 44 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015435.272743:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:3.0:1786015435.272746:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015435.272750:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbce00, rc 0) 00000100:00100000:3.0:1786015435.272953:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28047:x1872772280492928:12345-192.168.202.56@tcp:101:cp.0 Request processed in 7249us (10964us total) trans 4294967974 rc 0/0 00000100:00100000:3.0:1786015435.272965:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1046 00010000:00010000:0.0:1786015435.287487:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c501a30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.287524:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c501a30 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.287551:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c501a30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.287559:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015435.287565:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c501a30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.287576:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c501a30 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.287599:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff8b74a04b5100) 00010000:00010000:0.0:1786015435.287602:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015435.287608:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c501a30 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.287616:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c501a30 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015435.288742:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015435.290139:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280493056 00000100:00100000:1.0:1786015435.290159:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280493056 00000100:00080000:0.0:1786015435.290227:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015435.290267:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 273 00000100:00100000:1.0:1786015435.290283:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280493056:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015435.290311:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015435.290343:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c501a45 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e87ca expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015435.290381:0:14547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786015435.290411:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=670s v=(0 0) 00010000:00010000:1.0:1786015435.290434:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015435.290447:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c501a45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87ca expref: 11 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.290472:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c501a45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87ca expref: 11 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.290489:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46400, rc 0) 00000100:00100000:1.0:1786015435.290582:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280493056:12345-192.168.202.56@tcp:101:cp.0 Request processed in 304us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015435.290590:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 273 00000100:00100000:3.0:1786015435.300603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015435.300807:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280493184 00000100:00100000:2.0:1786015435.300821:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280493184 00000100:00100000:2.0:1786015435.300897:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 274 00000100:00100000:2.0:1786015435.300910:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:28047:x1872772280493184:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015435.300936:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015435.300962:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002287730d/0xb1a5ef690c501a4c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e87d1 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.301006:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c501a45 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87ca expref: 12 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.301034:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015435.301039:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015435.301046:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002287730d/0xb1a5ef690c501a4c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d1 expref: 12 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.301101:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c501a45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87ca expref: 12 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.301117:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c501a45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87ca expref: 12 pid: 14547 timeout: 770 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015435.301133:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304410880:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015435.301464:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786015435.305889:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304410880:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015435.305942:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002287730d/0xb1a5ef690c501a4c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d1 expref: 12 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015435.305972:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906800, rc 0) 00000100:00100000:2.0:1786015435.306109:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+12:28047:x1872772280493184:12345-192.168.202.56@tcp:101:cp.0 Request processed in 5200us (5519us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015435.306120:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 274 00000100:00100000:3.0:1786015435.320779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015435.321214:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280493312 00000100:00100000:0.0:1786015435.321228:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280493312 00010000:00010000:0.0:1786015435.321292:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c501a45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87ca expref: 12 pid: 14547 timeout: 770 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015435.321346:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 315 00000100:00100000:0.0:1786015435.321359:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280493312:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015435.321379:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015435.321411:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c501a45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87ca expref: 12 pid: 14547 timeout: 770 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.321447:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c501a45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87ca expref: 12 pid: 14547 timeout: 770 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.321478:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031b7654b/0xb1a5ef690c501a45 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87ca expref: 12 pid: 14547 timeout: 770 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.321502:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015435.321508:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015435.321519:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002287730d/0xb1a5ef690c501a4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d1 expref: 11 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.321532:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002287730d/0xb1a5ef690c501a4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d1 expref: 11 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.321586:0:6607:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002287730d/0xb1a5ef690c501a4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d1 expref: 11 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015435.321606:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6607:1872772304411008:192.168.202.56@tcp:105: 00000100:00100000:0.0:1786015435.321711:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482dfd840 going to sleep for 11 seconds 00000100:00100000:3.0:1786015435.334969:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015435.335166:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6607:1872772304411008:192.168.202.56@tcp:105: 00010000:00010000:0.0:1786015435.335203:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015435.335305:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280493312:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 13947us (14555us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015435.335321:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 315 00000100:00100000:2.0:1786015435.336185:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280493568 00000100:00100000:2.0:1786015435.336199:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280493568 00000100:00100000:2.0:1786015435.336306:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 208 00000100:00100000:2.0:1786015435.336330:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+44:28047:x1872772280493568:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:2.0:1786015435.338550:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28047:x1872772280493568:12345-192.168.202.56@tcp:35:cp.0 Request processed in 2208us (3581us total) trans 4294967975 rc 0/0 00000100:00100000:2.0:1786015435.338565:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 208 00000100:00100000:3.0:1786015435.407865:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015435.409159:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280493696 00000100:00100000:0.0:1786015435.409182:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280493696 00000100:00100000:0.0:1786015435.412501:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1047 00000100:00100000:0.0:1786015435.412537:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+90:28050:x1872772280493696:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015435.412572:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015435.412605:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501a53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e87d8 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.412697:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501a5a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.412717:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501a5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.412732:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501a5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.412751:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501a61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.412759:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.412790:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.412933:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501a68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.412944:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.412977:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015435.413022:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1d:0x0]: returning size 1516 00000004:00200000:0.0:1786015435.413027:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015435.413066:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.413081:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.413090:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501a5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.413095:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501a5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.413101:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501a5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.413105:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015435.413108:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501a5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.413114:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501a5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.413125:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8b7499c59500) 00010000:00010000:0.0:1786015435.413127:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015435.413132:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501a5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.413145:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501a5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.413157:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.413161:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501a61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.413165:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501a61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.413168:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015435.413170:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501a61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.413173:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501a61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.413177:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff8b748f24a000) 00010000:00010000:0.0:1786015435.413179:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015435.413180:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501a61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.413183:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501a61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.413213:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501a53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d8 expref: 92 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.413231:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501a68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d8 expref: 91 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.413415:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:0.0:1786015435.413417:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015435.413419:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd600, rc 0) 00000100:00100000:0.0:1786015435.416305:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+91:28050:x1872772280493696:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3767us (8435us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015435.416326:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1047 00000100:00100000:3.0:1786015435.430643:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015435.430789:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280493824 00000100:00100000:0.0:1786015435.430803:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280493824 00000100:00100000:0.0:1786015435.430896:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 275 00000100:00100000:0.0:1786015435.430909:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280493824:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015435.430939:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015435.430964:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055f19d6a/0xb1a5ef690c501a6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e87df expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015435.431048:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304411136:192.168.202.56@tcp:106: 00000100:00100000:0.0:1786015435.431192:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482dfd840 going to sleep for 11 seconds 00000100:00080000:3.0:1786015435.431693:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1786015435.443015:0:6591:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x17:0x0] updating lvb size: 0 -> 1516 00002000:00010000:0.0:1786015435.443026:0:6591:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x17:0x0] updating lvb mtime: 0 -> 1786015435 00002000:00010000:0.0:1786015435.443028:0:6591:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x17:0x0] updating lvb atime: 0 -> 1786015435 00002000:00010000:0.0:1786015435.443030:0:6591:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x17:0x0] updating lvb ctime: 0 -> 1786015435 00000100:00100000:0.0:1786015435.443095:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304411136:192.168.202.56@tcp:106: 00010000:00010000:0.0:1786015435.443211:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000055f19d6a/0xb1a5ef690c501a6f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87df expref: 13 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.443329:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055f19d6a/0xb1a5ef690c501a6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87df expref: 13 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015435.443349:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd200, rc 0) 00000100:00100000:0.0:1786015435.443488:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280493824:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 12582us (12859us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015435.443499:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 275 00000100:00100000:3.0:1786015435.446717:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015435.446864:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280493952 00000100:00100000:1.0:1786015435.446877:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280493952 00000100:00100000:1.0:1786015435.446961:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1048 00000100:00100000:1.0:1786015435.446974:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+91:28050:x1872772280493952:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015435.447003:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015435.447033:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501a76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e87e6 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.447151:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.447169:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.447182:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015435.447405:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x40:0x0]: returning size 512 00000004:00200000:1.0:1786015435.447426:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015435.447457:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.447492:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501a76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87e6 expref: 93 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.447516:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87e6 expref: 92 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.447526:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8b7499c59500) 00010000:00010000:1.0:1786015435.447530:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015435.447535:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46600, rc 0) 00000100:00100000:1.0:1786015435.447620:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+92:28050:x1872772280493952:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 649us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015435.447629:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1048 00000100:00100000:3.0:1786015435.451493:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015435.451601:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280494080 00000100:00100000:1.0:1786015435.451614:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280494080 00000100:00100000:1.0:1786015435.451697:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 276 00000100:00100000:1.0:1786015435.451712:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280494080:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015435.451739:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015435.451858:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ca44aba/0xb1a5ef690c501a84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e87ed expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015435.451943:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa477b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304411264:192.168.202.56@tcp:106: 00000100:00100000:1.0:1786015435.452185:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7491f64300 going to sleep for 11 seconds 00000100:00100000:1.0:1786015435.455672:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa477b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304411264:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015435.455752:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000ca44aba/0xb1a5ef690c501a84 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87ed expref: 13 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.455826:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ca44aba/0xb1a5ef690c501a84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87ed expref: 13 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015435.455844:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47000, rc 0) 00000100:00100000:1.0:1786015435.455929:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280494080:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 4219us (4449us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015435.455941:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 276 00000100:00100000:2.0:1786015435.461028:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015435.461213:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280494336 00000100:00100000:3.0:1786015435.461227:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280494336 00000100:00100000:3.0:1786015435.461394:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1049 00000100:00100000:3.0:1786015435.461406:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+92:28050:x1872772280494336:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:3.0:1786015435.461884:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].28, 136 off12000 00000100:00100000:3.0:1786015435.462062:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+92:28050:x1872772280494336:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 646us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015435.462072:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1049 00010000:00010000:1.0:1786015435.627971:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015436.012459:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015436.012476:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015436.012990:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 29 count 2 00000040:00080000:1.0:1786015436.013000:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015436.013385:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa477b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304411392:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015436.013527:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b749306cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015436.024240:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa477b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304411392:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015436.037166:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015436.037254:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280494464 00000100:00100000:0.0:1786015436.037268:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280494464 00000100:00100000:0.0:1786015436.037345:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1050 00000100:00100000:0.0:1786015436.037358:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28060:x1872772280494464:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015436.037410:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x1d:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015436.037686:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28060:x1872772280494464:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 329us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015436.037696:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1050 00000100:00100000:0.0:1786015436.050752:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015436.050820:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280494720 00000100:00100000:0.0:1786015436.050834:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280494720 00000100:00100000:0.0:1786015436.050904:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1051 00000100:00100000:0.0:1786015436.050917:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28060:x1872772280494720:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015436.050947:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015436.050979:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501a8b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e87f4 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.051176:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501a92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.051197:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501a92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.051215:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501a92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015436.051229:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1d:0x0]: returning size 1516 00010000:00010000:0.0:1786015436.051443:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501a8b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87f4 expref: 48 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.051467:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501a92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87f4 expref: 47 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.051477:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:0.0:1786015436.051481:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015436.051486:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc000, rc 0) 00000100:00100000:0.0:1786015436.051565:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+47:28060:x1872772280494720:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 650us (839us total) trans 4294967976 rc 0/0 00000100:00100000:0.0:1786015436.051573:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1051 00000100:00100000:2.0:1786015436.057218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015436.057267:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015436.057309:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280494848 00000100:00100000:2.0:1786015436.057322:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280494848 00000100:00100000:2.0:1786015436.057390:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 277 00000100:00100000:2.0:1786015436.057401:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280494848:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786015436.057462:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c501aa0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.057487:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002287730d/0xb1a5ef690c501a4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d1 expref: 11 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.057497:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x17:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786015436.057502:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786015436.057507:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c501aa0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.057556:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002287730d/0xb1a5ef690c501a4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d1 expref: 11 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.057572:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002287730d/0xb1a5ef690c501a4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d1 expref: 11 pid: 11384 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015436.057615:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304411520:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015436.057719:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb4600 going to sleep for 11 seconds 00000100:00100000:1.0:1786015436.058321:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280494976 00000100:00100000:1.0:1786015436.058330:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280494976 00000100:00100000:1.0:1786015436.058397:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:1.0:1786015436.058406:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b024e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2354:x1872772280494976:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015436.058419:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015436.058452:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501a92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87f4 expref: 47 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.058487:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:1.0:1786015436.058493:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015436.058537:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b024e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+46:2354:x1872772280494976:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 132us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015436.058545:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 47 00000001:00080000:1.0:1786015436.058861:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967975 is committed 00000001:00080000:1.0:1786015436.058883:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967973 is committed 00000100:00100000:3.0:1786015436.070889:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015436.070933:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280495104 00000100:00100000:3.0:1786015436.070945:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280495104 00002000:00100000:3.0:1786015436.071013:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x17:0x0] (0->1515) req@ffff8b7381941180 x1872772280495104/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:282/0 lens 2008/0 e 0 to 0 dl 1786015447 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015436.071026:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381941180 with x1872772280495104 ext(0->1515) 00010000:00010000:3.0:1786015436.071039:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002287730d/0xb1a5ef690c501a4c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d1 expref: 12 pid: 11384 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.071072:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002287730d/0xb1a5ef690c501a4c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d1 expref: 12 pid: 11384 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015436.071081:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b7381941180 00000100:00100000:3.0:1786015436.071111:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:3.0:1786015436.071121:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280495104:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:2.0:1786015436.074808:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304411520:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015436.074859:0:11384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c501aa0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015436.075982:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2353:x1872772280495104:12345-192.168.202.56@tcp:4:cp.0 Request processed in 4849us (5095us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1786015436.076002:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 00002000:00100000:3.0:1786015436.076021:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x17:0x0] (0->1515) req@ffff8b7381941180 x1872772280495104/t4294967357(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:282/0 lens 2008/448 e 0 to 0 dl 1786015447 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015436.076062:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381941180 with x1872772280495104 ext(0->1515) 00010000:00010000:3.0:1786015436.076078:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002287730d/0xb1a5ef690c501a4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d1 expref: 14 pid: 11384 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.076100:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002287730d/0xb1a5ef690c501a4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d1 expref: 14 pid: 11384 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015436.076110:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b7381941180 00000100:00100000:3.0:1786015436.086925:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015436.087187:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280495232 00000100:00100000:0.0:1786015436.087202:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280495232 00010000:00010000:0.0:1786015436.087262:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002287730d/0xb1a5ef690c501a4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d1 expref: 14 pid: 11384 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015436.087318:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 316 00000100:00100000:0.0:1786015436.087349:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2352:x1872772280495232:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015436.087373:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015436.087407:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002287730d/0xb1a5ef690c501a4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d1 expref: 14 pid: 11384 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.087425:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002287730d/0xb1a5ef690c501a4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d1 expref: 14 pid: 11384 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.087457:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002287730d/0xb1a5ef690c501a4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d1 expref: 14 pid: 11384 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.087478:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015436.087483:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015436.087492:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c501aa0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.087504:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c501aa0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.087548:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015436.087620:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2352:x1872772280495232:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 273us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015436.087628:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 316 00010000:00010000:3.0:1786015436.088178:0:11384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c501aa0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.088190:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c501aa0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.088226:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c501aa0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.088236:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c501aa0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.088242:0:11384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c501aa0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.088250:0:11384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906000 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015436.088265:0:11384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c501aa0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.088276:0:11384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c501aa0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.088291:0:11384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c501aa0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.088298:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c501aa0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015436.088387:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280494848:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 30985us (31182us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015436.088397:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 277 00000100:00100000:0.0:1786015436.100356:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015436.100452:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280495488 00000100:00100000:1.0:1786015436.100466:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280495488 00000100:00100000:1.0:1786015436.100542:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1052 00000100:00100000:1.0:1786015436.100564:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:28060:x1872772280495488:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786015436.100727:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:28060:x1872772280495488:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 166us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015436.100735:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1052 00000100:00100000:0.0:1786015436.107035:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015436.107226:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280495616 00000100:00100000:1.0:1786015436.107250:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280495616 00000100:00100000:1.0:1786015436.107319:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 278 00000100:00100000:1.0:1786015436.107331:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2351:x1872772280495616:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015436.107357:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015436.107387:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ca44aba/0xb1a5ef690c501aa7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e87fb expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015436.107424:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 1516, mtime: 0x6a746ecb, atime: 0x0, ctime: 0x6a746ecb, blocks: 0x1 00010000:00010000:1.0:1786015436.107452:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=671s v=(0 0) 00010000:00010000:1.0:1786015436.107469:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015436.107480:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ca44aba/0xb1a5ef690c501aa7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87fb expref: 13 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.107504:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000ca44aba/0xb1a5ef690c501aa7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87fb expref: 13 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.107521:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47000, rc 0) 00000100:00100000:1.0:1786015436.107607:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2351:x1872772280495616:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 272us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015436.107616:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 278 00000100:00100000:1.0:1786015436.118572:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015436.118732:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280495872 00000100:00100000:0.0:1786015436.118801:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280495872 00000100:00100000:0.0:1786015436.118877:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1053 00000100:00100000:0.0:1786015436.118889:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+44:28060:x1872772280495872:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015436.119027:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+44:28060:x1872772280495872:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 140us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015436.119036:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1053 00000100:00100000:0.0:1786015436.123706:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015436.125407:0:17969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280496000 00000100:00100000:3.0:1786015436.125429:0:17969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280496000 00002000:00100000:3.0:1786015436.125520:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x17:0x0] (0->4095) req@ffff8b74bf89d500 x1872772280496000/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:282/0 lens 488/0 e 0 to 0 dl 1786015447 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015436.125533:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74bf89d500 with x1872772280496000 ext(0->4095) 00002000:00010000:3.0:1786015436.125541:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74bf89d500 00000100:00100000:3.0:1786015436.125579:0:17969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 96 00000100:00100000:3.0:1786015436.125591:0:17969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280496000:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1786015436.125948:0:17969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280496000:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 358us (2257us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786015436.125966:0:17969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 96 00002000:00100000:3.0:1786015436.125973:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x17:0x0] (0->4095) req@ffff8b74bf89d500 x1872772280496000/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:282/0 lens 488/4536 e 0 to 0 dl 1786015447 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015436.125981:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74bf89d500 with x1872772280496000 ext(0->4095) 00002000:00010000:3.0:1786015436.125985:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74bf89d500 00000100:00100000:2.0:1786015436.134249:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015436.137100:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280496128 00000100:00100000:0.0:1786015436.137121:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280496128 00000100:00100000:0.0:1786015436.137226:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1054 00000100:00100000:0.0:1786015436.137240:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+44:28060:x1872772280496128:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015436.137271:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015436.137302:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c501aae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8802 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.137353:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501ab5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.137370:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.137385:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.137538:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c501aae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8802 expref: 46 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.137564:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8802 expref: 45 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.137585:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:0.0:1786015436.137588:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015436.137592:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afca00, rc 0) 00000100:00100000:0.0:1786015436.137709:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28060:x1872772280496128:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 472us (3476us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015436.137717:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1054 00000100:00100000:0.0:1786015436.160210:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015436.160749:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280496256 00000100:00100000:3.0:1786015436.160807:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280496256 00000100:00100000:0.0:1786015436.160896:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1055 00000100:00100000:0.0:1786015436.160911:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28060:x1872772280496256:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015436.160960:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x1d:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015436.164400:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28060:x1872772280496256:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 3474us (4186us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015436.164419:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1055 00000100:00100000:3.0:1786015436.182866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015436.185733:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280496384 00000100:00100000:1.0:1786015436.185757:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280496384 00000100:00100000:1.0:1786015436.185884:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 279 00000100:00100000:1.0:1786015436.185899:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2351:x1872772280496384:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015436.185967:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501abc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.185992:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015436.185998:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015436.186006:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501abc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.186024:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501abc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.186105:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501abc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.186114:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501abc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.186123:0:14547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501abc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.186130:0:14547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47a00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015436.186146:0:14547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501abc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.186156:0:14547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501abc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.186176:0:14547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501abc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.186185:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c501abc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015436.186441:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2351:x1872772280496384:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 545us (3585us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015436.186461:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 279 00000100:00100000:2.0:1786015436.196161:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015436.196324:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280496640 00000100:00100000:1.0:1786015436.196336:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280496640 00000100:00100000:1.0:1786015436.196422:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1056 00000100:00100000:1.0:1786015436.196435:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28060:x1872772280496640:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786015436.196564:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501ac3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.196585:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501ab5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8802 expref: 45 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.196594:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501ac3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.196655:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8802 expref: 45 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.196672:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501ab5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8802 expref: 45 pid: 5795 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015436.196689:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa477b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304411648:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015436.196837:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b749306c780 going to sleep for 11 seconds 00000100:00100000:3.0:1786015436.200329:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015436.200440:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280496768 00000100:00100000:2.0:1786015436.200455:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280496768 00010000:00010000:2.0:1786015436.200519:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501ab5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8802 expref: 46 pid: 5795 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015436.200569:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 317 00000100:00100000:2.0:1786015436.200579:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+46:2353:x1872772280496768:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015436.200598:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015436.200617:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501ab5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8802 expref: 46 pid: 5795 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.200634:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501ab5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8802 expref: 46 pid: 5795 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.200664:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:2.0:1786015436.200671:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501ac3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.200702:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.200711:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501ac3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.200737:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015436.200830:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+46:2353:x1872772280496768:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 251us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015436.200838:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 317 00010000:00010000:1.0:1786015436.201895:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501ab5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8802 expref: 45 pid: 5795 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015436.201921:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa477b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304411648:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015436.201951:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.201990:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.201996:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.202293:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.202302:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501ac3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.202309:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501ac3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.202316:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015436.202321:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501ac3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.202329:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501ac3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.202344:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:1.0:1786015436.202348:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015436.202353:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501ac3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.202359:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501ac3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015436.203851:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28060:x1872772280496640:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 7407us (7695us total) trans 4294967977 rc 0/0 00000100:00100000:1.0:1786015436.203886:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1056 00000040:00080000:2.0:1786015436.204214:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015436.204220:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015436.207145:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1786015436.207172:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015436.211999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015436.212638:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280497024 00000100:00100000:2.0:1786015436.212654:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280497024 00000100:00100000:2.0:1786015436.212753:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 209 00000100:00100000:2.0:1786015436.212793:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28060:x1872772280497024:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015436.213140:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+46:28060:x1872772280497024:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 376us (1156us total) trans 4294967978 rc 0/0 00000100:00100000:2.0:1786015436.213150:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 209 00000040:00080000:1.0:1786015436.576342:0:19680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015436.576358:0:19680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015436.576409:0:19680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 29 count 2 00000040:00080000:1.0:1786015436.576417:0:19680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015436.654353:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015436.688174:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015436.693177:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280497152 00000100:00100000:1.0:1786015436.693203:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280497152 00000100:00100000:1.0:1786015436.693314:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 280 00000100:00100000:1.0:1786015436.693328:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280497152:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015436.693353:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015436.693379:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501aca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8809 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.693417:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015436.693422:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015436.693433:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501aca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8809 expref: 13 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.693455:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501aca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8809 expref: 13 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.693473:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46e00, rc 0) 00000100:00100000:1.0:1786015436.693571:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+13:2352:x1872772280497152:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 246us (5412us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015436.693579:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 280 00000100:00100000:1.0:1786015436.700097:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015436.700268:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280497408 00000100:00100000:3.0:1786015436.700282:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280497408 00000100:00100000:3.0:1786015436.700358:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1057 00000100:00100000:3.0:1786015436.700371:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+91:28061:x1872772280497408:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015436.700398:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015436.700424:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501ad1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8810 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.700541:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501ad8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.700556:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.700567:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015436.700579:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1d:0x0]: returning size 1516 00010000:00010000:3.0:1786015436.700793:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501ad1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8810 expref: 94 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.700818:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8810 expref: 93 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.700828:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:3.0:1786015436.700831:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786015436.700835:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbda00, rc 0) 00000100:00100000:3.0:1786015436.700916:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+93:28061:x1872772280497408:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 547us (836us total) trans 4294967979 rc 0/0 00000100:00100000:3.0:1786015436.700924:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1057 00000100:00100000:3.0:1786015436.703949:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015436.704052:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280497536 00000100:00100000:2.0:1786015436.704066:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280497536 00000100:00100000:2.0:1786015436.704140:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 281 00000100:00100000:2.0:1786015436.704151:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+13:2354:x1872772280497536:12345-192.168.202.56@tcp:1:lfs.0 00010000:00010000:2.0:1786015436.704226:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c501ae6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.704273:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ca44aba/0xb1a5ef690c501aa7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87fb expref: 12 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.704288:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501aca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8809 expref: 13 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.704297:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015436.704302:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015436.704309:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c501ae6 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.704361:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501aca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8809 expref: 13 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.704378:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501aca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8809 expref: 13 pid: 11384 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015436.704399:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304411776:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015436.704524:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ca44aba/0xb1a5ef690c501aa7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87fb expref: 12 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.704533:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ca44aba/0xb1a5ef690c501aa7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87fb expref: 12 pid: 6591 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015436.704557:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304411904:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015436.704584:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb4000 going to sleep for 11 seconds 00000100:00100000:2.0:1786015436.706356:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304411776:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015436.706373:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304411904:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015436.706411:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c501ae6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015436.712200:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015436.712243:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015436.712285:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280497664 00000100:00100000:2.0:1786015436.712299:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280497664 00010000:00010000:2.0:1786015436.712384:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501aca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8809 expref: 14 pid: 11384 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015436.712428:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280497792 00000100:00100000:2.0:1786015436.712431:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280497792 00010000:00010000:2.0:1786015436.712446:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ca44aba/0xb1a5ef690c501aa7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87fb expref: 13 pid: 6591 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015436.712469:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 318 00000100:00100000:2.0:1786015436.712480:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+14:2354:x1872772280497664:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015436.712502:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015436.712535:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501aca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8809 expref: 14 pid: 11384 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.712568:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501aca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8809 expref: 14 pid: 11384 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.712612:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501aca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8809 expref: 14 pid: 11384 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.712635:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015436.712715:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+13:2354:x1872772280497664:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 236us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015436.712723:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 318 00000100:00100000:2.0:1786015436.712746:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 319 00000100:00100000:2.0:1786015436.712753:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280497792:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015436.712787:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015436.712798:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ca44aba/0xb1a5ef690c501aa7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87fb expref: 13 pid: 6591 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.712810:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ca44aba/0xb1a5ef690c501aa7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87fb expref: 13 pid: 6591 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.712825:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ca44aba/0xb1a5ef690c501aa7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87fb expref: 13 pid: 6591 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.712837:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015436.712849:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015436.712857:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c501ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.712869:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c501ae6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.712899:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015436.712920:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280497792:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 167us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015436.712927:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 319 00010000:00010000:2.0:1786015436.712984:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c501ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.712994:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c501ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.713023:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c501ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.713032:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c501ae6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.713051:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c501ae6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.713060:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907600 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015436.713072:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c501ae6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.713081:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c501ae6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.713093:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c501ae6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.713101:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000069af577/0xb1a5ef690c501ae6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015436.713154:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280497536:12345-192.168.202.56@tcp:1:lfs.0 Request processed in 9005us (9220us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015436.713163:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 281 00000100:00100000:1.0:1786015436.722633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015436.722833:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280498048 00000100:00100000:0.0:1786015436.722849:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280498048 00000100:00100000:0.0:1786015436.722936:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 210 00000100:00100000:0.0:1786015436.722949:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+93:28061:x1872772280498048:12345-192.168.202.56@tcp:35:lfs.0 00000004:00010000:0.0:1786015436.723052:0:5797:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8810 expref: 93 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786015436.723399:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967980 00000001:00080000:0.0:1786015436.724246:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967981 00010000:00010000:0.0:1786015436.724336:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501aed lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.724357:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501a37 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87c3 expref: 45 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.724367:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501a68 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d8 expref: 96 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.724374:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501aed lrc: 5/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.724419:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501a68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d8 expref: 96 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.724437:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501a68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d8 expref: 96 pid: 12526 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015436.724455:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304412032:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015436.724589:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501a37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87c3 expref: 45 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.724599:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501a37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87c3 expref: 45 pid: 5794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015436.724609:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304412160:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015436.724635:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482dfdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015436.731419:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304412032:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015436.737552:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304412160:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015436.737613:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501aed lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015436.740582:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015436.740701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015436.741205:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280498304 00000100:00100000:1.0:1786015436.741219:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280498304 00010000:00010000:1.0:1786015436.741274:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501a37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87c3 expref: 46 pid: 5794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015436.741323:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280498176 00000100:00100000:1.0:1786015436.741327:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280498176 00010000:00010000:1.0:1786015436.741343:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501a68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d8 expref: 97 pid: 12526 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015436.741368:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 320 00000100:00100000:1.0:1786015436.741380:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+46:2353:x1872772280498304:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015436.741401:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015436.741410:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501a37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87c3 expref: 46 pid: 5794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.741422:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501a37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87c3 expref: 46 pid: 5794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.741449:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501a37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87c3 expref: 46 pid: 5794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.741469:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:1.0:1786015436.741475:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501aed lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.741484:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501aed lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.741508:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015436.741576:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:2353:x1872772280498304:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 198us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015436.741585:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 320 00000100:00100000:0.0:1786015436.741695:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 321 00000100:00100000:0.0:1786015436.741707:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+97:2354:x1872772280498176:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015436.741716:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015436.741722:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501a68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d8 expref: 97 pid: 12526 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.741733:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501a68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d8 expref: 97 pid: 12526 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.741748:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501a68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87d8 expref: 97 pid: 12526 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.741780:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:0.0:1786015436.741784:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501aed lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.741793:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501aed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.741802:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501aed lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.741854:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015436.741879:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+96:2354:x1872772280498176:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 175us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015436.741886:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 321 00010000:00010000:0.0:1786015436.741916:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501aed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.741925:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501aed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786015436.742104:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967982 00000001:00080000:0.0:1786015436.742369:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967983 00000001:00080000:0.0:1786015436.742431:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967984 00000100:00100000:0.0:1786015436.742529:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304412288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1786015436.742609:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015436.742647:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c13593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015436.742678:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304412288 00000100:00100000:0.0:1786015436.742683:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304412288 00000100:00100000:0.0:1786015436.742733:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1786015436.742741:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1872772304412288:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1786015436.742839:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1872772304412288:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 99us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015436.742846:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1786015436.742864:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015436.742899:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304412288:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1786015436.743290:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967985 00000100:00100000:0.0:1786015436.743345:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304412416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1786015436.743386:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015436.743413:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304412416 00000100:00100000:0.0:1786015436.743417:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304412416 00000100:00100000:0.0:1786015436.743442:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1786015436.743449:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1872772304412416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1786015436.743608:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5797:x1872772304412416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 159us (220us total) trans 4294967358 rc 0/0 00000100:00100000:0.0:1786015436.743614:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1786015436.743637:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482dfdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015436.743659:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304412416:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:0.0:1786015436.743683:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501aed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.743691:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501aed lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.743699:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501aed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.743705:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015436.743710:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501aed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.743717:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501aed lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.743733:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:0.0:1786015436.743736:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1786015436.743742:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501aed lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015436.743755:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501aed lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786015436.743976:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x41:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1786015436.744126:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].14, 64 off9160 00000004:00080000:0.0:1786015436.744139:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 671995377092ns, next at 672995374138ns, rc = 0 00000001:00080000:0.0:1786015436.744148:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967986 00010000:00010000:0.0:1786015436.744188:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b74a04b5500) 00010000:00010000:0.0:1786015436.744191:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786015436.744200:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501ad8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8810 expref: 100 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015436.744307:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+99:28061:x1872772280498048:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 21360us (21690us total) trans 4294967987 rc 0/0 00000100:00100000:0.0:1786015436.744317:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 210 00000020:00080000:0.0:1786015436.744321:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:1.0:1786015436.755333:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015436.755922:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280498560 00000100:00100000:2.0:1786015436.755938:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280498560 00000100:00100000:2.0:1786015436.757312:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1058 00000100:00100000:2.0:1786015436.757344:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+99:28062:x1872772280498560:12345-192.168.202.56@tcp:101:cmp.0 00010000:00010000:2.0:1786015436.757379:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015436.757410:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501af4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8817 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.757516:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501afb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.757534:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501afb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.757559:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501afb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.757580:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.757587:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.757595:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.758306:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501b09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.758318:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.758326:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015436.758340:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1d:0x0]: returning size 1516 00010000:00010000:2.0:1786015436.758568:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501afb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.758576:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501afb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.758584:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501afb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.758643:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015436.758657:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501afb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.758666:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501afb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.758681:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8b7499c59500) 00010000:00010000:2.0:1786015436.758685:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015436.758690:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501afb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.758697:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501afb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.758712:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.758719:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.758725:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.758731:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015436.758734:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.758740:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.758747:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff8b7499c59e00) 00010000:00010000:2.0:1786015436.758750:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015436.758787:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.758795:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.758889:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501af4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8817 expref: 102 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.758907:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501b09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8817 expref: 101 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015436.758915:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:2.0:1786015436.758917:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015436.758919:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906800, rc 0) 00000100:00100000:2.0:1786015436.759021:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+101:28062:x1872772280498560:12345-192.168.202.56@tcp:101:cmp.0 Request processed in 1690us (3703us total) trans 4294967988 rc 0/0 00000100:00100000:1.0:1786015436.763981:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015436.764060:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280498816 00000100:00100000:1.0:1786015436.764073:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280498816 00000100:00100000:1.0:1786015436.764173:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 48 00000100:00100000:1.0:1786015436.764187:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b024f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+102:28062:x1872772280498816:12345-192.168.202.56@tcp:103:cmp.0 00010000:00010000:1.0:1786015436.764210:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015436.764255:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501b09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8817 expref: 102 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015436.764279:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:1.0:1786015436.764295:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015436.764368:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b024f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+101:28062:x1872772280498816:12345-192.168.202.56@tcp:103:cmp.0 Request processed in 184us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015436.764377:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 48 00000100:00100000:2.0:1786015436.767096:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1058 00000100:00100000:3.0:1786015436.772355:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015436.772658:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280498944 00000100:00100000:1.0:1786015436.772673:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280498944 00000100:00100000:3.0:1786015436.772794:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1059 00000100:00100000:3.0:1786015436.772809:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+100:28062:x1872772280498944:12345-192.168.202.56@tcp:58:cmp.0 00010000:00010000:3.0:1786015436.773076:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501b17 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.773099:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501b17 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.773115:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501b17 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786015436.773490:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].29, 136 off12136 00000100:00100000:3.0:1786015436.775341:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+100:28062:x1872772280498944:12345-192.168.202.56@tcp:58:cmp.0 Request processed in 2519us (2985us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015436.775361:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1059 00000100:00100000:1.0:1786015436.794914:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015436.795086:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280499072 00000100:00100000:3.0:1786015436.795098:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280499072 00000100:00100000:3.0:1786015436.795178:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1060 00000100:00100000:3.0:1786015436.795191:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+100:28062:x1872772280499072:12345-192.168.202.56@tcp:101:cmp.0 00010000:00010000:3.0:1786015436.795220:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015436.795249:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501b1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e881e expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.795330:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501b17 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.795343:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501b1e lrc: 4/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e881e expref: 101 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.795367:0:7673:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501b17 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.795384:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501b1e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e881e expref: 101 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.795401:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:3.0:1786015436.795404:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015436.795408:0:7673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501b1e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e881e expref: 101 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015436.795416:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbca00, rc 0) 00000100:00100000:3.0:1786015436.795503:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+101:28062:x1872772280499072:12345-192.168.202.56@tcp:101:cmp.0 Request processed in 314us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015436.795511:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1060 00000040:00080000:1.0:1786015437.231720:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015437.231745:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015437.231832:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 30 count 3 00000040:00080000:1.0:1786015437.231841:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015437.233376:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304412544:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015437.238390:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482b33d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786015437.253181:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304412544:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015437.275645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015437.277894:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280499200 00000100:00100000:2.0:1786015437.277915:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280499200 00000100:00100000:2.0:1786015437.278017:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1061 00000100:00100000:2.0:1786015437.278031:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28064:x1872772280499200:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015437.278096:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x1d:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015437.278383:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28064:x1872772280499200:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 356us (2753us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015437.278393:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1061 00000100:00080000:0.0:1786015437.280469:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015437.290462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015437.290610:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280499328 00000100:00100000:3.0:1786015437.290625:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280499328 00000100:00100000:3.0:1786015437.290710:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1062 00000100:00100000:3.0:1786015437.290722:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28064:x1872772280499328:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1786015437.293091:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501b25 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293126:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501b25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293144:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501b25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293165:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501b2c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293173:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501b2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293206:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501b2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293314:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293323:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293330:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015437.293381:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1d:0x0]: returning size 1516 00000004:00200000:0.0:1786015437.293386:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015437.293402:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293415:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501b25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293422:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501b25 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293430:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501b25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293437:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015437.293442:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501b25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293449:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501b25 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293471:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:0.0:1786015437.293475:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015437.293481:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501b25 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293488:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501b25 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293578:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501b2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293586:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501b2c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293660:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501b2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293667:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015437.293670:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501b2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293677:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501b2c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293687:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3e15321 (ffff8b748f24a100) 00010000:00010000:0.0:1786015437.293690:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015437.293693:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501b2c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293699:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501b2c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293730:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293737:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b33 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.293743:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.294017:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015437.294021:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.294028:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.294048:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:0.0:1786015437.294051:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015437.294055:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.294062:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015437.294203:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28064:x1872772280499328:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 3477us (3750us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015437.294225:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1062 00000100:00100000:0.0:1786015437.308377:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015437.308519:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280499584 00000100:00100000:1.0:1786015437.308534:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280499584 00000100:00100000:1.0:1786015437.308806:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1063 00000100:00100000:1.0:1786015437.308822:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28064:x1872772280499584:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015437.308862:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015437.308892:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501b3a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8825 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.309045:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501b41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.309064:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501b41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.309081:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501b41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015437.309095:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1d:0x0]: returning size 1516 00010000:00010000:1.0:1786015437.309516:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501b41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.309526:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501b41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.309534:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501b41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.309541:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015437.309567:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501b41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.309577:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501b41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.309605:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:1.0:1786015437.309610:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015437.309615:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501b41 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.309622:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501b41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.309687:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501b3a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8825 expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.309700:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:1.0:1786015437.309703:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786015437.309708:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501b3a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8825 expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.309719:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47a00, rc 0) 00000100:00100000:1.0:1786015437.310373:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+46:28064:x1872772280499584:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1548us (2003us total) trans 4294967989 rc 301/301 00000100:00100000:1.0:1786015437.310386:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1063 00000100:00100000:1.0:1786015437.314262:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015437.314866:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280499712 00000100:00100000:0.0:1786015437.314883:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280499712 00000100:00100000:0.0:1786015437.315047:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1064 00000100:00100000:0.0:1786015437.315062:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+46:28064:x1872772280499712:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015437.315121:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x1d:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015437.315270:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+46:28064:x1872772280499712:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 211us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015437.315279:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1064 00000100:00100000:3.0:1786015437.322577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015437.334965:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280499968 00000100:00100000:2.0:1786015437.334987:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280499968 00000100:00100000:2.0:1786015437.335108:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1065 00000100:00100000:2.0:1786015437.335120:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+46:28064:x1872772280499968:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015437.335153:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015437.335185:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501b4f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e882c expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.336317:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.336342:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.336359:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015437.336374:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1e:0x0]: returning size 0 00010000:00010000:2.0:1786015437.336449:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501b4f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e882c expref: 49 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.336472:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e882c expref: 48 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.336482:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:2.0:1786015437.336486:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015437.336490:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906000, rc 0) 00000100:00100000:2.0:1786015437.336599:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+48:28064:x1872772280499968:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1480us (14036us total) trans 4294967990 rc 0/0 00000100:00100000:2.0:1786015437.336622:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1065 00000100:00100000:0.0:1786015437.362631:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015437.362839:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280500224 00000100:00100000:1.0:1786015437.362854:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280500224 00000100:00100000:1.0:1786015437.362949:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1066 00000100:00100000:1.0:1786015437.362982:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:28064:x1872772280500224:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786015437.363079:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015437.363117:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e882c expref: 48 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.363560:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:1.0:1786015437.363576:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015437.363612:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501b64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.363631:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87e6 expref: 100 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.363641:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501b64 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.363695:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87e6 expref: 100 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.363715:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87e6 expref: 100 pid: 5796 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015437.363733:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304412672:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015437.364137:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015437.375016:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304412672:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015437.375070:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501b64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015437.399335:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015437.399550:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280500352 00000100:00100000:2.0:1786015437.399564:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280500352 00010000:00010000:2.0:1786015437.399672:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87e6 expref: 101 pid: 5796 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015437.399732:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 322 00000100:00100000:2.0:1786015437.399748:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+101:2353:x1872772280500352:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015437.400310:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015437.400328:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87e6 expref: 101 pid: 5796 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.400348:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87e6 expref: 101 pid: 5796 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.400384:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501a7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e87e6 expref: 101 pid: 5796 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.400411:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8b7499c59500) 00010000:00010000:2.0:1786015437.400418:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501b64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.400431:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501b64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.400441:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501b64 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.400668:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015437.400756:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+100:2353:x1872772280500352:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1011us (1438us total) trans 0 rc 0/0 00000100:00080000:0.0:1786015437.400990:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786015437.401019:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501b64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.401028:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501b64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.401077:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x40:0x0].0x91e896c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.401089:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x91e896c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.401100:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x91e896c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.401751:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501b64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015437.402081:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 322 00010000:00010000:0.0:1786015437.402216:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501b64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.402224:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501b64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.402233:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015437.402238:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501b64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.402248:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501b64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.402266:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8b7499c59500) 00010000:00010000:0.0:1786015437.402270:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015437.402275:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501b64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.402282:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501b64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.402298:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x91e896c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.402304:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x91e896c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.402310:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x91e896c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.402315:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015437.402327:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x91e896c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.402334:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x91e896c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.402344:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x91e896c6 (ffff8b748f24a100) 00010000:00010000:0.0:1786015437.402347:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015437.402350:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x91e896c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.402356:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x91e896c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015437.404244:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:28064:x1872772280500224:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 39518us (39883us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786015437.404261:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1066 00000100:00100000:3.0:1786015437.411829:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015437.411934:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280500480 00000100:00100000:2.0:1786015437.411948:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280500480 00000100:00100000:2.0:1786015437.412029:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1067 00000100:00100000:2.0:1786015437.412051:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+47:28064:x1872772280500480:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015437.412080:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015437.412116:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501b72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8833 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.412179:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.412198:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.412214:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.412368:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501b72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8833 expref: 49 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.412392:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8833 expref: 48 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.412402:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:2.0:1786015437.412417:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015437.412422:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906000, rc 0) 00000100:00100000:2.0:1786015437.412538:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+48:28064:x1872772280500480:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 489us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015437.412556:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1067 00000100:00100000:1.0:1786015437.423348:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015437.423557:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280500736 00000100:00100000:0.0:1786015437.423572:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280500736 00000100:00100000:0.0:1786015437.423660:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1068 00000100:00100000:0.0:1786015437.423675:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+48:28064:x1872772280500736:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786015437.423862:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.423887:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.423902:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015437.424201:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000044df4c60 reply state 00000000c745cdb1 transno 4294967991 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015437.424230:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015437.424362:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+50:28064:x1872772280500736:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 690us (1029us total) trans 4294967991 rc 0/0 00000100:00100000:0.0:1786015437.424371:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1068 00000100:00100000:3.0:1786015437.436420:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015437.438050:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280500864 00000100:00100000:1.0:1786015437.438072:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280500864 00010000:00010000:0.0:1786015437.438251:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.438269:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b80 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.438278:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b80 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.438285:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015437.438291:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b80 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.438301:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b80 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.438326:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:0.0:1786015437.438330:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786015437.438337:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b80 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.438345:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501b80 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015437.438960:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1069 00000100:00100000:2.0:1786015437.438976:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:28064:x1872772280500864:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015437.439014:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015437.439051:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501b87 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e883a expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.439149:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501b87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e883a expref: 50 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.439169:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501b87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e883a expref: 50 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.439179:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:2.0:1786015437.439181:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015437.439184:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907600, rc 0) 00000100:00100000:2.0:1786015437.439290:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:28064:x1872772280500864:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 318us (2884us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015437.439298:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1069 00000100:00100000:3.0:1786015437.458149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015437.458365:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280500992 00000100:00100000:1.0:1786015437.458379:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280500992 00000100:00100000:1.0:1786015437.458509:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 211 00000100:00100000:1.0:1786015437.458520:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916b7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:28064:x1872772280500992:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1786015437.459204:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916b7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:28064:x1872772280500992:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 Request processed in 682us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015437.459281:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 211 00000100:00100000:0.0:1786015437.474597:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015437.475597:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280501248 00000100:00100000:2.0:1786015437.475615:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280501248 00000100:00100000:2.0:1786015437.475732:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 212 00000100:00100000:2.0:1786015437.475754:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+50:28064:x1872772280501248:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015437.476222:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:28064:x1872772280501248:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 471us (1644us total) trans 4294967992 rc 0/0 00000100:00100000:2.0:1786015437.476232:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 212 00000100:00100000:3.0:1786015437.491709:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015437.492254:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280501504 00000100:00100000:1.0:1786015437.492274:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280501504 00000100:00100000:1.0:1786015437.492376:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1070 00000100:00100000:1.0:1786015437.492391:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+51:28064:x1872772280501504:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786015437.492624:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+51:28064:x1872772280501504:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 236us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015437.492635:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1070 00000100:00100000:3.0:1786015437.499457:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015437.499602:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280501760 00000100:00100000:0.0:1786015437.499638:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280501760 00000100:00100000:0.0:1786015437.499732:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1071 00000100:00100000:0.0:1786015437.499744:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:28064:x1872772280501760:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015437.499815:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015437.499961:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501b8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8841 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.500132:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501b95 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.500151:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501b87 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e883a expref: 52 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.500161:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501b95 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.500211:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501b87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e883a expref: 52 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.500228:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501b87 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e883a expref: 52 pid: 5795 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015437.500246:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304412800:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015437.500374:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b73826a4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786015437.507554:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015437.513331:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280501888 00000100:00100000:2.0:1786015437.513355:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280501888 00010000:00010000:2.0:1786015437.513439:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501b87 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e883a expref: 53 pid: 5795 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015437.513502:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 323 00000100:00100000:2.0:1786015437.513514:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2354:x1872772280501888:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015437.513538:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015437.513547:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501b87 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e883a expref: 53 pid: 5795 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.513564:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501b87 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e883a expref: 53 pid: 5795 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.513597:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:2.0:1786015437.513604:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501b95 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.513617:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501b95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.513627:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501b95 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.513654:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015437.513798:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2354:x1872772280501888:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 284us (6262us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015437.513807:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 323 00010000:00010000:1.0:1786015437.514668:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501b87 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e883a expref: 52 pid: 5795 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015437.514694:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304412800:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015437.514727:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501b95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.514738:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501b95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.514745:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501b95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015437.514810:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1e:0x0]: returning size 0 00000004:00080000:1.0:1786015437.517788:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15:0x0], index 0: 0 00010000:00010000:1.0:1786015437.518105:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501b95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.518119:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501b95 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.518128:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501b95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.518136:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015437.518141:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501b95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.518149:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501b95 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.518170:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:1.0:1786015437.518173:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015437.518179:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501b95 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.518186:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501b95 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.518274:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501b8e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8841 expref: 52 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.518286:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8b7499c59500) 00010000:00010000:1.0:1786015437.518288:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786015437.518292:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501b8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8841 expref: 52 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.518316:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afce00, rc 0) 00000100:00100000:1.0:1786015437.518415:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:28064:x1872772280501760:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 18672us (18975us total) trans 4294967993 rc 301/301 00000100:00100000:1.0:1786015437.518426:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1071 00000100:00100000:0.0:1786015437.529455:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015437.530247:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280502144 00000100:00100000:3.0:1786015437.530265:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280502144 00000100:00100000:3.0:1786015437.530370:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 213 00000100:00100000:3.0:1786015437.530382:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:28064:x1872772280502144:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786015437.531348:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+52:28064:x1872772280502144:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 960us (1903us total) trans 4294967994 rc 0/0 00000100:00100000:3.0:1786015437.531361:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 213 00000100:00100000:3.0:1786015437.544514:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015437.544825:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280502272 00000100:00100000:2.0:1786015437.544848:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280502272 00000100:00100000:2.0:1786015437.544929:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1072 00000100:00100000:2.0:1786015437.544939:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+52:28064:x1872772280502272:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015437.544974:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015437.545002:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501ba3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8848 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.545115:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501baa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.545134:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501baa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.545149:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501baa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015437.545196:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1e:0x0]: returning size 0 00000004:00200000:2.0:1786015437.545202:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015437.545239:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501baa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.545276:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501ba3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8848 expref: 54 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.545300:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501baa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8848 expref: 53 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.545336:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:2.0:1786015437.545339:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786015437.545344:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906e00, rc 0) 00000100:00100000:2.0:1786015437.545422:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+53:28064:x1872772280502272:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 484us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015437.545431:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1072 00000100:00100000:2.0:1786015437.552562:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015437.555055:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280502400 00000100:00100000:0.0:1786015437.555080:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280502400 00000100:00100000:0.0:1786015437.555201:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 282 00000100:00100000:0.0:1786015437.555240:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280502400:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015437.555266:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015437.555294:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501bb1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e884f expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015437.555329:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786015437.555359:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=672s v=(0 0) 00010000:00010000:0.0:1786015437.555365:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015437.555378:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501bb1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e884f expref: 9 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.555402:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501bb1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e884f expref: 9 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.555420:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc600, rc 0) 00000100:00100000:0.0:1786015437.555527:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280502400:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 295us (2980us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015437.555536:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 282 00000100:00080000:3.0:1786015437.556255:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015437.559264:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015437.559399:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280502656 00000100:00100000:3.0:1786015437.559414:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280502656 00000100:00100000:3.0:1786015437.559494:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1073 00000100:00100000:3.0:1786015437.559505:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:28064:x1872772280502656:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786015437.559679:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:28064:x1872772280502656:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 175us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015437.559708:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1073 00000100:00100000:2.0:1786015437.569681:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015437.570172:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280502784 00000100:00100000:1.0:1786015437.570191:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280502784 00000100:00100000:1.0:1786015437.570286:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 283 00000100:00100000:1.0:1786015437.570299:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:28064:x1872772280502784:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015437.570330:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015437.570365:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b02bd2/0xb1a5ef690c501bb8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8856 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.570410:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501bb1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e884f expref: 10 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.570421:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015437.570426:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015437.570432:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b02bd2/0xb1a5ef690c501bb8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8856 expref: 10 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.570478:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501bb1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e884f expref: 10 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.570496:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501bb1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e884f expref: 10 pid: 6592 timeout: 772 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015437.570538:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304412928:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015437.570806:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486543180 going to sleep for 11 seconds 00000100:00100000:1.0:1786015437.580315:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304412928:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015437.580373:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b02bd2/0xb1a5ef690c501bb8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8856 expref: 10 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.580401:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47600, rc 0) 00000100:00100000:1.0:1786015437.580486:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:28064:x1872772280502784:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 10189us (10821us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015437.580496:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 283 00000100:00100000:0.0:1786015437.582147:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015437.582908:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280502912 00000100:00100000:1.0:1786015437.582927:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280502912 00010000:00010000:1.0:1786015437.582988:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501bb1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e884f expref: 10 pid: 6592 timeout: 772 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015437.583052:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 324 00000100:00100000:1.0:1786015437.583063:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280502912:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015437.583083:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015437.583113:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501bb1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e884f expref: 10 pid: 6592 timeout: 772 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.583128:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501bb1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e884f expref: 10 pid: 6592 timeout: 772 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.583181:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501bb1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e884f expref: 10 pid: 6592 timeout: 772 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.583203:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015437.583208:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015437.583934:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b02bd2/0xb1a5ef690c501bb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8856 expref: 9 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.583951:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b02bd2/0xb1a5ef690c501bb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8856 expref: 9 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.584017:0:6607:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000043b02bd2/0xb1a5ef690c501bb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8856 expref: 9 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015437.584048:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304413056:192.168.202.56@tcp:105: 00000100:00100000:1.0:1786015437.584703:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486543180 going to sleep for 11 seconds 00000100:00100000:2.0:1786015437.599985:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015437.600692:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304413056:192.168.202.56@tcp:105: 00010000:00010000:1.0:1786015437.600732:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015437.600855:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280502912:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 17792us (18719us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015437.600869:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 324 00000100:00100000:3.0:1786015437.602613:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280503040 00000100:00100000:3.0:1786015437.602635:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280503040 00002000:00100000:3.0:1786015437.602719:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x15:0x0] (0->1515) req@ffff8b748825a300 x1872772280503040/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:283/0 lens 2008/0 e 0 to 0 dl 1786015448 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015437.602733:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b748825a300 with x1872772280503040 ext(0->1515) 00002000:00010000:3.0:1786015437.602740:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b748825a300 00000100:00100000:2.0:1786015437.602914:0:17970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 97 00000100:00100000:2.0:1786015437.602929:0:17970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280503040:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1786015437.603717:0:17970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280503040:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 786us (3742us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1786015437.603728:0:17970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 97 00002000:00100000:2.0:1786015437.603737:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x15:0x0] (0->1515) req@ffff8b748825a300 x1872772280503040/t4294967351(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:283/0 lens 2008/448 e 0 to 0 dl 1786015448 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015437.603747:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b748825a300 with x1872772280503040 ext(0->1515) 00002000:00010000:2.0:1786015437.603753:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b748825a300 00000100:00100000:0.0:1786015437.614302:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015437.615673:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280503168 00000100:00100000:1.0:1786015437.615694:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280503168 00000100:00100000:1.0:1786015437.616230:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1074 00000100:00100000:3.0:1786015437.616499:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:28064:x1872772280503168:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1786015437.676578:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786015437.730458:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967991 is committed 00000001:00080000:0.0:1786015437.730482:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967987 is committed 00000004:00080000:0.0:1786015437.730487:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 18 committed 00000020:00080000:0.0:1786015437.730519:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b74bf54ecc0 refcount 2 committed 0 result 0 batchid 19 00000020:00080000:0.0:1786015437.730526:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74850a4900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b74bf54e6c0 00000020:00080000:0.0:1786015437.730550:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74850a4600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74bf610c00 00000001:00080000:0.0:1786015437.730591:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967993 is committed 00000001:00080000:0.0:1786015437.730668:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967988 is committed 00000001:00080000:0.0:1786015437.730680:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967994 is committed 00000020:00080000:0.0:1786015437.730702:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 19 committed batchid 18 00000020:00080000:0.0:1786015437.731002:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 18 00000100:00100000:3.0:1786015437.731377:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:28064:x1872772280503168:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 115105us (117083us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015437.731392:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1074 00000100:00100000:0.0:1786015437.732568:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786015437.732596:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304413184:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786015437.732691:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015437.732994:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304413184 00000100:00100000:1.0:1786015437.733006:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304413184 00000100:00100000:1.0:1786015437.733086:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1786015437.733098:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304413184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786015437.733216:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:23 count 1 00002000:00010000:1.0:1786015437.733267:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 1516, mtime: 0x6a746ecb, atime: 0x0, ctime: 0x6a746ecb, blocks: 0x1 00010000:00010000:1.0:1786015437.733278:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b223b20f/0xb1a5ef690c501bbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.733301:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=672s v=(0 0) 00010000:00010000:1.0:1786015437.733306:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015437.733315:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b223b20f/0xb1a5ef690c501bbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.733332:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b223b20f/0xb1a5ef690c501bbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.733344:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b223b20f/0xb1a5ef690c501bbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.733353:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b223b20f/0xb1a5ef690c501bbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.734464:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786015437.735498:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304413184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2394us (2799us total) trans 4294967359 rc 0/0 00000100:00100000:1.0:1786015437.735523:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000004:00080000:1.0:1786015437.735615:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b74bf89e300/2, rc 0, transno 4294967359 00000100:00100000:1.0:1786015437.735624:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304413184:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786015437.736315:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:3.0:1786015437.736470:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786015437.736483:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b223b20f/0xb1a5ef690c501bbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015437.736499:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46800 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015437.736504:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b223b20f/0xb1a5ef690c501bbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015437.736517:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b223b20f/0xb1a5ef690c501bbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015437.736544:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b223b20f/0xb1a5ef690c501bbf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015437.736568:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b223b20f/0xb1a5ef690c501bbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015437.736600:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015437.736602:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015437.736604:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015437.736720:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280503296 00000100:00100000:1.0:1786015437.736732:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280503296 00000100:00100000:1.0:1786015437.737039:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 285 00000100:00100000:1.0:1786015437.737052:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280503296:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1786015437.812738:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967351 is committed 00000100:00100000:1.0:1786015437.813337:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280503296:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 76274us (77014us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015437.813355:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 285 00000100:00100000:2.0:1786015437.828850:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015437.832389:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280503552 00000100:00100000:1.0:1786015437.832418:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280503552 00000100:00100000:1.0:1786015437.832585:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1075 00000100:00100000:1.0:1786015437.832599:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+44:28064:x1872772280503552:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786015437.832692:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015437.832735:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501baa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8848 expref: 44 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.832833:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:1.0:1786015437.832849:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015437.832903:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501bc6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.832924:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.832961:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786015437.833277:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b05abb7c reply state 00000000fc3a45fc transno 4294967995 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015437.833290:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786015437.833439:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28064:x1872772280503552:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 841us (4614us total) trans 4294967995 rc 0/0 00000100:00100000:1.0:1786015437.833449:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1075 00000100:00100000:0.0:1786015437.843112:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:2.0:1786015437.843361:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.843381:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501bc6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.843412:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501bc6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.843419:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015437.843425:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501bc6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.843435:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501bc6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.843458:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:2.0:1786015437.843462:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015437.843469:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501bc6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.843476:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501bc6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015437.845382:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280503680 00000100:00100000:1.0:1786015437.845408:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280503680 00000100:00100000:1.0:1786015437.845597:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1076 00000100:00100000:1.0:1786015437.845611:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+44:28064:x1872772280503680:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015437.845646:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015437.845680:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501bcd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e885d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.845788:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501bcd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e885d expref: 45 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.845809:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501bcd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e885d expref: 45 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.845961:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:1.0:1786015437.845967:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015437.845972:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46800, rc 0) 00000100:00100000:1.0:1786015437.846164:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28064:x1872772280503680:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 552us (3066us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015437.846174:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1076 00000100:00100000:0.0:1786015437.857461:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015437.859359:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280503808 00000100:00100000:1.0:1786015437.859381:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280503808 00000100:00100000:0.0:1786015437.859538:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 286 00000100:00100000:0.0:1786015437.859550:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280503808:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1786015437.859978:0:6591:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb size from disk: 0 -> 1516 00002000:00010000:0.0:1786015437.859983:0:6591:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb mtime from disk: 0 -> 1786015435 00002000:00010000:0.0:1786015437.859985:0:6591:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb atime from disk: 0 -> 1786015435 00002000:00010000:0.0:1786015437.859988:0:6591:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb ctime from disk: 0 -> 1786015435 00002000:00010000:0.0:1786015437.859990:0:6591:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1786015437.860100:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280503808:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 551us (2654us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1786015437.860109:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 286 00000100:00100000:3.0:1786015437.863525:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015437.864138:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280504064 00000100:00100000:1.0:1786015437.864153:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280504064 00000100:00100000:1.0:1786015437.864332:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1077 00000100:00100000:1.0:1786015437.864346:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28064:x1872772280504064:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1786015437.864453:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501bd4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.864476:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b79 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8833 expref: 45 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.864487:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501bd4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.864537:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8833 expref: 45 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.864555:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8833 expref: 45 pid: 12526 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015437.864574:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304413312:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015437.864710:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748827cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1786015437.874170:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015437.874419:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280504192 00000100:00100000:2.0:1786015437.874432:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280504192 00010000:00010000:2.0:1786015437.874491:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b79 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8833 expref: 46 pid: 12526 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015437.874545:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 325 00000100:00100000:2.0:1786015437.874557:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+46:2354:x1872772280504192:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015437.874580:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015437.874590:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b79 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8833 expref: 46 pid: 12526 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.874634:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8833 expref: 46 pid: 12526 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.874668:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:2.0:1786015437.874675:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501bd4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.874688:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501bd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.874697:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501bd4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015437.874725:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015437.874861:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+46:2354:x1872772280504192:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 303us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015437.874870:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 325 00010000:00010000:1.0:1786015437.879251:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501b79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8833 expref: 45 pid: 12526 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015437.879324:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304413312:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015437.879367:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501bd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.879382:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501bd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.879390:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501bd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.879439:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501bd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.879448:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501bd4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.879457:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501bd4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.879464:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015437.879470:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501bd4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.879479:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501bd4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.879501:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:1.0:1786015437.879504:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1786015437.879510:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501bd4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.879525:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501bd4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015437.879674:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:28064:x1872772280504064:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 15329us (16162us total) trans 0 rc -22/-22 00000100:00100000:1.0:1786015437.879688:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1077 00000100:00100000:3.0:1786015437.883849:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015437.884258:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280504320 00000100:00100000:1.0:1786015437.884274:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280504320 00000100:00100000:1.0:1786015437.884359:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 287 00000100:00100000:1.0:1786015437.884371:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280504320:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015437.884441:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005649ae8d/0xb1a5ef690c501bdb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.884469:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b02bd2/0xb1a5ef690c501bb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8856 expref: 10 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.884480:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x15:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786015437.884486:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015437.884492:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005649ae8d/0xb1a5ef690c501bdb lrc: 4/1,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.884545:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000043b02bd2/0xb1a5ef690c501bb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8856 expref: 10 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.884565:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000043b02bd2/0xb1a5ef690c501bb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8856 expref: 10 pid: 6591 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015437.884614:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304413440:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015437.885938:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748827cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1786015437.886737:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015437.886888:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015437.886933:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015437.886968:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015437.886999:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280504448 00000100:00100000:2.0:1786015437.887012:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280504448 00000100:00100000:2.0:1786015437.887088:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 577 00000100:00100000:2.0:1786015437.887100:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280504448:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015437.887197:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280504448:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 99us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015437.887235:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 577 00000100:00100000:1.0:1786015437.888336:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280504576 00000100:00100000:1.0:1786015437.888351:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280504576 00000100:00100000:1.0:1786015437.888491:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280504832 00000100:00100000:1.0:1786015437.888496:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280504832 00000100:00100000:1.0:1786015437.888513:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280504704 00000100:00100000:1.0:1786015437.888516:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280504704 00000100:00100000:1.0:1786015437.888538:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 417 00000100:00100000:1.0:1786015437.888547:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+14:2352:x1872772280504576:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015437.888629:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+14:2352:x1872772280504576:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 83us (1900us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015437.888638:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 417 00000100:00100000:1.0:1786015437.888657:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 418 00000100:00100000:1.0:1786015437.888664:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2352:x1872772280504832:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015437.888697:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2352:x1872772280504832:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015437.888703:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 418 00000100:00100000:1.0:1786015437.888716:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 419 00000100:00100000:1.0:1786015437.888723:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280504704:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015437.888747:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280504704:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015437.888754:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 419 00000100:00080000:0.0:1786015437.889019:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015437.889025:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015437.893648:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015437.894491:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280504960 00000100:00100000:0.0:1786015437.894525:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280504960 00010000:00010000:0.0:1786015437.894589:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000043b02bd2/0xb1a5ef690c501bb8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8856 expref: 11 pid: 6591 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015437.894658:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 326 00000100:00100000:0.0:1786015437.894670:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280504960:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015437.894702:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015437.894735:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000043b02bd2/0xb1a5ef690c501bb8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8856 expref: 11 pid: 6591 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.894752:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000043b02bd2/0xb1a5ef690c501bb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8856 expref: 11 pid: 6591 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.894833:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015437.895164:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015437.895174:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005649ae8d/0xb1a5ef690c501bdb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.895186:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005649ae8d/0xb1a5ef690c501bdb lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.895221:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015437.895360:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280504960:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 690us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015437.895371:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 326 00010000:00010000:1.0:1786015437.897464:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b02bd2/0xb1a5ef690c501bb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8856 expref: 10 pid: 6591 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015437.897499:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304413440:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015437.897532:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005649ae8d/0xb1a5ef690c501bdb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.897544:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005649ae8d/0xb1a5ef690c501bdb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.897551:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005649ae8d/0xb1a5ef690c501bdb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.897599:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005649ae8d/0xb1a5ef690c501bdb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.897607:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005649ae8d/0xb1a5ef690c501bdb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.897616:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005649ae8d/0xb1a5ef690c501bdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.897624:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46600 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015437.897628:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005649ae8d/0xb1a5ef690c501bdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.897669:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005649ae8d/0xb1a5ef690c501bdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.897693:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005649ae8d/0xb1a5ef690c501bdb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.897701:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005649ae8d/0xb1a5ef690c501bdb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015437.897875:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280504320:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 13504us (14051us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015437.897886:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 287 00000100:00100000:2.0:1786015437.905840:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015437.905999:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280505216 00000100:00100000:1.0:1786015437.906012:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280505216 00000100:00100000:1.0:1786015437.906096:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1078 00000100:00100000:1.0:1786015437.906109:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+44:28064:x1872772280505216:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786015437.906241:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501be2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.906265:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501be2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.906279:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501be2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.906545:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501be9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.906568:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501bcd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e885d expref: 45 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.906577:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501be9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.906623:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501bcd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e885d expref: 45 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.906641:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501bcd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e885d expref: 45 pid: 5795 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015437.906658:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304413568:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015437.906799:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748827cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1786015437.911662:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015437.911815:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280505344 00000100:00100000:0.0:1786015437.911828:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280505344 00010000:00010000:0.0:1786015437.911896:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501bcd lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e885d expref: 46 pid: 5795 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015437.911939:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 327 00000100:00100000:0.0:1786015437.911950:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+46:2353:x1872772280505344:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015437.911972:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015437.911982:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501bcd lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e885d expref: 46 pid: 5795 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.911998:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501bcd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e885d expref: 46 pid: 5795 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.912041:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:0.0:1786015437.912048:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501be9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.912059:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501be9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.912068:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501be9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.912093:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015437.912177:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+46:2353:x1872772280505344:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 228us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015437.912187:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 327 00010000:00010000:1.0:1786015437.913675:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46800/0xb1a5ef690c501bcd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e885d expref: 45 pid: 5795 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015437.913704:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304413568:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015437.913738:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501be9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.913749:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501be9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.913754:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501be9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786015437.914107:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967996 00000001:00080000:1.0:1786015437.914528:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967997 00000001:00080000:1.0:1786015437.914582:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967998 00000100:00100000:1.0:1786015437.914706:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304413696:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786015437.914843:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015437.914883:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0312b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786015437.915530:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304413696 00000100:00100000:0.0:1786015437.915540:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304413696 00000100:00100000:0.0:1786015437.915645:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1786015437.915668:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5796:x1872772304413696:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1786015437.915807:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5796:x1872772304413696:12345-0@lo:1000:mdt00_002.0 Request processed in 142us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015437.915816:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1786015437.915879:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304413696:0@lo:1000:mdt00_002.0 00000100:00080000:3.0:1786015437.918318:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1786015437.919498:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967999 00000100:00100000:0.0:1786015437.919659:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304413824:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1786015437.919805:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015437.919865:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b73826a4240 going to sleep for 11 seconds 00000100:00100000:2.0:1786015437.920268:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304413824 00000100:00100000:2.0:1786015437.920279:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304413824 00000100:00100000:2.0:1786015437.920356:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1786015437.920367:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5796:x1872772304413824:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786015437.920676:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5796:x1872772304413824:12345-0@lo:1000:mdt00_002.0 Request processed in 311us (871us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1786015437.920686:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1786015437.921423:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304413824:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1786015437.922334:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968000 00010000:00010000:1.0:1786015437.922412:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501be9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.922426:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501be9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.922434:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501be9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.922441:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015437.922447:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501be9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.922454:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501be9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.922474:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:1.0:1786015437.922478:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015437.922483:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501be9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.922490:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501be9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.922536:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501b17 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.922561:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501b17 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.922567:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501b17 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.922572:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015437.922575:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501b17 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.922581:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501b17 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.922604:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:1.0:1786015437.922607:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015437.922616:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501b1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e881e expref: 89 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.922628:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501b1e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e881e expref: 89 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.922639:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501b1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e881e expref: 89 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.922695:0:5796:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbca00/0xb1a5ef690c501b1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e881e expref: 89 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015437.922714:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304413952:192.168.202.56@tcp:105: 00000100:00100000:2.0:1786015437.925043:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748570a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786015437.934506:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015437.934673:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280505472 00000100:00100000:1.0:1786015437.934686:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280505472 00000100:00100000:1.0:1786015437.934812:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 214 00000100:00100000:1.0:1786015437.934825:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+90:28062:x1872772280505472:12345-192.168.202.56@tcp:49:cmp.0 00000100:00100000:1.0:1786015437.935016:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+90:28062:x1872772280505472:12345-192.168.202.56@tcp:49:cmp.0 Request processed in 193us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015437.935024:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 214 00000100:00100000:0.0:1786015437.935565:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304413952:192.168.202.56@tcp:105: 00010000:00010000:0.0:1786015437.935620:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501b17 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.935633:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501b17 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.935682:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501bf0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.935700:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501bf0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.935714:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501bf0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.935726:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501bf0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.935733:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501bf0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.935799:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501bf0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.935807:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015437.935812:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501bf0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.935820:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501bf0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.935835:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:0.0:1786015437.935838:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015437.935842:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501bf0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.935848:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501bf0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.935860:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501be2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.935866:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501be2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.935871:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501be2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.935877:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015437.935880:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501be2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.935899:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501be2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.935908:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8b74a04b5100) 00010000:00010000:0.0:1786015437.935911:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015437.935914:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501be2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015437.935919:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501be2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015437.939863:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+49:28064:x1872772280505216:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 33729us (34010us total) trans 4294968001 rc 0/0 00000100:00100000:0.0:1786015437.939884:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1078 00000020:00080000:0.0:1786015437.939893:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1786015437.940396:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015437.940403:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015437.940938:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1786015437.940962:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015437.943455:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015437.946078:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280505600 00000100:00100000:1.0:1786015437.946098:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280505600 00000100:00100000:1.0:1786015437.946204:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 288 00000100:00100000:1.0:1786015437.946217:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+14:28062:x1872772280505600:12345-192.168.202.56@tcp:101:cmp.0 00010000:00010000:1.0:1786015437.946244:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015437.946276:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b223b20f/0xb1a5ef690c501bf7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8864 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015437.946313:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 1516, mtime: 0x6a746ecb, atime: 0x6a746ecb, ctime: 0x6a746ecb, blocks: 0xb 00010000:00010000:1.0:1786015437.946345:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=673s v=(0 0) 00010000:00010000:1.0:1786015437.946351:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015437.946362:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b223b20f/0xb1a5ef690c501bf7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8864 expref: 15 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.946385:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b223b20f/0xb1a5ef690c501bf7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8864 expref: 15 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.946401:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46800, rc 0) 00000100:00100000:2.0:1786015437.946647:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015437.946710:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280505856 00000100:00100000:3.0:1786015437.946717:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280505856 00000100:00100000:3.0:1786015437.946821:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 215 00000100:00100000:3.0:1786015437.946831:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:28064:x1872772280505856:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015437.947073:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+15:28062:x1872772280505600:12345-192.168.202.56@tcp:101:cmp.0 Request processed in 858us (3632us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015437.947100:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 288 00000004:00080000:3.0:1786015437.951222:0:5798:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x1e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1786015437.951374:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968002 00010000:00010000:3.0:1786015437.951476:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501bfe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015437.951498:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501bfe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015437.951513:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501bfe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015437.951523:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501bfe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015437.951543:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501bfe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015437.951549:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501bfe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015437.951583:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786015437.951747:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+51:28064:x1872772280505856:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 4912us (5095us total) trans 4294968003 rc 0/0 00000100:00100000:3.0:1786015437.951804:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 215 00000020:00080000:3.0:1786015437.951812:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786015437.954425:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786015437.954443:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501bfe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.954456:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015437.954461:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501bfe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.954472:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501bfe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.954496:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:1.0:1786015437.954499:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786015437.954505:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501bfe lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.954511:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501bfe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015437.954539:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015437.954541:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015437.954543:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015437.956451:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015437.956696:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280505984 00000100:00100000:0.0:1786015437.956712:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280505984 00002000:00100000:0.0:1786015437.956820:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x15:0x0] (0->4095) req@ffff8b74c103ea00 x1872772280505984/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:283/0 lens 488/0 e 0 to 0 dl 1786015448 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015437.956833:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c103ea00 with x1872772280505984 ext(0->4095) 00002000:00010000:0.0:1786015437.956840:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74c103ea00 00000100:00100000:0.0:1786015437.956879:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 98 00000100:00100000:0.0:1786015437.956890:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41677fca-39fb-471c-b582-96bce6540a36+15:2354:x1872772280505984:12345-192.168.202.56@tcp:3:cmp.0 00000100:00100000:0.0:1786015437.957223:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41677fca-39fb-471c-b582-96bce6540a36+15:2354:x1872772280505984:12345-192.168.202.56@tcp:3:cmp.0 Request processed in 334us (786us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786015437.957233:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 98 00002000:00100000:0.0:1786015437.957247:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x15:0x0] (0->4095) req@ffff8b74c103ea00 x1872772280505984/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:283/0 lens 488/4536 e 0 to 0 dl 1786015448 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015437.957256:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c103ea00 with x1872772280505984 ext(0->4095) 00002000:00010000:0.0:1786015437.957259:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74c103ea00 00000100:00100000:0.0:1786015437.971965:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015437.972038:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280506240 00000100:00100000:2.0:1786015437.972052:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280506240 00000100:00100000:2.0:1786015437.972141:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 216 00000100:00100000:2.0:1786015437.972154:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+90:28062:x1872772280506240:12345-192.168.202.56@tcp:35:cmp.0 00000100:00100000:2.0:1786015437.972536:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+91:28062:x1872772280506240:12345-192.168.202.56@tcp:35:cmp.0 Request processed in 384us (587us total) trans 4294968004 rc 0/0 00000100:00100000:2.0:1786015437.972546:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 216 00000100:00100000:0.0:1786015437.996413:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786015438.004156:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304414080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015438.004323:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015438.004558:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304414080 00000100:00100000:3.0:1786015438.004573:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304414080 00000100:00100000:3.0:1786015438.004668:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1786015438.004684:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304414080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015438.004730:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 81592320 pending 0 free 3857711104 avail 3854565376 00000100:00100000:3.0:1786015438.004851:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304414080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015438.004860:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1786015438.004991:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304414080:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786015438.700088:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015439.532534:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304414592:0@lo:400:kworker.0 00000100:00100000:3.0:1786015439.532636:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015439.532725:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786015439.532732:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304414208:0@lo:400:kworker.0 00000100:00100000:3.0:1786015439.532795:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015439.532825:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304414720:0@lo:400:kworker.0 00000100:00100000:3.0:1786015439.532878:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015439.532907:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304414464:0@lo:400:kworker.0 00000100:00100000:3.0:1786015439.532931:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015439.532951:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786015439.532956:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304414336:0@lo:400:kworker.0 00000100:00100000:3.0:1786015439.532977:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015439.532991:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304414848:0@lo:400:kworker.0 00000100:00100000:3.0:1786015439.533011:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015439.533059:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304414592 00000100:00100000:3.0:1786015439.533068:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304414592 00000100:00100000:3.0:1786015439.533131:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304414848 00000100:00100000:3.0:1786015439.533134:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304414848 00000100:00100000:3.0:1786015439.533163:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1786015439.533173:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304414592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015439.533316:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304414720 00000100:00100000:1.0:1786015439.533322:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304414720 00000100:00100000:1.0:1786015439.533359:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304414464 00000100:00100000:1.0:1786015439.533362:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304414464 00000100:00100000:1.0:1786015439.533388:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304414336 00000100:00100000:1.0:1786015439.533390:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304414336 00000100:00100000:1.0:1786015439.533406:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:1.0:1786015439.533413:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304414720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015439.533498:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304414720:12345-0@lo:400:kworker.0 Request processed in 84us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015439.533506:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:1.0:1786015439.533527:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1786015439.533534:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304414464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015439.533567:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304414464:12345-0@lo:400:kworker.0 Request processed in 35us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015439.533573:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1786015439.533584:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1786015439.533590:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304414336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015439.533617:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304414336:12345-0@lo:400:kworker.0 Request processed in 27us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015439.533623:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1786015439.533648:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:1.0:1786015439.533655:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1872772304414848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015439.533689:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1872772304414848:12345-0@lo:400:kworker.0 Request processed in 35us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015439.533696:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:1.0:1786015439.533750:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304414336:0@lo:400:kworker.0 00000100:00100000:1.0:1786015439.533787:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304414848:0@lo:400:kworker.0 00000100:00100000:1.0:1786015439.533802:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304414464:0@lo:400:kworker.0 00000100:00100000:1.0:1786015439.533844:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304414720:0@lo:400:kworker.0 00000100:00100000:2.0:1786015439.534036:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304414208 00000100:00100000:2.0:1786015439.534042:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304414208 00000100:00100000:2.0:1786015439.534086:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:2.0:1786015439.534094:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304414208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015439.534138:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304414208:12345-0@lo:400:kworker.0 Request processed in 45us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015439.534144:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00080000:2.0:1786015439.534205:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786015439.534211:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015439.534214:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015439.535411:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304414208:0@lo:400:kworker.0 00000100:00100000:3.0:1786015439.537501:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304414592:12345-0@lo:400:kworker.0 Request processed in 4315us (4851us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015439.537521:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1786015439.537925:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304414592:0@lo:400:kworker.0 00010000:00010000:1.0:1786015439.724021:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015440.060444:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304414976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015440.060542:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015440.060648:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304414976 00000100:00100000:1.0:1786015440.060659:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304414976 00000100:00100000:1.0:1786015440.060709:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1786015440.060718:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1872772304414976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015440.060787:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 78184448 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015440.060835:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1872772304414976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015440.060843:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1786015440.060970:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304414976:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1786015440.136140:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967358 is committed 00000001:00080000:2.0:1786015440.143038:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967359 is committed 00000001:00080000:2.0:1786015440.143065:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967357 is committed 00010000:00010000:3.0:1786015440.747917:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015441.773461:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015442.800997:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015443.017683:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015443.017743:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015443.017827:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015443.017849:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015443.017874:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015443.017897:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015443.017922:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015443.017968:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280506624 00000100:00100000:1.0:1786015443.017987:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280506624 00000100:00100000:1.0:1786015443.018151:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280506752 00000100:00100000:1.0:1786015443.018155:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280506752 00000100:00100000:1.0:1786015443.018171:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280507008 00000100:00100000:1.0:1786015443.018194:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280507008 00000100:00100000:1.0:1786015443.018395:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280507136 00000100:00100000:1.0:1786015443.018399:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280507136 00000100:00100000:1.0:1786015443.018419:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 422 00000100:00100000:1.0:1786015443.018429:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+15:2351:x1872772280506624:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015443.018508:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+15:2351:x1872772280506624:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 80us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015443.018516:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 422 00000100:00100000:1.0:1786015443.018534:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 423 00000100:00100000:1.0:1786015443.018540:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+12:2351:x1872772280506752:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015443.018565:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+12:2351:x1872772280506752:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015443.018570:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 423 00000100:00100000:1.0:1786015443.018581:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 424 00000100:00100000:1.0:1786015443.018586:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280507008:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015443.018613:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280507008:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015443.018619:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 424 00000100:00100000:1.0:1786015443.018630:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 425 00000100:00100000:1.0:1786015443.018635:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280507136:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015443.018654:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280507136:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 19us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015443.018660:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 425 00000100:00100000:1.0:1786015443.018677:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280506496 00000100:00100000:1.0:1786015443.018687:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280506496 00000100:00100000:1.0:1786015443.018714:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280506880 00000100:00100000:1.0:1786015443.018716:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280506880 00000100:00100000:1.0:1786015443.018735:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 440 00000100:00100000:1.0:1786015443.018740:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+91:2351:x1872772280506496:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015443.018819:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+91:2351:x1872772280506496:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 77us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015443.018826:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 440 00000100:00100000:1.0:1786015443.018839:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 441 00000100:00100000:1.0:1786015443.018846:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:2351:x1872772280506880:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015443.018875:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:2351:x1872772280506880:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015443.018881:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 441 00000100:00100000:2.0:1786015443.019166:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280506368 00000100:00100000:2.0:1786015443.019172:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280506368 00000100:00100000:2.0:1786015443.019221:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 579 00000100:00100000:2.0:1786015443.019229:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280506368:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015443.019268:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280506368:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 39us (1596us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015443.019274:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 579 00000100:00080000:2.0:1786015443.019313:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786015443.019318:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015443.019320:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015443.117163:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304415104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015443.117288:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015443.117391:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304415104 00000100:00100000:0.0:1786015443.117402:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304415104 00000100:00100000:0.0:1786015443.117470:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1786015443.117480:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304415104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015443.117520:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 81592320 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015443.117585:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304415104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015443.117594:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1786015443.117658:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304415104:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786015443.117719:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1786015443.202352:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968000 is committed 00000020:00080000:0.0:1786015443.202370:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b73826a43c0 refcount 2 committed 0 result 0 batchid 20 00000020:00080000:0.0:1786015443.202377:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74bfa19300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b73826a49c0 00000020:00080000:0.0:1786015443.202381:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74bfa19100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b7382c92c00 00000020:00080000:0.0:1786015443.202413:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 19 batchid updated 00000001:00080000:0.0:1786015443.202422:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968001 is committed 00000001:00080000:0.0:1786015443.202443:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968004 is committed 00000001:00080000:0.0:1786015443.202452:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968003 is committed 00000020:00080000:0.0:1786015443.202468:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 20 committed batchid 19 00000020:00080000:0.0:1786015443.202683:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 19 00000001:00080000:2.0:1786015443.232859:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967352 is committed 00000001:00080000:2.0:1786015443.232886:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967353 is committed 00010000:00010000:2.0:1786015443.824966:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015444.653035:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304415360:0@lo:400:kworker.0 00000100:00100000:3.0:1786015444.653414:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015444.653461:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304415616:0@lo:400:kworker.0 00000100:00100000:3.0:1786015444.653475:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304415872:0@lo:400:kworker.0 00000100:00100000:1.0:1786015444.653498:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015444.653508:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304415360 00000100:00100000:3.0:1786015444.653515:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304415360 00000100:00100000:1.0:1786015444.653537:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1786015444.653543:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304415232:0@lo:400:kworker.0 00000100:00100000:3.0:1786015444.653562:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1786015444.653570:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304415360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015444.653570:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015444.653589:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304415744:0@lo:400:kworker.0 00000100:00100000:1.0:1786015444.653608:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015444.653633:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304415488:0@lo:400:kworker.0 00000100:00100000:3.0:1786015444.653637:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304415360:12345-0@lo:400:kworker.0 Request processed in 68us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015444.653644:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1786015444.653653:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015444.653660:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304415744 00000100:00100000:3.0:1786015444.653663:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304415744 00000100:00100000:1.0:1786015444.653680:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304415616 00000100:00100000:1.0:1786015444.653683:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304415616 00000100:00100000:3.0:1786015444.653690:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304415488 00000100:00100000:3.0:1786015444.653693:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304415488 00000100:00100000:3.0:1786015444.653707:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1786015444.653710:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1786015444.653712:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304415744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015444.653715:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304415616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015444.653746:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304415744:12345-0@lo:400:kworker.0 Request processed in 33us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015444.653748:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304415616:12345-0@lo:400:kworker.0 Request processed in 33us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015444.653752:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1786015444.653754:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1786015444.653779:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1786015444.653786:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304415488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015444.653795:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304415232 00000100:00100000:1.0:1786015444.653798:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304415232 00000100:00100000:3.0:1786015444.653819:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304415488:12345-0@lo:400:kworker.0 Request processed in 34us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015444.653820:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:3.0:1786015444.653825:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1786015444.653826:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304415232:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786015444.653841:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015444.653854:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304415232:12345-0@lo:400:kworker.0 Request processed in 29us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015444.653859:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:1.0:1786015444.653920:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304415488:0@lo:400:kworker.0 00000100:00100000:1.0:1786015444.653955:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304415232:0@lo:400:kworker.0 00000100:00100000:1.0:1786015444.653978:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304415744:0@lo:400:kworker.0 00000100:00100000:1.0:1786015444.653987:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967353 gen 2 00000004:00080000:1.0:1786015444.653993:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967353 committed transno 4294967353 00000100:00100000:1.0:1786015444.654010:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304415616:0@lo:400:kworker.0 00000100:00100000:1.0:1786015444.654045:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015444.654083:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304415360:0@lo:400:kworker.0 00000100:00100000:3.0:1786015444.654648:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304415872 00000100:00100000:3.0:1786015444.654654:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304415872 00000100:00100000:3.0:1786015444.654699:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1786015444.654707:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304415872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015444.654754:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304415872:12345-0@lo:400:kworker.0 Request processed in 48us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015444.654784:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00080000:0.0:1786015444.655013:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015444.655140:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967359 gen 2 00000004:00080000:1.0:1786015444.655153:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967358 committed transno 4294967359 00000004:00080000:1.0:1786015444.655173:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b74bf89e300, transno 4294967359 00000100:00100000:1.0:1786015444.655195:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304415872:0@lo:400:kworker.0 00010000:00010000:1.0:1786015444.845337:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015445.163978:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304416000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015445.164059:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015445.164341:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304416000 00000100:00100000:2.0:1786015445.164350:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304416000 00000100:00100000:2.0:1786015445.164407:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1786015445.164425:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304416000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015445.164460:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 76480512 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015445.164514:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304416000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015445.164521:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1786015445.164603:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304416000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015445.304253:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015445.304343:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280507264 00000100:00100000:1.0:1786015445.304353:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280507264 00000100:00100000:1.0:1786015445.304428:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1079 00000100:00100000:1.0:1786015445.304440:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28043:x1872772280507264:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1786015445.304548:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28043:x1872772280507264:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 112us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015445.304557:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1079 00000100:00080000:0.0:1786015445.304621:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786015445.868078:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015446.124099:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015446.124108:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015446.124165:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 30 count 3 00000040:00080000:1.0:1786015446.124173:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786015446.893153:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786015447.552720:0:19880:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12n: Import/implicit restore/release == 07:24:05 (1786015445) 00000100:00100000:0.0:1786015447.870230:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015447.870275:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280507392 00000100:00100000:0.0:1786015447.870288:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280507392 00000100:00100000:0.0:1786015447.870356:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1080 00000100:00100000:0.0:1786015447.870367:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28667:x1872772280507392:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1786015447.870460:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28667:x1872772280507392:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 95us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015447.870469:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1080 00000100:00080000:0.0:1786015447.870489:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015447.892161:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015447.893385:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015447.893429:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280507776 00000100:00100000:1.0:1786015447.893439:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280507776 00000100:00100000:0.0:1786015447.895341:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280507520 00000100:00100000:0.0:1786015447.895355:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280507520 00000100:00100000:0.0:1786015447.895425:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1081 00000100:00100000:0.0:1786015447.895436:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+91:28668:x1872772280507776:12345-192.168.202.56@tcp:36:mkdir.0 00010000:00010000:0.0:1786015447.895501:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015447.895530:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50196c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8784 expref: 91 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015447.895559:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7499c59a00) 00010000:00010000:0.0:1786015447.895578:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015447.896001:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501c05 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015447.896016:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5019ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8799 expref: 41 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015447.896026:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501c05 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015447.896057:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5019ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8799 expref: 41 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015447.896071:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5019ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8799 expref: 41 pid: 5795 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015447.896086:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304416128:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015447.896177:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015447.898138:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1082 00000100:00100000:1.0:1786015447.898158:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+90:2352:x1872772280507520:12345-192.168.202.56@tcp:41:mkdir.0 00000004:00000024:1.0:1786015447.898210:0:5794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 14680064 pending 0 free 2259812352 avail 2257715200 00000100:00100000:1.0:1786015447.898276:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+90:2352:x1872772280507520:12345-192.168.202.56@tcp:41:mkdir.0 Request processed in 127us (4897us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015447.898284:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1082 00000100:00080000:1.0:1786015447.898315:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015447.906138:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304416128:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015447.906172:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501c05 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015447.906378:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015447.906413:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280507904 00000100:00100000:1.0:1786015447.906419:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280507904 00010000:00010000:1.0:1786015447.906455:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5019ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8799 expref: 42 pid: 5795 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015447.906489:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 328 00000100:00100000:1.0:1786015447.906541:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b024fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+42:2353:x1872772280507904:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015447.906557:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015447.906565:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5019ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8799 expref: 42 pid: 5795 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.906578:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5019ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8799 expref: 42 pid: 5795 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.906602:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5019ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8799 expref: 42 pid: 5795 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.906619:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7499c59a00) 00010000:00010000:1.0:1786015447.906624:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501c05 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.906634:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501c05 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.906642:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501c05 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.906679:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015447.906732:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b024fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+41:2353:x1872772280507904:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 234us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015447.906739:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 328 00010000:00010000:1.0:1786015447.906823:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501c05 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.906831:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501c05 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.906853:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501c0c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.906864:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501c0c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.906871:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501c0c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015447.915382:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 512 00010000:00010000:1.0:1786015447.915400:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501c05 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.915412:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501c05 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.915421:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501c05 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.915427:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015447.915431:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501c05 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.915450:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501c05 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.915468:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7499c59a00) 00010000:00010000:1.0:1786015447.915472:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015447.915477:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501c05 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.915483:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501c05 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786015447.915504:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a9201441 reply state 0000000086c2acf1 transno 4294968005 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501c0c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015447.915514:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786015447.915640:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+91:28668:x1872772280507776:12345-192.168.202.56@tcp:36:mkdir.0 Request processed in 20203us (23487us total) trans 4294968005 rc 0/0 00000100:00100000:1.0:1786015447.915650:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1081 00010000:00010000:1.0:1786015447.921096:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501c0c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.921115:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501c0c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.921123:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501c0c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.921130:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015447.921135:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501c0c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.921163:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501c0c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.921182:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee467b96 (ffff8b7483ee6c00) 00010000:00010000:1.0:1786015447.921185:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015447.921190:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501c0c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.921196:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501c0c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015447.925698:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015448.138636:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015448.138691:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015448.138716:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280508032 00000100:00100000:0.0:1786015448.138733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015448.138736:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280508032 00000100:00100000:0.0:1786015448.138842:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015448.138865:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 581 00000100:00100000:0.0:1786015448.138876:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015448.138885:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280508032:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015448.138996:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280508544 00000100:00100000:0.0:1786015448.139007:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280508544 00000100:00100000:1.0:1786015448.139021:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280508032:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 142us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015448.139030:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 581 00000100:00100000:1.0:1786015448.139083:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280508288 00000100:00100000:1.0:1786015448.139087:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280508288 00000100:00100000:1.0:1786015448.139143:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280508800 00000100:00100000:1.0:1786015448.139147:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280508800 00000100:00100000:1.0:1786015448.139172:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 428 00000100:00100000:1.0:1786015448.139178:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+15:2353:x1872772280508288:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015448.139213:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+15:2353:x1872772280508288:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 35us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015448.139249:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 428 00000100:00100000:3.0:1786015448.139275:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 445 00000100:00100000:1.0:1786015448.139275:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 429 00000100:00100000:1.0:1786015448.139287:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280508800:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015448.139298:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+41:2353:x1872772280508544:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015448.139318:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280508800:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015448.139327:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 429 00000100:00080000:1.0:1786015448.139348:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015448.139355:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015448.139381:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+41:2353:x1872772280508544:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 90us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015448.139394:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 445 00000100:00100000:1.0:1786015448.139434:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015448.139473:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280508416 00000100:00100000:3.0:1786015448.139480:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280508416 00000100:00100000:1.0:1786015448.139529:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015448.139669:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280508160 00000100:00100000:0.0:1786015448.139677:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280508160 00000100:00100000:0.0:1786015448.139708:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 446 00000100:00100000:0.0:1786015448.139716:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+90:2353:x1872772280508160:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015448.139787:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+90:2353:x1872772280508160:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 72us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015448.139794:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 446 00000100:00080000:0.0:1786015448.139825:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015448.150719:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280508672 00000100:00100000:3.0:1786015448.150736:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280508672 00000100:00100000:1.0:1786015448.150881:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 430 00000100:00100000:1.0:1786015448.150912:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280508416:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015448.151418:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280508416:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 519us (11983us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015448.160851:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 431 00000100:00100000:3.0:1786015448.160881:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280508672:12345-192.168.202.56@tcp:400:kworker.0 00000100:00080000:0.0:1786015448.161386:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015448.162435:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280508672:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 1566us (22904us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015448.162448:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 431 00000100:00100000:1.0:1786015448.162658:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 430 00000040:00080000:2.0:1786015448.172025:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015448.172036:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015448.172093:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 30 count 3 00000040:00080000:2.0:1786015448.172107:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015448.239744:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304416256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015448.239888:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015448.241363:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304416256 00000100:00100000:3.0:1786015448.241381:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304416256 00000100:00100000:3.0:1786015448.241467:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1786015448.241479:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304416256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015448.241525:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 81592320 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015448.241617:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304416256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (1729us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015448.241625:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:3.0:1786015448.242074:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015448.242142:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304416256:0@lo:13:osp-pre-0-0.0 00000020:00080000:0.0:1786015448.369012:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 20 batchid updated 00000020:00080000:0.0:1786015448.369045:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 20 00000020:00080000:0.0:1786015448.369064:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 20 00000001:00080000:0.0:1786015448.369086:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968005 is committed 00000100:00100000:1.0:1786015448.522381:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015448.522633:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280508928 00000100:00100000:2.0:1786015448.522649:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280508928 00000100:00100000:2.0:1786015448.522731:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1083 00000100:00100000:2.0:1786015448.522742:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+89:28705:x1872772280508928:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:2.0:1786015448.522815:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015448.522851:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501c13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e886b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.522949:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501c1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.522968:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501c1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.522982:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501c1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015448.523350:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1786015448.523356:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 28 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015448.523430:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501c1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.523465:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501c13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e886b expref: 91 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.523487:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501c1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e886b expref: 90 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.523496:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d400) 00010000:00010000:2.0:1786015448.523499:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015448.523503:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907600, rc 0) 00000100:00100000:2.0:1786015448.523579:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+90:28705:x1872772280508928:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 839us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015448.523587:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1083 00000100:00100000:2.0:1786015448.543209:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015448.543490:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280509184 00000100:00100000:3.0:1786015448.543501:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280509184 00000100:00100000:3.0:1786015448.543582:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1084 00000100:00100000:3.0:1786015448.543594:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+90:28705:x1872772280509184:12345-192.168.202.56@tcp:36:mkdir.0 00010000:00010000:3.0:1786015448.543681:0:7673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015448.543720:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501c1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e886b expref: 90 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.543746:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d400) 00010000:00010000:3.0:1786015448.545102:0:7673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015448.545611:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+89:28705:x1872772280509184:12345-192.168.202.56@tcp:36:mkdir.0 Request processed in 2013us (2606us total) trans 0 rc -17/-17 00000100:00100000:3.0:1786015448.545623:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1084 00000100:00100000:0.0:1786015448.555008:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015448.555211:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280509312 00000100:00100000:2.0:1786015448.555236:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280509312 00000100:00100000:2.0:1786015448.555304:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1085 00000100:00100000:2.0:1786015448.555314:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+89:28705:x1872772280509312:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:2.0:1786015448.555341:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015448.555371:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501c21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8872 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.555452:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501c28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.555468:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501c28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.555503:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501c28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015448.556299:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1786015448.556309:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 28 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015448.556422:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501c28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.556461:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501c21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8872 expref: 91 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.556482:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501c28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8872 expref: 90 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.556493:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:2.0:1786015448.556496:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015448.556500:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906800, rc 0) 00000100:00100000:2.0:1786015448.556588:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+90:28705:x1872772280509312:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 1274us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015448.556596:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1085 00000100:00100000:1.0:1786015448.569566:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015448.569905:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280509440 00000100:00100000:3.0:1786015448.569936:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280509440 00000100:00100000:3.0:1786015448.570129:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1086 00000100:00100000:3.0:1786015448.570143:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+90:28705:x1872772280509440:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:3.0:1786015448.570173:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015448.570205:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501c2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8879 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.570295:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501c36 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.570312:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501c36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.570325:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501c36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.570376:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.570383:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.570390:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.571634:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501c44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.571654:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.571666:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015448.571836:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 7680 00000004:00200000:3.0:1786015448.571841:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015448.572693:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.572720:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501c36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.572729:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501c36 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.572737:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501c36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.572910:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015448.573254:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501c36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.573265:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501c36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.573286:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:3.0:1786015448.573289:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015448.573295:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501c36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.573300:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501c36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.573322:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.573327:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c3d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.573333:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.573338:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015448.573341:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.573348:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.573370:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee467b96 (ffff8b74a04b5200) 00010000:00010000:3.0:1786015448.573373:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015448.573376:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c3d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.573382:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.573441:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501c2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8879 expref: 92 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.573458:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501c44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8879 expref: 91 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.573466:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8b74a04b5b00) 00010000:00010000:3.0:1786015448.573468:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015448.573471:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc000, rc 0) 00000100:00100000:2.0:1786015448.577104:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+91:28705:x1872772280509440:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 6945us (7534us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015448.577122:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1086 00000100:00100000:0.0:1786015448.717948:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015448.718722:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280509568 00000100:00100000:3.0:1786015448.718742:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280509568 00000100:00100000:3.0:1786015448.718883:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1087 00000100:00100000:3.0:1786015448.718897:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+41:28711:x1872772280509568:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015448.718949:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015448.718987:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501c4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8880 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.719093:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.719135:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.719151:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015448.719427:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1786015448.719432:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 28 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015448.719508:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.719541:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501c4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8880 expref: 43 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.719565:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8880 expref: 42 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.719575:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:3.0:1786015448.719577:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015448.719580:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbda00, rc 0) 00000100:00100000:3.0:1786015448.719659:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28711:x1872772280509568:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 764us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015448.719668:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1087 00000100:00100000:1.0:1786015448.736907:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015448.737622:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280509824 00000100:00100000:2.0:1786015448.737638:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280509824 00000100:00100000:2.0:1786015448.737725:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1088 00000100:00100000:2.0:1786015448.737738:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+91:28711:x1872772280509824:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015448.737845:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015448.737849:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786015448.737888:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501c44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8879 expref: 91 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.737941:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8b74a04b5b00) 00010000:00010000:2.0:1786015448.737956:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015448.737979:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501c59 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8887 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.740468:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501c60 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.740500:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501c60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.740526:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501c60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.740672:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501c67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.740698:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501c67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.740712:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501c67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.743059:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501c6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.743090:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.743152:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015448.743167:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 0 00010000:00010000:2.0:1786015448.743254:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501c60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.743329:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501c60 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.743338:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501c60 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.743343:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015448.743348:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501c60 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.743355:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501c60 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.743368:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8b749232dd00) 00010000:00010000:2.0:1786015448.743371:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015448.743376:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501c60 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.743382:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501c60 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015448.743395:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e301011d reply state 00000000e76d1a79 transno 4294968006 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501c67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015448.743410:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786015448.743513:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501c59 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8887 expref: 93 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.743536:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501c6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8887 expref: 92 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.743544:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b749232d000) 00010000:00010000:2.0:1786015448.743546:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015448.743548:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907e00, rc 0) 00000100:00100000:2.0:1786015448.743631:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+93:28711:x1872772280509824:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 5895us (6738us total) trans 4294968006 rc 0/0 00000100:00100000:2.0:1786015448.743640:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1088 00010000:00010000:2.0:1786015448.750981:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501c67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.751178:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501c67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.751189:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501c67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.751196:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015448.751202:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501c67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.751211:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501c67 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.751336:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x81b47e8f (ffff8b749232d400) 00010000:00010000:2.0:1786015448.751339:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015448.751345:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501c67 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.751352:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501c67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015448.751900:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015448.754503:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280510080 00000100:00100000:2.0:1786015448.754527:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280510080 00000100:00100000:2.0:1786015448.754629:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1089 00000100:00100000:2.0:1786015448.754642:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+92:28711:x1872772280510080:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015448.754680:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015448.754717:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c501c7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e888e expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.754873:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501c83 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.754891:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501c6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8887 expref: 93 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.754900:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501c83 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.755402:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501c6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8887 expref: 93 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.755420:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501c6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8887 expref: 93 pid: 5796 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015448.755455:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383748700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304416384:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015448.755587:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b13f0840 going to sleep for 11 seconds 00000100:00100000:0.0:1786015448.767816:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015448.768977:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280510208 00000100:00100000:1.0:1786015448.769004:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280510208 00010000:00010000:1.0:1786015448.769068:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501c6e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8887 expref: 94 pid: 5796 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015448.769140:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 329 00000100:00100000:1.0:1786015448.769174:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+94:2353:x1872772280510208:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015448.769198:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015448.769207:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501c6e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8887 expref: 94 pid: 5796 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015448.770564:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501c6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8887 expref: 94 pid: 5796 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015448.770604:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b749232d000) 00010000:00010000:1.0:1786015448.770611:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501c83 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015448.770621:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501c83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015448.770631:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501c83 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015448.770663:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015448.770748:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+94:2353:x1872772280510208:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1576us (2945us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015448.770757:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 329 00010000:00010000:2.0:1786015448.782357:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501c6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8887 expref: 93 pid: 5796 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015448.782391:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383748700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304416384:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015448.782429:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501c83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.784060:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501c83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.784080:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501c83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015448.784125:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 0 00010000:00010000:0.0:1786015448.784648:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501c83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.784661:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501c83 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.784669:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501c83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.784713:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015448.784719:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501c83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.784728:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501c83 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.784753:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b749232d000) 00010000:00010000:0.0:1786015448.784756:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015448.784833:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501c83 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.784841:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c501c83 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.787324:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c501c7c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e888e expref: 93 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.787353:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8b7499c59a00) 00010000:00010000:0.0:1786015448.787356:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015448.787362:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c501c7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e888e expref: 93 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.787395:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73813bf800, rc 0) 00000100:00100000:0.0:1786015448.787508:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+92:28711:x1872772280510080:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 32867us (35613us total) trans 4294968007 rc 301/301 00000100:00100000:0.0:1786015448.787520:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1089 00000100:00100000:1.0:1786015448.805426:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015448.821398:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280510464 00000100:00100000:2.0:1786015448.821433:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280510464 00000100:00100000:2.0:1786015448.821585:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 217 00000100:00100000:2.0:1786015448.821602:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916b5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+92:28711:x1872772280510464:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786015448.831571:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916b5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+93:28711:x1872772280510464:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 9953us (26146us total) trans 4294968008 rc 0/0 00000100:00100000:0.0:1786015448.831619:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 217 00000100:00100000:2.0:1786015448.838704:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015448.838983:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280510592 00000100:00100000:3.0:1786015448.839170:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280510592 00000100:00100000:3.0:1786015448.839461:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1090 00000100:00100000:3.0:1786015448.839476:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+93:28711:x1872772280510592:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015448.839512:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015448.839566:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501c91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8895 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.839655:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501c91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8895 expref: 94 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.839673:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501c91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8895 expref: 94 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015448.839697:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:3.0:1786015448.839701:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015448.839706:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc200, rc 0) 00000100:00100000:3.0:1786015448.839858:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+94:28711:x1872772280510592:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 385us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015448.839866:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1090 00000100:00100000:1.0:1786015448.847861:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015448.848259:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280510848 00000100:00100000:2.0:1786015448.848273:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280510848 00000100:00100000:2.0:1786015448.848354:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1091 00000100:00100000:2.0:1786015448.848366:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+94:28711:x1872772280510848:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1786015448.848462:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501c98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.848485:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501c98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015448.848500:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501c98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.849398:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501c98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.849412:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501c98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.849420:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501c98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.849426:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015448.849432:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501c98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.849441:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501c98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.849458:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:0.0:1786015448.849461:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1786015448.849467:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501c98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.849473:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501c98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015448.849592:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+95:28711:x1872772280510848:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 1226us (1743us total) trans 4294968009 rc 0/0 00000100:00100000:0.0:1786015448.849602:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1091 00000100:00100000:2.0:1786015448.869345:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015448.869438:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280511104 00000100:00100000:0.0:1786015448.869455:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280511104 00000100:00100000:0.0:1786015448.869561:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1092 00000100:00100000:0.0:1786015448.869574:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+95:28711:x1872772280511104:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786015448.870014:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501c9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.870039:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015448.870055:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786015448.870146:0:12526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968010 00000004:00010000:0.0:1786015448.870193:0:12526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000248ca4da reply state 000000006ae00da6 transno 4294968011 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015448.870205:0:12526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015448.870528:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+98:28711:x1872772280511104:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 953us (1196us total) trans 4294968011 rc 0/0 00000100:00100000:0.0:1786015448.870537:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1092 00000020:00080000:0.0:1786015448.870543:0:12526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786015448.876541:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:1.0:1786015448.876754:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015448.876815:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501c9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015448.876855:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501c9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015448.876863:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015448.876869:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501c9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015448.876879:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501c9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015448.876903:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:1.0:1786015448.876907:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786015448.876913:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501c9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015448.877358:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501c9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015448.877954:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280511360 00000100:00100000:3.0:1786015448.877970:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280511360 00000100:00100000:3.0:1786015448.878083:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 218 00000100:00100000:3.0:1786015448.878094:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+97:28711:x1872772280511360:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786015448.878665:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+98:28711:x1872772280511360:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 569us (2135us total) trans 4294968012 rc 0/0 00000100:00100000:3.0:1786015448.878675:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 218 00010000:00010000:1.0:1786015448.945382:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015449.010023:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015449.010163:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280511488 00000100:00100000:0.0:1786015449.010182:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280511488 00000100:00100000:0.0:1786015449.010266:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1093 00000100:00100000:0.0:1786015449.010277:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+98:28717:x1872772280511488:12345-192.168.202.56@tcp:101:cmp.0 00010000:00010000:0.0:1786015449.010305:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015449.010329:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501ca6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e889c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.010402:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501cad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.010432:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501cad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786015449.010437:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786015449.010447:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501cad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.010465:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501cb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.010473:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.010480:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.010836:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501cbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.010846:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.010855:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015449.010889:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 7680 00000004:00200000:0.0:1786015449.010893:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015449.010941:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.010955:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501cad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.010972:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501cad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.010978:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501cad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.010984:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015449.010988:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501cad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.010995:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501cad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.011006:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:0.0:1786015449.011008:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015449.011012:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501cad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.011018:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501cad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.011030:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.011035:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501cb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.011041:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.011045:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015449.011056:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.011062:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.011069:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee467b96 (ffff8b748f24ab00) 00010000:00010000:0.0:1786015449.011072:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015449.011074:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501cb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.011080:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501cb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.011110:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501ca6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e889c expref: 100 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.011123:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd200/0xb1a5ef690c501cbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e889c expref: 99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.011131:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8b748f24a700) 00010000:00010000:0.0:1786015449.011133:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786015449.011135:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd200, rc 0) 00000100:00100000:0.0:1786015449.011200:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+99:28717:x1872772280511488:12345-192.168.202.56@tcp:101:cmp.0 Request processed in 926us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015449.011208:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1093 00000100:00100000:2.0:1786015449.014427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015449.014887:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280511744 00000100:00100000:0.0:1786015449.014905:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280511744 00000100:00100000:0.0:1786015449.015068:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1094 00000100:00100000:0.0:1786015449.015080:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+99:28717:x1872772280511744:12345-192.168.202.56@tcp:101:cmp.0 00010000:00010000:0.0:1786015449.015126:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015449.015149:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501cc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e88a3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015229:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501cc9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015243:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015254:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015270:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501cd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015278:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015285:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015412:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501cd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015422:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015429:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015449.015439:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 158 00010000:00010000:0.0:1786015449.015540:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015548:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501cc9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015555:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015560:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015449.015565:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015572:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501cc9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015584:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8b748f24a700) 00010000:00010000:0.0:1786015449.015587:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015449.015591:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501cc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015596:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501cc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015611:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015617:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501cd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015622:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015637:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015449.015640:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015647:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501cd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015655:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x81b47e8f (ffff8b748f24a900) 00010000:00010000:0.0:1786015449.015658:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015449.015661:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501cd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015668:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501cd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015712:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501cc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88a3 expref: 102 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015726:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88a3 expref: 101 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.015733:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:0.0:1786015449.015735:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015449.015737:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd800, rc 0) 00000100:00100000:0.0:1786015449.015838:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+101:28717:x1872772280511744:12345-192.168.202.56@tcp:101:cmp.0 Request processed in 759us (1426us total) trans 4294968013 rc 0/0 00000100:00100000:0.0:1786015449.015845:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1094 00000100:00100000:3.0:1786015449.025381:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015449.026344:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280512000 00000100:00100000:2.0:1786015449.026357:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280512000 00000100:00100000:2.0:1786015449.026435:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00100000:2.0:1786015449.026445:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+101:28717:x1872772280512000:12345-192.168.202.56@tcp:103:cmp.0 00010000:00010000:2.0:1786015449.026461:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1786015449.026486:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501cd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88a3 expref: 101 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.026509:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501c91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8895 expref: 100 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.026522:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:2.0:1786015449.026533:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015449.026595:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+99:28717:x1872772280512000:12345-192.168.202.56@tcp:103:cmp.0 Request processed in 150us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015449.026602:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00100000:1.0:1786015449.030853:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015449.031402:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280512128 00000100:00100000:3.0:1786015449.031413:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280512128 00000100:00100000:3.0:1786015449.031476:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1095 00000100:00100000:3.0:1786015449.031486:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+99:28717:x1872772280512128:12345-192.168.202.56@tcp:58:cmp.0 00010000:00010000:3.0:1786015449.031613:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501ce5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.031630:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501ce5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.031642:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501ce5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786015449.031914:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].30, 136 off12272 00000100:00100000:3.0:1786015449.032329:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+99:28717:x1872772280512128:12345-192.168.202.56@tcp:58:cmp.0 Request processed in 842us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015449.032338:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1095 00000100:00100000:3.0:1786015449.035854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015449.036245:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280512256 00000100:00100000:1.0:1786015449.036255:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280512256 00000100:00100000:1.0:1786015449.036316:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1096 00000100:00100000:1.0:1786015449.036325:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+99:28717:x1872772280512256:12345-192.168.202.56@tcp:101:cmp.0 00010000:00010000:1.0:1786015449.036348:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015449.036371:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501cec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e88aa expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.036452:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501ce5 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.036463:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501cec lrc: 4/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88aa expref: 100 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.036482:0:7673:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501ce5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.036496:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501cec lrc: 3/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88aa expref: 100 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.036510:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:1.0:1786015449.036513:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015449.036517:0:7673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501cec lrc: 3/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88aa expref: 100 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.036525:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47a00, rc 0) 00000100:00100000:1.0:1786015449.036594:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+100:28717:x1872772280512256:12345-192.168.202.56@tcp:101:cmp.0 Request processed in 269us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015449.036601:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1096 00000040:00080000:2.0:1786015449.196678:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015449.196691:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015449.196739:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 31 count 4 00000040:00080000:2.0:1786015449.196749:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015449.196943:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738374ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304416512:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786015449.198440:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b13f0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786015449.221257:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738374ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304416512:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015449.221757:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015449.221997:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280512384 00000100:00100000:0.0:1786015449.222012:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280512384 00000100:00100000:0.0:1786015449.222084:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1097 00000100:00100000:0.0:1786015449.222093:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28718:x1872772280512384:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015449.222145:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x44:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015449.222273:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28718:x1872772280512384:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 180us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015449.222281:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1097 00000100:00080000:3.0:1786015449.222947:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015449.228686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015449.228866:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280512512 00000100:00100000:1.0:1786015449.228879:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280512512 00000100:00100000:1.0:1786015449.228963:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1098 00000100:00100000:1.0:1786015449.228975:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28718:x1872772280512512:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1786015449.229056:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501cf3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229091:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229115:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229133:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501cfa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229141:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501cfa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229147:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501cfa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229173:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501d01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229182:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229189:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015449.229233:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 158 00000004:00200000:1.0:1786015449.229238:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015449.229254:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229266:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229282:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501cf3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229289:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501cf3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229297:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015449.229301:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501cf3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229310:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501cf3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229324:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:1.0:1786015449.229327:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015449.229331:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501cf3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229336:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501cf3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229351:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501cfa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229356:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501cfa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229363:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501cfa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229368:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015449.229377:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501cfa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229383:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501cfa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229391:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x8b3c9e9 (ffff8b7483ee6500) 00010000:00010000:1.0:1786015449.229394:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015449.229396:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501cfa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229402:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501cfa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229418:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229424:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501d01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229430:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501d01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229434:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015449.229437:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501d01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229442:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501d01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229450:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:1.0:1786015449.229452:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015449.229462:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501d01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.229467:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501d01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015449.229553:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28718:x1872772280512512:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 580us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015449.229561:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1098 00000100:00100000:1.0:1786015449.237068:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015449.237442:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280512768 00000100:00100000:2.0:1786015449.237452:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280512768 00000100:00100000:2.0:1786015449.237518:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1099 00000100:00100000:2.0:1786015449.237528:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+42:28718:x1872772280512768:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015449.237551:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015449.237575:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501d08 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e88b1 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.237698:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.237717:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.237731:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015449.237745:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 158 00010000:00010000:2.0:1786015449.237892:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.237901:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.237908:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.237915:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015449.237927:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.237953:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.237966:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:2.0:1786015449.237969:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015449.237974:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.237981:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.238022:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501d08 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88b1 expref: 44 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.238031:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:2.0:1786015449.238034:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786015449.238038:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501d08 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88b1 expref: 44 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.238047:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907e00, rc 0) 00000100:00100000:2.0:1786015449.238121:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+43:28718:x1872772280512768:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 594us (1064us total) trans 4294968014 rc 301/301 00000100:00100000:2.0:1786015449.238129:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1099 00000100:00100000:2.0:1786015449.244869:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015449.245110:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280512896 00000100:00100000:3.0:1786015449.245121:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280512896 00000100:00100000:3.0:1786015449.245183:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1100 00000100:00100000:3.0:1786015449.245193:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:28718:x1872772280512896:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015449.245235:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x44:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015449.245369:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:28718:x1872772280512896:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 176us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015449.245377:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1100 00000100:00100000:3.0:1786015449.256527:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015449.256736:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280513024 00000100:00100000:1.0:1786015449.256749:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280513024 00000100:00100000:1.0:1786015449.256873:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1101 00000100:00100000:1.0:1786015449.256885:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+43:28718:x1872772280513024:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015449.256908:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015449.256944:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501d1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e88b8 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257015:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501d24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257030:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501d24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257042:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501d24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257057:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501d2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257065:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501d2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257088:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501d2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257412:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501d32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257421:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257428:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015449.257477:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 7680 00000004:00200000:1.0:1786015449.257482:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015449.257506:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257519:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501d24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257525:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501d24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257531:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501d24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257537:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015449.257541:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501d24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257548:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501d24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257567:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:1.0:1786015449.257570:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015449.257575:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501d24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257581:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501d24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257593:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501d2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257598:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501d2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257603:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501d2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257608:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015449.257622:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501d2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257629:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501d2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257638:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee467b96 (ffff8b7483ee6500) 00010000:00010000:1.0:1786015449.257641:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015449.257644:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501d2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257651:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501d2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257693:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501d1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88b8 expref: 45 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257708:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46400/0xb1a5ef690c501d32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88b8 expref: 44 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.257716:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8b748f24a700) 00010000:00010000:1.0:1786015449.257718:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1786015449.257721:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46400, rc 0) 00000100:00100000:1.0:1786015449.257826:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:28718:x1872772280513024:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 942us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015449.257834:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1101 00000100:00100000:0.0:1786015449.262274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015449.262548:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280513280 00000100:00100000:1.0:1786015449.262558:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280513280 00000100:00100000:1.0:1786015449.262626:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1102 00000100:00100000:1.0:1786015449.262637:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+44:28718:x1872772280513280:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015449.262660:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015449.262685:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501d39 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e88bf expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786015449.267010:0:5796:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x18:0x0], index 1: 0 00010000:00010000:1.0:1786015449.267452:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501d40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.267470:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501d40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.267495:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501d40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.267581:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501d39 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88bf expref: 47 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.267601:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501d40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88bf expref: 46 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.267611:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8b7483ee6c00) 00010000:00010000:1.0:1786015449.267615:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015449.267619:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47c00, rc 0) 00000100:00100000:1.0:1786015449.267708:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+46:28718:x1872772280513280:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 5073us (5444us total) trans 4294968015 rc 0/0 00000100:00100000:1.0:1786015449.267717:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1102 00000100:00100000:3.0:1786015449.290846:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015449.290993:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280513536 00000100:00100000:2.0:1786015449.291011:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280513536 00000100:00100000:2.0:1786015449.291109:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1103 00000100:00100000:2.0:1786015449.291123:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+46:28718:x1872772280513536:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786015449.291227:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015449.291264:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c501d40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88bf expref: 46 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291285:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8b7483ee6c00) 00010000:00010000:2.0:1786015449.291297:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015449.291327:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501d4e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291344:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501d4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291355:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501d4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291374:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d55 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0xa1fcb858 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291382:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0xa1fcb858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291389:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0xa1fcb858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291495:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501d4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291504:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501d4e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291512:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501d4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291529:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015449.291534:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501d4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291542:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501d4e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291553:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8b748f24a700) 00010000:00010000:2.0:1786015449.291556:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015449.291561:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501d4e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291567:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501d4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291576:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0xa1fcb858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291582:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d55 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0xa1fcb858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291587:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0xa1fcb858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291591:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015449.291597:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0xa1fcb858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291602:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d55 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0xa1fcb858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291627:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0xa1fcb858 (ffff8b7499c59e00) 00010000:00010000:2.0:1786015449.291630:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015449.291632:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d55 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0xa1fcb858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.291638:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501d55 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0xa1fcb858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015449.291714:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28718:x1872772280513536:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 595us (882us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786015449.291721:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1103 00000100:00100000:3.0:1786015449.301500:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015449.301648:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280513664 00000100:00100000:2.0:1786015449.301658:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280513664 00000100:00100000:2.0:1786015449.301717:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1104 00000100:00100000:2.0:1786015449.301727:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28718:x1872772280513664:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015449.301751:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015449.301800:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501d5c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e88c6 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.301837:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501d63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.301850:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501d63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.301862:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501d63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.301973:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501d5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88c6 expref: 47 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.301999:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501d63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88c6 expref: 46 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.302008:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:2.0:1786015449.302011:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015449.302014:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906000, rc 0) 00000100:00100000:2.0:1786015449.302086:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+46:28718:x1872772280513664:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 360us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015449.302093:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1104 00000100:00100000:2.0:1786015449.305463:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015449.305535:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280513920 00000100:00100000:1.0:1786015449.305545:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280513920 00000100:00100000:1.0:1786015449.305606:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1105 00000100:00100000:1.0:1786015449.305624:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+46:28718:x1872772280513920:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786015449.305712:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501d6a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.305730:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501d6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.305742:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501d6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786015449.306075:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].15, 88 off9248 00000004:00080000:1.0:1786015449.306084:0:5796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 684557322515ns, next at 685557320531ns, rc = 0 00000004:00010000:1.0:1786015449.306175:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b7f91d87 reply state 00000000f9db319a transno 4294968016 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501d6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015449.306185:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786015449.306289:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+48:28718:x1872772280513920:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 665us (834us total) trans 4294968016 rc 0/0 00000100:00100000:1.0:1786015449.306297:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1105 00000100:00100000:0.0:1786015449.319739:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:2.0:1786015449.320304:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501d6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.320319:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501d6a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.320337:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501d6a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.320344:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015449.320349:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501d6a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.320357:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501d6a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.320384:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:2.0:1786015449.320388:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786015449.320409:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501d6a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.320416:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501d6a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015449.321216:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280514048 00000100:00100000:3.0:1786015449.321228:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280514048 00000100:00100000:3.0:1786015449.321289:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1106 00000100:00100000:3.0:1786015449.321297:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+47:28718:x1872772280514048:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015449.321335:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015449.321357:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501d71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e88cd expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.321734:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501d71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88cd expref: 48 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.321750:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501d71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88cd expref: 48 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.321799:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:3.0:1786015449.321803:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015449.321806:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc400, rc 0) 00000100:00100000:3.0:1786015449.321869:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+48:28718:x1872772280514048:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 572us (2141us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015449.321877:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1106 00000100:00100000:3.0:1786015449.344354:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015449.344467:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280514176 00000100:00100000:0.0:1786015449.344477:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280514176 00000100:00100000:0.0:1786015449.344545:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 289 00000100:00100000:0.0:1786015449.344555:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280514176:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1786015449.346458:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280514176:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 1896us (2104us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1786015449.346471:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 289 00000100:00100000:2.0:1786015449.358031:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015449.358192:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280514432 00000100:00100000:3.0:1786015449.358205:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280514432 00000100:00100000:3.0:1786015449.358273:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 219 00000100:00100000:3.0:1786015449.358283:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:28718:x1872772280514432:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786015449.358683:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:28718:x1872772280514432:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 400us (661us total) trans 4294968017 rc 0/0 00000100:00100000:3.0:1786015449.358692:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 219 00000100:00100000:0.0:1786015449.373741:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015449.373981:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280514688 00000100:00100000:3.0:1786015449.373992:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280514688 00000100:00100000:3.0:1786015449.374053:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1107 00000100:00100000:3.0:1786015449.374064:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7385445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:28718:x1872772280514688:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786015449.374197:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7385445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:28718:x1872772280514688:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 134us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015449.374205:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1107 00000100:00100000:2.0:1786015449.376857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015449.377057:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280514816 00000100:00100000:1.0:1786015449.377068:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280514816 00000100:00100000:1.0:1786015449.377132:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1108 00000100:00100000:1.0:1786015449.377142:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+49:28718:x1872772280514816:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015449.377161:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015449.377185:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501d78 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e88d4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.377258:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501d7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.377273:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501d7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.377285:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501d7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015449.377324:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015449.377343:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501d7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.377382:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501d78 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88d4 expref: 51 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.377399:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501d7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88d4 expref: 50 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.377409:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:1.0:1786015449.377412:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786015449.377415:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47600, rc 0) 00000100:00100000:1.0:1786015449.377473:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+50:28718:x1872772280514816:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 332us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015449.377481:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1108 00000100:00100000:2.0:1786015449.381554:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015449.381650:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280514944 00000100:00100000:3.0:1786015449.381662:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280514944 00000100:00100000:3.0:1786015449.381725:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 290 00000100:00100000:3.0:1786015449.381735:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280514944:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015449.381753:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015449.381812:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c501d86 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e88db expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015449.381846:0:14547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a746ed9, blocks: 0x1 00010000:00010000:3.0:1786015449.382200:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1786015449.382205:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015449.382216:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c501d86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88db expref: 12 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.382235:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c501d86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88db expref: 12 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.382265:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbce00, rc 0) 00000100:00100000:3.0:1786015449.382327:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280514944:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 593us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015449.382334:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 290 00000100:00100000:0.0:1786015449.388449:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015449.388519:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280515200 00000100:00100000:3.0:1786015449.388529:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280515200 00000100:00100000:3.0:1786015449.388586:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1109 00000100:00100000:3.0:1786015449.388596:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7385447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+50:28718:x1872772280515200:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786015449.388711:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7385447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+50:28718:x1872772280515200:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 117us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015449.388719:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1109 00000100:00100000:2.0:1786015449.394238:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015449.394386:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280515328 00000100:00100000:1.0:1786015449.394396:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280515328 00000100:00100000:1.0:1786015449.394456:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 291 00000100:00100000:1.0:1786015449.394465:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:28718:x1872772280515328:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015449.394485:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015449.394507:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501d8d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e88e2 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.394542:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c501d86 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88db expref: 13 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.394552:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015449.394556:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015449.394562:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501d8d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e2 expref: 13 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.394626:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c501d86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88db expref: 13 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.394642:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c501d86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88db expref: 13 pid: 14547 timeout: 784 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015449.394657:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304416640:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015449.394754:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486540900 going to sleep for 11 seconds 00000100:00100000:0.0:1786015449.400743:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015449.400990:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280515456 00000100:00100000:2.0:1786015449.401000:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280515456 00010000:00010000:2.0:1786015449.401053:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c501d86 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88db expref: 14 pid: 14547 timeout: 784 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015449.401115:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 330 00000100:00100000:2.0:1786015449.401126:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7385445f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2354:x1872772280515456:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015449.401142:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015449.401170:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c501d86 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88db expref: 14 pid: 14547 timeout: 784 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.401186:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c501d86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88db expref: 14 pid: 14547 timeout: 784 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.401215:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015449.401220:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015449.401230:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501d8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e2 expref: 14 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.401263:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501d8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e2 expref: 14 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.401323:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501d8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e2 expref: 14 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015449.401341:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5782:1872772304416768:192.168.202.56@tcp:105: 00000100:00100000:2.0:1786015449.401425:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b13f0000 going to sleep for 11 seconds 00010000:00010000:1.0:1786015449.402202:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c501d86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88db expref: 14 pid: 14547 timeout: 784 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015449.402225:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304416640:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015449.402260:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501d8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e2 expref: 13 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.402272:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46e00, rc 0) 00000100:00100000:1.0:1786015449.402330:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:28718:x1872772280515328:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 7866us (8102us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015449.402339:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 291 00000100:00100000:2.0:1786015449.404187:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5782:1872772304416768:192.168.202.56@tcp:105: 00010000:00010000:2.0:1786015449.404211:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015449.404269:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7385445f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280515456:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 3143us (3538us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015449.404280:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 330 00000100:00100000:2.0:1786015449.425407:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015449.428632:0:17970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280515584 00000100:00100000:0.0:1786015449.428648:0:17970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280515584 00002000:00100000:0.0:1786015449.428717:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x18:0x0] (0->157) req@ffff8b7381cc1c00 x1872772280515584/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:295/0 lens 648/0 e 0 to 0 dl 1786015460 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015449.428729:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381cc1c00 with x1872772280515584 ext(0->157) 00002000:00010000:0.0:1786015449.428735:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7381cc1c00 00000100:00100000:0.0:1786015449.428811:0:17970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 99 00000100:00100000:0.0:1786015449.428821:0:17970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280515584:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1786015449.429532:0:17970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2353:x1872772280515584:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 711us (4135us total) trans 4294967361 rc 0/0 00000100:00100000:0.0:1786015449.429545:0:17970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 99 00002000:00100000:0.0:1786015449.429553:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x18:0x0] (0->157) req@ffff8b7381cc1c00 x1872772280515584/t4294967361(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:295/0 lens 648/448 e 0 to 0 dl 1786015460 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015449.429563:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381cc1c00 with x1872772280515584 ext(0->157) 00002000:00010000:0.0:1786015449.429567:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7381cc1c00 00000100:00100000:3.0:1786015449.432541:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015449.432650:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280515712 00000100:00100000:1.0:1786015449.432672:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280515712 00000100:00100000:1.0:1786015449.432856:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1110 00000100:00100000:1.0:1786015449.432880:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+50:28718:x1872772280515712:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1786015449.536647:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968013 is committed 00000001:00080000:0.0:1786015449.536682:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968016 is committed 00000004:00080000:0.0:1786015449.536688:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 19 committed 00000001:00080000:0.0:1786015449.536722:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968017 is committed 00000100:00100000:3.0:1786015449.537453:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+46:28718:x1872772280515712:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 104573us (104909us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015449.537468:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1110 00000100:00100000:1.0:1786015449.539964:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015449.540944:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280515840 00000100:00100000:3.0:1786015449.540963:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280515840 00000100:00100000:3.0:1786015449.541060:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 292 00000100:00100000:3.0:1786015449.541072:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2352:x1872772280515840:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1786015449.545320:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7385446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304416896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786015449.545421:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015449.545523:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304416896 00000100:00100000:0.0:1786015449.545532:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304416896 00000100:00100000:0.0:1786015449.545597:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1786015449.545606:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7385445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304416896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786015449.545912:0:14547:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1786015449.545929:0:14547:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb mtime from disk: 0 -> 1786015449 00002000:00010000:0.0:1786015449.545931:0:14547:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786015449.545933:0:14547:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb ctime from disk: 1786015449 -> 1786015449 00002000:00010000:0.0:1786015449.545935:0:14547:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1786015449.545988:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7385445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304416896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 382us (566us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1786015449.545996:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000004:00080000:0.0:1786015449.546069:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b7385446680/2, rc 0, transno 4294967362 00000100:00100000:0.0:1786015449.546076:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7385446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304416896:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1786015449.546112:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015449.669933:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2352:x1872772280515840:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 128841us (129960us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015449.669955:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 292 00000001:00080000:2.0:1786015449.670257:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967361 is committed 00000100:00100000:0.0:1786015449.674399:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015449.674602:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280516096 00000100:00100000:1.0:1786015449.674619:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280516096 00000100:00100000:0.0:1786015449.675065:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1111 00000100:00100000:0.0:1786015449.675080:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7385445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+46:28718:x1872772280516096:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786015449.675223:0:12526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015449.675264:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501d7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88d4 expref: 46 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.675289:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:0.0:1786015449.675296:0:12526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015449.675337:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c501d94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.675355:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c501d94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.675367:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c501d94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015449.675621:0:12526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ebe528c7 reply state 00000000beb045cc transno 4294968018 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c501d94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015449.675632:0:12526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015449.676084:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7385445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+47:28718:x1872772280516096:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 1006us (1698us total) trans 4294968018 rc 0/0 00000100:00100000:0.0:1786015449.676094:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1111 00000100:00100000:3.0:1786015449.684731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015449.684987:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280516224 00000100:00100000:2.0:1786015449.685010:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280516224 00000100:00100000:2.0:1786015449.685085:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 294 00000100:00100000:2.0:1786015449.685109:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280516224:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1786015449.685383:0:6591:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb size from disk: 158 -> 158 00002000:00010000:2.0:1786015449.685388:0:6591:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb mtime from disk: 1786015449 -> 1536580263 00002000:00010000:2.0:1786015449.685391:0:6591:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb atime from disk: 0 -> 1786014790 00002000:00010000:2.0:1786015449.685393:0:6591:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb ctime from disk: 1786015449 -> 1786015449 00002000:00010000:2.0:1786015449.685396:0:6591:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1786015449.685492:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2352:x1872772280516224:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 396us (776us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1786015449.685501:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 294 00010000:00010000:1.0:1786015449.689964:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c501d94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.689991:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c501d94 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.690000:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c501d94 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.690007:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015449.690013:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c501d94 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.690021:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c501d94 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.690043:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:1.0:1786015449.690047:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015449.690053:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c501d94 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.690060:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c501d94 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015449.690959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015449.691222:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280516480 00000100:00100000:0.0:1786015449.691236:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280516480 00000100:00100000:0.0:1786015449.691308:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1112 00000100:00100000:0.0:1786015449.691340:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+46:28718:x1872772280516480:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1786015449.691435:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501d9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.691455:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501d63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88c6 expref: 46 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.691466:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501d9b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.691511:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501d63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88c6 expref: 46 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.691527:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501d63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88c6 expref: 46 pid: 12526 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015449.691544:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7385444e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304417024:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015449.691669:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54e180 going to sleep for 11 seconds 00000100:00100000:0.0:1786015449.695285:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015449.695521:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7385444e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304417024:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015449.695556:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501d9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015449.695806:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280516608 00000100:00100000:1.0:1786015449.695817:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280516608 00010000:00010000:1.0:1786015449.695946:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501d63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88c6 expref: 47 pid: 12526 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015449.696061:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 331 00000100:00100000:1.0:1786015449.696073:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7385444380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2354:x1872772280516608:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015449.696093:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015449.696112:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501d63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88c6 expref: 47 pid: 12526 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.696125:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501d63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88c6 expref: 47 pid: 12526 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.696152:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501d63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88c6 expref: 47 pid: 12526 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.696171:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:1.0:1786015449.696176:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501d9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.696188:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501d9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.696197:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501d9b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.696222:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015449.696296:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7385444380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+46:2354:x1872772280516608:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 223us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015449.696305:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 331 00010000:00010000:0.0:1786015449.697079:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501d9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.697091:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501d9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.697145:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501d9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.697151:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501d9b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.697175:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501d9b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.697181:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015449.697186:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501d9b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.697195:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501d9b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.697208:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:0.0:1786015449.697211:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1786015449.697214:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501d9b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.697220:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501d9b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015449.697301:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28718:x1872772280516480:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 5962us (6348us total) trans 0 rc -22/-22 00000100:00100000:0.0:1786015449.697311:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1112 00000100:00100000:0.0:1786015449.717429:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015449.717536:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280516736 00000100:00100000:3.0:1786015449.717550:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280516736 00000100:00100000:3.0:1786015449.717630:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 295 00000100:00100000:3.0:1786015449.717642:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7385446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280516736:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015449.717708:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c501da2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.717736:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501d8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e2 expref: 12 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.717748:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015449.717753:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015449.717758:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c501da2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.717841:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501d8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e2 expref: 12 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.717858:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501d8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e2 expref: 12 pid: 6591 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015449.717884:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304417152:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015449.718029:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872840 going to sleep for 11 seconds 00000100:00100000:0.0:1786015449.730219:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015449.730877:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304417152:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015449.730934:0:14547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c501da2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015449.731456:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280516864 00000100:00100000:1.0:1786015449.731469:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280516864 00010000:00010000:1.0:1786015449.731933:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501d8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e2 expref: 13 pid: 6591 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015449.732036:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 332 00000100:00100000:1.0:1786015449.732048:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7385447480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280516864:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015449.732070:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015449.732115:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501d8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e2 expref: 13 pid: 6591 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.732131:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501d8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e2 expref: 13 pid: 6591 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.732161:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c164013/0xb1a5ef690c501d8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e2 expref: 13 pid: 6591 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.732183:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015449.732189:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015449.732196:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c501da2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.732208:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c501da2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.732251:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015449.732335:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7385447480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280516864:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 290us (2132us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015449.732347:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 332 00010000:00010000:3.0:1786015449.732789:0:14547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c501da2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.732803:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c501da2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.732837:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c501da2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.732847:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c501da2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.732855:0:14547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c501da2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.732862:0:14547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbcc00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015449.732868:0:14547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c501da2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.732878:0:14547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c501da2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.732893:0:14547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c501da2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.732935:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c501da2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015449.733010:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7385446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280516736:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 15370us (15598us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015449.733019:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 295 00000100:00100000:0.0:1786015449.734971:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015449.735066:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280517120 00000100:00100000:3.0:1786015449.735080:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280517120 00000100:00100000:3.0:1786015449.735188:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1113 00000100:00100000:3.0:1786015449.735202:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7385445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+45:28718:x1872772280517120:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786015449.735317:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501da9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.735339:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501da9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.735354:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501da9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.736006:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501db0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.736022:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501d71 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88cd expref: 46 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.736031:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501db0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.736099:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501d71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88cd expref: 46 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.736118:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501d71 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88cd expref: 46 pid: 7673 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015449.736138:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304417280:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015449.736266:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872840 going to sleep for 11 seconds 00000100:00100000:2.0:1786015449.767612:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015449.767727:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280517248 00000100:00100000:1.0:1786015449.767742:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280517248 00010000:00010000:1.0:1786015449.767861:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501d71 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88cd expref: 47 pid: 7673 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015449.767946:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 333 00000100:00100000:1.0:1786015449.767959:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2353:x1872772280517248:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015449.767997:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015449.768015:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501d71 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88cd expref: 47 pid: 7673 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.768033:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501d71 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88cd expref: 47 pid: 7673 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.768069:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:1.0:1786015449.768076:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501db0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.768089:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501db0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.768108:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501db0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.768140:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015449.768233:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2353:x1872772280517248:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 276us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015449.768247:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 333 00010000:00010000:3.0:1786015449.769469:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501d71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88cd expref: 46 pid: 7673 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015449.769502:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304417280:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015449.769533:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501db0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.769546:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501db0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.769552:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501db0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786015449.770053:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968019 00000001:00080000:3.0:1786015449.770249:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968020 00000001:00080000:3.0:1786015449.770293:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968021 00000100:00100000:3.0:1786015449.770408:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304417408:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1786015449.770517:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015449.771091:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786015449.772593:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7385447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304417664:0@lo:400:kworker.0 00000100:00100000:0.0:1786015449.772612:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7385444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304417792:0@lo:400:kworker.0 00000100:00100000:2.0:1786015449.772816:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304417408 00000100:00100000:2.0:1786015449.772827:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304417408 00000100:00100000:3.0:1786015449.772876:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7385447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304417536:0@lo:400:kworker.0 00000100:00100000:2.0:1786015449.776019:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1786015449.776040:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5796:x1872772304417408:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1786015449.776627:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015449.776694:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015449.776710:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7385444a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304417920:0@lo:400:kworker.0 00000100:00100000:0.0:1786015449.776797:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015449.776852:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304417792 00000100:00100000:0.0:1786015449.776862:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304417792 00000100:00100000:0.0:1786015449.776926:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:0.0:1786015449.776935:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7385444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304417792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015449.776987:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7385444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304417792:12345-0@lo:400:kworker.0 Request processed in 53us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015449.776995:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00080000:0.0:1786015449.777019:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015449.777060:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7385444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304417792:0@lo:400:kworker.0 00000100:00100000:1.0:1786015449.778862:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015449.780439:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304417664 00000100:00100000:0.0:1786015449.780460:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304417664 00000100:00100000:0.0:1786015449.780564:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:0.0:1786015449.780578:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304417664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015449.781076:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304417664:12345-0@lo:400:kworker.0 Request processed in 295us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015449.781088:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1786015449.781972:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015449.782061:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7385446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304418048:0@lo:400:kworker.0 00000100:00100000:3.0:1786015449.782126:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015449.782193:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304417536 00000100:00100000:3.0:1786015449.782201:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304417536 00000100:00100000:3.0:1786015449.782249:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:3.0:1786015449.782257:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304417536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015449.782309:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304417536:12345-0@lo:400:kworker.0 Request processed in 53us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015449.782316:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:3.0:1786015449.782356:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304417920 00000100:00100000:3.0:1786015449.782360:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304417920 00000100:00100000:0.0:1786015449.782427:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304418048 00000100:00100000:0.0:1786015449.782433:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304418048 00000100:00100000:0.0:1786015449.782475:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:0.0:1786015449.782482:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304418048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015449.782515:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1786015449.782524:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7385446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304417920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015449.782566:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304418048:12345-0@lo:400:kworker.0 Request processed in 82us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015449.782576:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:3.0:1786015449.782582:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7385446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304417920:12345-0@lo:400:kworker.0 Request processed in 58us (5782us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015449.782590:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00080000:0.0:1786015449.782608:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015449.782647:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7385444a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304417920:0@lo:400:kworker.0 00000100:00100000:3.0:1786015449.782688:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7385447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304417536:0@lo:400:kworker.0 00000100:00100000:3.0:1786015449.782698:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7385446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304418048:0@lo:400:kworker.0 00000100:00100000:2.0:1786015449.782830:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5796:x1872772304417408:12345-0@lo:1000:mdt00_002.0 Request processed in 6793us (12310us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015449.782840:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1786015449.783129:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304417408:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1786015449.783616:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968022 00000100:00100000:3.0:1786015449.783718:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304418176:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1786015449.783807:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015449.783835:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872840 going to sleep for 11 seconds 00000100:00100000:1.0:1786015449.783876:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7385447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304417664:0@lo:400:kworker.0 00000100:00100000:2.0:1786015449.784275:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304418176 00000100:00100000:2.0:1786015449.784282:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304418176 00000100:00100000:2.0:1786015449.784332:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1786015449.784341:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5796:x1872772304418176:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786015449.784594:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5796:x1872772304418176:12345-0@lo:1000:mdt00_002.0 Request processed in 254us (786us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1786015449.784602:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1786015449.784860:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304418176:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1786015449.784906:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501db0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.784931:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501db0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.784940:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501db0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.784948:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbdc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015449.784953:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501db0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.784962:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501db0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.784981:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:3.0:1786015449.784985:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015449.784992:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501db0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.784999:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501db0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.785037:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501ce5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.785044:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501ce5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.785061:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501ce5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.785067:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015449.785070:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501ce5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.785075:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501ce5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.785081:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:3.0:1786015449.785084:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015449.785093:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501cec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88aa expref: 91 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.785119:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501cec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88aa expref: 91 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.785130:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501cec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88aa expref: 91 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.785161:0:5796:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501cec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88aa expref: 91 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015449.785175:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304418304:192.168.202.56@tcp:105: 00000100:00100000:3.0:1786015449.785414:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872840 going to sleep for 11 seconds 00000100:00100000:2.0:1786015449.790265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015449.790486:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280517376 00000100:00100000:1.0:1786015449.790499:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280517376 00000100:00100000:1.0:1786015449.790602:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 220 00000100:00100000:1.0:1786015449.790614:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+92:28717:x1872772280517376:12345-192.168.202.56@tcp:49:cmp.0 00000100:00100000:1.0:1786015449.791321:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+92:28717:x1872772280517376:12345-192.168.202.56@tcp:49:cmp.0 Request processed in 706us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015449.793659:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304418304:192.168.202.56@tcp:105: 00010000:00010000:3.0:1786015449.793831:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501ce5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.793845:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501ce5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.793906:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501db7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015449.794949:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 220 00010000:00010000:3.0:1786015449.795150:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501db7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.795167:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501db7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.795183:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501db7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.795189:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501db7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.795196:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501db7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.795203:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015449.795208:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501db7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.795218:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501db7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.795232:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:3.0:1786015449.795235:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015449.795259:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501db7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.795266:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501db7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.795287:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501da9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.795294:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501da9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.795300:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501da9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.795305:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015449.795308:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501da9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.795314:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501da9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.795322:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:3.0:1786015449.795325:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786015449.795328:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501da9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.795345:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501da9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015449.796514:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7385445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+49:28718:x1872772280517120:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 61301us (61540us total) trans 4294968023 rc 0/0 00000100:00100000:3.0:1786015449.796532:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1113 00000020:00080000:3.0:1786015449.796553:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1786015449.797295:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015449.797304:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015449.797981:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1786015449.798264:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015449.798755:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015449.799494:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280517504 00000100:00100000:3.0:1786015449.799509:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280517504 00000100:00100000:3.0:1786015449.799588:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 296 00000100:00100000:3.0:1786015449.799600:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+12:28717:x1872772280517504:12345-192.168.202.56@tcp:101:cmp.0 00010000:00010000:3.0:1786015449.799631:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015449.799667:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c501dbe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e88e9 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015449.799719:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 158, mtime: 0x5b965aa7, atime: 0x6a746c46, ctime: 0x6a746ed9, blocks: 0xb 00010000:00010000:3.0:1786015449.799750:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1786015449.799756:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015449.799789:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c501dbe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e9 expref: 13 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.799814:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c501dbe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e9 expref: 13 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.799830:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbdc00, rc 0) 00000100:00100000:3.0:1786015449.799931:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+13:28717:x1872772280517504:12345-192.168.202.56@tcp:101:cmp.0 Request processed in 332us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015449.799939:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 296 00000100:00100000:1.0:1786015449.802340:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015449.803460:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280517760 00000100:00100000:0.0:1786015449.803483:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280517760 00000100:00100000:0.0:1786015449.803618:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 221 00000100:00100000:0.0:1786015449.803630:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+49:28718:x1872772280517760:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015449.812343:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000004:00080000:0.0:1786015449.829430:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x1f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1786015449.829553:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968024 00010000:00010000:0.0:1786015449.829629:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501dc5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.829652:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.829669:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.829680:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501dc5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.829688:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501dc5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.829695:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015449.830358:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786015449.830685:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280517888 00000100:00100000:3.0:1786015449.830714:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280517888 00002000:00100000:3.0:1786015449.830798:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8b74bf39ea00 x1872772280517888/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:295/0 lens 488/0 e 0 to 0 dl 1786015460 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015449.830809:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74bf39ea00 with x1872772280517888 ext(0->4095) 00002000:00010000:3.0:1786015449.830827:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74bf39ea00 00000100:00100000:3.0:1786015449.830879:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 100 00000100:00100000:3.0:1786015449.830891:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41677fca-39fb-471c-b582-96bce6540a36+13:2353:x1872772280517888:12345-192.168.202.56@tcp:3:cmp.0 00000100:00100000:3.0:1786015449.831414:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41677fca-39fb-471c-b582-96bce6540a36+13:2353:x1872772280517888:12345-192.168.202.56@tcp:3:cmp.0 Request processed in 524us (19083us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786015449.831424:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 100 00002000:00100000:3.0:1786015449.831431:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8b74bf39ea00 x1872772280517888/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:295/0 lens 488/4536 e 0 to 0 dl 1786015460 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015449.831439:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74bf39ea00 with x1872772280517888 ext(0->4095) 00002000:00010000:3.0:1786015449.831443:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74bf39ea00 00000100:00100000:0.0:1786015449.834286:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:28718:x1872772280517760:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 26880us (28183us total) trans 4294968025 rc 0/0 00000100:00100000:0.0:1786015449.834311:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 221 00000020:00080000:0.0:1786015449.834324:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786015449.834975:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786015449.834999:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501dc5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.835012:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd600 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015449.835017:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501dc5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.835030:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.835052:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:1.0:1786015449.835057:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786015449.835062:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501dc5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.835069:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501dc5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.835098:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015449.835101:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015449.835102:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015449.846745:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015449.847011:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280518144 00000100:00100000:3.0:1786015449.847028:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280518144 00000100:00100000:3.0:1786015449.847126:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 222 00000100:00100000:3.0:1786015449.847139:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+92:28717:x1872772280518144:12345-192.168.202.56@tcp:35:cmp.0 00000001:00080000:3.0:1786015449.847589:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968026 00000100:00100000:3.0:1786015449.847799:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+94:28717:x1872772280518144:12345-192.168.202.56@tcp:35:cmp.0 Request processed in 626us (1035us total) trans 4294968027 rc 0/0 00000100:00100000:3.0:1786015449.847810:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 222 00000020:00080000:3.0:1786015449.847817:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786015449.904061:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015449.904498:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280518272 00000100:00100000:2.0:1786015449.904524:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280518272 00000100:00100000:2.0:1786015449.904600:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1114 00000100:00100000:2.0:1786015449.904613:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7385444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+94:28719:x1872772280518272:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015449.904650:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015449.904684:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501dcc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e88f0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.904830:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501dd3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.904848:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.904862:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.904891:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501dda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.904899:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.905135:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.910431:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501de1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.910462:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.910477:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015449.910553:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 158 00000004:00200000:3.0:1786015449.910559:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015449.910587:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.910602:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.910614:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.910620:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501dd3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.910627:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.910634:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015449.910639:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.910647:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501dd3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.910665:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8b748f24a700) 00010000:00010000:3.0:1786015449.910668:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015449.910674:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501dd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.910681:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501dd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.912903:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.912925:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501dda lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.912934:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501dda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.912941:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015449.912947:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501dda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.912954:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501dda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.912975:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x81b47e8f (ffff8b7499c59a00) 00010000:00010000:3.0:1786015449.912978:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015449.917174:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501dda lrc: 2/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.918108:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501dda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.918228:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501dcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88f0 expref: 96 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.918249:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501de1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88f0 expref: 95 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.918287:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:3.0:1786015449.918291:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015449.918295:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd400, rc 0) 00000100:00100000:3.0:1786015449.918408:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7385444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+95:28719:x1872772280518272:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 13795us (14360us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015449.918418:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1114 00000100:00100000:1.0:1786015449.923517:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015449.926097:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280518400 00000100:00100000:3.0:1786015449.926121:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280518400 00000100:00100000:3.0:1786015449.926225:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1115 00000100:00100000:3.0:1786015449.926238:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+95:28719:x1872772280518400:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015449.926268:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015449.926299:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501de8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e88f7 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.926395:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501def lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.926413:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.926427:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015449.926709:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 7680 00000004:00200000:3.0:1786015449.926714:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015449.926830:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.926880:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501de8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88f7 expref: 97 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.926904:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd800/0xb1a5ef690c501def lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88f7 expref: 96 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.936357:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8b748f24a700) 00010000:00010000:3.0:1786015449.936371:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015449.936381:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd800, rc 0) 00000100:00100000:3.0:1786015449.936501:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+96:28719:x1872772280518400:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 10258us (12989us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015449.936528:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1115 00000100:00100000:1.0:1786015449.948246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015449.948626:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280518656 00000100:00100000:3.0:1786015449.948643:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280518656 00000100:00100000:3.0:1786015449.948739:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1116 00000100:00100000:3.0:1786015449.948753:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+96:28719:x1872772280518656:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015449.948822:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015449.948853:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501df6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e88fe expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.949223:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501dfd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.949245:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501dfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.949286:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501dfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015449.949307:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 158 00010000:00010000:2.0:1786015449.949491:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c501df6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88fe expref: 99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.949519:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501dfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88fe expref: 98 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.949529:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:2.0:1786015449.949533:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786015449.949537:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907e00, rc 0) 00000100:00100000:2.0:1786015449.949626:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+98:28719:x1872772280518656:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 876us (1396us total) trans 4294968028 rc 0/0 00000100:00100000:2.0:1786015449.949635:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1116 00000100:00100000:0.0:1786015449.952660:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015449.953021:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280518784 00000100:00100000:3.0:1786015449.953034:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280518784 00000100:00100000:3.0:1786015449.953115:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 297 00000100:00100000:3.0:1786015449.953126:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7385447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+13:2352:x1872772280518784:12345-192.168.202.56@tcp:1:lfs.0 00010000:00010000:3.0:1786015449.953183:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c501e0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.953228:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c501dbe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e9 expref: 13 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.953238:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015449.953243:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015449.953248:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c501e0b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.953292:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c501dbe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e9 expref: 13 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.953586:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c501dbe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e9 expref: 13 pid: 11384 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015449.953607:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304418432:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015449.953735:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872000 going to sleep for 11 seconds 00000100:00100000:1.0:1786015449.959010:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015449.959825:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304418432:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015449.959868:0:14547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c501e0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015449.962533:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280518912 00000100:00100000:0.0:1786015449.962575:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280518912 00010000:00010000:1.0:1786015449.962744:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c501dbe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e9 expref: 14 pid: 11384 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015449.962818:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 334 00000100:00100000:1.0:1786015449.962829:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b024d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+14:2353:x1872772280518912:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015449.962848:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015449.962889:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c501dbe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e9 expref: 14 pid: 11384 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.962907:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c501dbe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e9 expref: 14 pid: 11384 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.962947:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c501dbe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88e9 expref: 14 pid: 11384 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.962978:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015449.962984:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015449.962991:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c501e0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.963013:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c501e0b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015449.963054:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015449.963503:0:14547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c501e0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.963516:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c501e0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.963562:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c501e0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.963572:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c501e0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.963581:0:14547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c501e0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.963589:0:14547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015449.963594:0:14547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c501e0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.963605:0:14547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c501e0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.963620:0:14547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c501e0b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.963630:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c501e0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015449.963894:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b024d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+13:2353:x1872772280518912:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1050us (4893us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015449.963906:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 334 00010000:00010000:3.0:1786015449.967732:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015449.967951:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7385447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280518784:12345-192.168.202.56@tcp:1:lfs.0 Request processed in 14745us (15224us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015449.967968:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 297 00000100:00100000:1.0:1786015449.974083:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015449.974353:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280519168 00000100:00100000:3.0:1786015449.974366:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280519168 00000100:00100000:3.0:1786015449.974475:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 223 00000100:00100000:3.0:1786015449.974486:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+98:28719:x1872772280519168:12345-192.168.202.56@tcp:35:lfs.0 00000004:00010000:3.0:1786015449.974574:0:5798:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x44:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501dfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88fe expref: 98 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786015449.974956:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968029 00000001:00080000:3.0:1786015449.975927:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968030 00010000:00010000:3.0:1786015449.976670:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501e12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.976708:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501cec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88aa expref: 101 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.976717:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501de1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88f0 expref: 101 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015449.976726:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501e12 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.979489:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501de1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88f0 expref: 101 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.979520:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501de1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88f0 expref: 101 pid: 5795 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015449.979542:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304418560:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015449.980404:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501cec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88aa expref: 101 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015449.980419:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501cec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88aa expref: 101 pid: 7673 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015449.980431:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304418688:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015449.980470:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7484eef9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786015450.001033:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015450.001314:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280519296 00000100:00100000:3.0:1786015450.001327:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280519296 00010000:00010000:3.0:1786015450.001394:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501cec lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88aa expref: 102 pid: 7673 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015450.001441:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 335 00000100:00100000:3.0:1786015450.001451:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+102:2354:x1872772280519296:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015450.001470:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015450.001478:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501cec lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88aa expref: 102 pid: 7673 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015450.001511:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501cec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88aa expref: 102 pid: 7673 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015450.001543:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:3.0:1786015450.001549:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501e12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015450.001558:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501e12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015450.001565:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015450.001638:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+102:2354:x1872772280519296:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 188us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015450.001645:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 335 00010000:00010000:1.0:1786015450.002403:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501cec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88aa expref: 101 pid: 7673 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015450.002425:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304418688:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015450.005643:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304418560:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015450.005701:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501e12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015450.015509:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015450.017576:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280519424 00000100:00100000:1.0:1786015450.017596:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280519424 00010000:00010000:1.0:1786015450.017659:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501de1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88f0 expref: 101 pid: 5795 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015450.017829:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 336 00000100:00100000:1.0:1786015450.017841:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+101:2353:x1872772280519424:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015450.017862:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015450.017872:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501de1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88f0 expref: 101 pid: 5795 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015450.017896:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501de1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88f0 expref: 101 pid: 5795 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015450.017933:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501de1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88f0 expref: 101 pid: 5795 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015450.017958:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:1.0:1786015450.017963:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501e12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015450.017975:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501e12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015450.017983:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501e12 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015450.018031:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015450.018483:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501e12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015450.018494:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501e12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786015450.018658:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968031 00000001:00080000:3.0:1786015450.018968:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968032 00000100:00100000:3.0:1786015450.019314:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304418816:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786015450.019435:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015450.019489:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b02aac00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015450.019893:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+102:2353:x1872772280519424:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 2049us (4522us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015450.019906:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 336 00000100:00100000:2.0:1786015450.020008:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304418816 00000100:00100000:2.0:1786015450.020017:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304418816 00000100:00100000:2.0:1786015450.020067:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1786015450.020075:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5798:x1872772304418816:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786015450.020182:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5798:x1872772304418816:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 108us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015450.020189:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1786015450.027450:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304418816:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1786015450.027976:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968033 00000100:00100000:3.0:1786015450.028080:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304418944:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786015450.028151:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015450.028213:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304418944 00000100:00100000:3.0:1786015450.028220:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304418944 00000100:00100000:3.0:1786015450.028272:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1786015450.028282:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5798:x1872772304418944:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786015450.028461:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5798:x1872772304418944:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 178us (308us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1786015450.028469:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1786015450.028500:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872000 going to sleep for 11 seconds 00000100:00100000:3.0:1786015450.028521:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304418944:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1786015450.028571:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968034 00010000:00010000:3.0:1786015450.028599:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501e12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015450.028611:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501e12 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015450.028620:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501e12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015450.028627:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015450.028632:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501e12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015450.028641:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501e12 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015450.028672:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:3.0:1786015450.028676:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1786015450.028682:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501e12 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015450.028689:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501e12 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786015450.028925:0:5798:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x45:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1786015450.029039:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].16, 64 off9312 00000001:00080000:3.0:1786015450.029051:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968035 00010000:00010000:3.0:1786015450.029079:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:3.0:1786015450.029082:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786015450.029091:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501dfd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e88fe expref: 104 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015450.029204:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+103:28719:x1872772280519168:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 54719us (55136us total) trans 4294968036 rc 0/0 00000100:00100000:3.0:1786015450.029213:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 223 00000020:00080000:3.0:1786015450.029217:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:1.0:1786015450.285889:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304419072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015450.286031:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015450.286143:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304419072 00000100:00100000:0.0:1786015450.286154:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304419072 00000100:00100000:0.0:1786015450.286220:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1786015450.286231:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3313:x1872772304419072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015450.286262:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 78184448 pending 0 free 3857711104 avail 3854565376 00000100:00100000:0.0:1786015450.286328:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3313:x1872772304419072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015450.286336:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1786015450.286395:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304419072:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786015450.989985:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015452.013196:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015453.039325:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015453.266919:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015453.266980:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015453.267012:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015453.267037:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015453.267060:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015453.267238:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280519552 00000100:00100000:1.0:1786015453.267253:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280519552 00000100:00100000:1.0:1786015453.267326:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 583 00000100:00100000:1.0:1786015453.267340:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280519552:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015453.267439:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280519552:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 102us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015453.267447:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 583 00000100:00100000:0.0:1786015453.267908:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280520064 00000100:00100000:0.0:1786015453.267914:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280520064 00000100:00100000:0.0:1786015453.267985:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 450 00000100:00100000:0.0:1786015453.267995:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+51:2352:x1872772280520064:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015453.268053:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+51:2352:x1872772280520064:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 60us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015453.268070:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 450 00000100:00100000:2.0:1786015453.268295:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015453.268353:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015453.268379:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280519808 00000100:00100000:2.0:1786015453.268384:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280519808 00000100:00100000:2.0:1786015453.268418:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280520320 00000100:00100000:2.0:1786015453.268435:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280520320 00000100:00100000:2.0:1786015453.268454:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280519936 00000100:00100000:2.0:1786015453.268457:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280519936 00000100:00100000:2.0:1786015453.268471:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280520192 00000100:00100000:2.0:1786015453.268473:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280520192 00000100:00100000:2.0:1786015453.268490:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 433 00000100:00100000:2.0:1786015453.268497:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+15:2352:x1872772280519808:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015453.268534:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+15:2352:x1872772280519808:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015453.268540:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 433 00000100:00100000:2.0:1786015453.268556:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 434 00000100:00100000:2.0:1786015453.268561:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280520320:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015453.268588:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280520320:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015453.268594:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 434 00000100:00100000:2.0:1786015453.268607:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 435 00000100:00100000:2.0:1786015453.268613:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280519936:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015453.268636:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280519936:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015453.268642:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 435 00000100:00100000:2.0:1786015453.268656:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 436 00000100:00100000:2.0:1786015453.268662:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280520192:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015453.268687:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280520192:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015453.268694:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 436 00000100:00080000:1.0:1786015453.268947:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015453.268953:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015453.268956:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015453.269450:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280519680 00000100:00100000:0.0:1786015453.269459:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280519680 00000100:00100000:0.0:1786015453.269516:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 451 00000100:00100000:0.0:1786015453.269524:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+103:2352:x1872772280519680:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015453.269590:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+103:2352:x1872772280519680:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 67us (2528us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015453.269597:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 451 00000100:00080000:1.0:1786015453.270390:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015453.364076:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7385446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304419200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015453.364223:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015453.364347:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304419200 00000100:00100000:0.0:1786015453.364361:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304419200 00000100:00100000:0.0:1786015453.364446:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1786015453.364459:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7385447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304419200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015453.364512:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 81592320 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015453.364571:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7385447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304419200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015453.364578:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1786015453.364640:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7385446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304419200:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786015453.364867:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786015454.060499:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015454.927091:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304419456:0@lo:400:kworker.0 00000100:00100000:3.0:1786015454.928077:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015454.930878:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786015454.930900:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304419584:0@lo:400:kworker.0 00000100:00100000:3.0:1786015454.930992:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015454.948619:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304419328:0@lo:400:kworker.0 00000100:00100000:0.0:1786015454.948733:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015454.974037:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304419328 00000100:00100000:2.0:1786015454.974052:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304419328 00000100:00100000:2.0:1786015454.974126:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1786015454.974139:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304419328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015454.974268:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304419328:12345-0@lo:400:kworker.0 Request processed in 132us (25535us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015454.974277:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:3.0:1786015454.978710:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304419968:0@lo:400:kworker.0 00000100:00100000:3.0:1786015454.978875:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015454.980121:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304419456 00000100:00100000:0.0:1786015454.980139:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304419456 00000100:00100000:0.0:1786015454.980197:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304419584 00000100:00100000:0.0:1786015454.980201:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304419584 00000100:00100000:0.0:1786015454.980237:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:0.0:1786015454.980247:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304419456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015454.994021:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304419456:12345-0@lo:400:kworker.0 Request processed in 13760us (65931us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015454.994042:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:0.0:1786015454.994109:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1786015454.994126:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304419584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015454.994163:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304419584:12345-0@lo:400:kworker.0 Request processed in 45us (63173us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015454.994197:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1786015454.994269:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304419712:0@lo:400:kworker.0 00000100:00100000:0.0:1786015454.994323:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015454.996271:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304419584:0@lo:400:kworker.0 00000100:00100000:2.0:1786015454.996295:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304419456:0@lo:400:kworker.0 00000100:00080000:2.0:1786015454.996708:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015455.022203:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015455.022231:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304419840:0@lo:400:kworker.0 00000100:00100000:0.0:1786015455.022337:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015455.022414:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304419328:0@lo:400:kworker.0 00000100:00100000:2.0:1786015455.023735:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304419840 00000100:00100000:2.0:1786015455.023752:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304419840 00000100:00100000:1.0:1786015455.025116:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304419968 00000100:00100000:1.0:1786015455.025133:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304419968 00000100:00100000:2.0:1786015455.030006:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:2.0:1786015455.030036:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7385444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304419840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015455.030217:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7385444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304419840:12345-0@lo:400:kworker.0 Request processed in 194us (7879us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015455.030227:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00080000:2.0:1786015455.030579:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015455.045619:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304419712 00000100:00100000:3.0:1786015455.045644:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304419712 00000100:00100000:3.0:1786015455.045810:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:3.0:1786015455.045827:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7385446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304419712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015455.045993:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7385446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304419712:12345-0@lo:400:kworker.0 Request processed in 173us (51670us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015455.046002:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:3.0:1786015455.046120:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304419840:0@lo:400:kworker.0 00000100:00100000:3.0:1786015455.046136:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304419712:0@lo:400:kworker.0 00000100:00080000:2.0:1786015455.054613:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015455.078700:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015455.078824:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1786015455.078841:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3312:x1872772304419968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015455.079009:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3312:x1872772304419968:12345-0@lo:400:kworker.0 Request processed in 174us (100143us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015455.079019:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1786015455.079092:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304419968:0@lo:400:kworker.0 00010000:00010000:0.0:1786015455.089702:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786015455.115705:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967362 is committed 00000001:00080000:2.0:1786015455.115735:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967364 is committed 00000001:00080000:2.0:1786015455.115744:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967363 is committed 00000001:00080000:2.0:1786015455.115751:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967365 is committed 00000001:00080000:0.0:1786015455.155795:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968025 is committed 00000001:00080000:0.0:1786015455.155827:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968028 is committed 00000001:00080000:0.0:1786015455.155837:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968036 is committed 00000020:00080000:0.0:1786015455.155850:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b74b0175300 refcount 2 committed 0 result 0 batchid 22 00000020:00080000:0.0:1786015455.155856:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b7486571700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b74b0175180 00000020:00080000:0.0:1786015455.155860:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b7486571800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b7385453800 00000020:00080000:0.0:1786015455.155898:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b7384872d80 refcount 2 committed 0 result 0 batchid 21 00000020:00080000:0.0:1786015455.155902:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b7486571c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b7384872900 00000020:00080000:0.0:1786015455.155905:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b7486571600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74afaa5c00 00000020:00080000:0.0:1786015455.155951:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 22 committed batchid 20 00000020:00080000:0.0:1786015455.156251:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 20 00000004:00080000:3.0:1786015455.410067:0:7781:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690661301647ns, next at 691661298939ns, rc = 0 00000100:00100000:2.0:1786015455.410283:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304420096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015455.410395:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015455.410533:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304420096 00000100:00100000:3.0:1786015455.410544:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304420096 00000100:00100000:3.0:1786015455.410618:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1786015455.410630:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304420096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015455.410676:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 78184448 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015455.410741:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304420096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015455.410749:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1786015455.410884:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967365 gen 2 00000004:00080000:2.0:1786015455.410890:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b7385446680, transno 4294967362 00000004:00080000:2.0:1786015455.410934:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967364 committed transno 4294967365 00000004:00080000:2.0:1786015455.410958:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967365 committed transno 4294967365 00000100:00100000:2.0:1786015455.410980:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304420096:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1786015456.045435:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015456.045462:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015456.046024:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 31 count 2 00000040:00080000:2.0:1786015456.046033:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015456.109731:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015456.356843:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015456.357138:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280520448 00000100:00100000:0.0:1786015456.357152:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280520448 00000100:00100000:0.0:1786015456.357247:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1117 00000100:00100000:0.0:1786015456.357261:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+43:28667:x1872772280520448:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1786015456.357473:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015456.358448:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+43:28667:x1872772280520448:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 1184us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015456.358461:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1117 00010000:00010000:1.0:1786015457.132311:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015458.168528:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015458.376640:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015458.376712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015458.376741:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015458.376864:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015458.376895:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015458.376915:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015458.376946:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015458.377012:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280520576 00000100:00100000:3.0:1786015458.377034:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280520576 00000100:00100000:3.0:1786015458.377103:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 585 00000100:00100000:3.0:1786015458.377114:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280520576:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015458.377214:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280520576:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 101us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015458.377222:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 585 00000100:00100000:3.0:1786015458.377263:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280520960 00000100:00100000:3.0:1786015458.377268:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280520960 00000100:00100000:3.0:1786015458.377310:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280521216 00000100:00100000:3.0:1786015458.377313:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280521216 00000100:00100000:3.0:1786015458.377328:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280520832 00000100:00100000:3.0:1786015458.377330:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280520832 00000100:00100000:3.0:1786015458.377347:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280521344 00000100:00100000:3.0:1786015458.377349:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280521344 00000100:00100000:3.0:1786015458.377366:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 439 00000100:00100000:3.0:1786015458.377372:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280520960:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015458.377408:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280520960:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 36us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015458.377415:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 439 00000100:00100000:3.0:1786015458.377427:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 440 00000100:00100000:3.0:1786015458.377433:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280521216:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015458.377459:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280521216:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015458.377466:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 440 00000100:00100000:3.0:1786015458.377478:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 441 00000100:00100000:3.0:1786015458.377483:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+15:2354:x1872772280520832:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015458.377516:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+15:2354:x1872772280520832:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015458.377524:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 441 00000100:00100000:3.0:1786015458.377544:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 442 00000100:00100000:3.0:1786015458.377550:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280521344:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015458.377574:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280521344:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015458.377581:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 442 00000100:00100000:3.0:1786015458.377603:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280520704 00000100:00100000:3.0:1786015458.377607:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280520704 00000100:00100000:3.0:1786015458.377640:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280521088 00000100:00100000:3.0:1786015458.377644:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280521088 00000100:00100000:3.0:1786015458.377666:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 455 00000100:00100000:3.0:1786015458.377672:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+92:2354:x1872772280520704:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015458.377702:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+92:2354:x1872772280520704:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015458.377709:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 455 00000100:00100000:3.0:1786015458.377721:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 456 00000100:00100000:3.0:1786015458.377727:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+43:2354:x1872772280521088:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015458.377751:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+43:2354:x1872772280521088:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015458.377789:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 456 00000100:00080000:3.0:1786015458.378017:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015458.378023:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786015458.378025:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015458.477117:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304420224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015458.477224:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015458.477512:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304420224 00000100:00100000:2.0:1786015458.477523:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304420224 00000100:00100000:2.0:1786015458.477598:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1786015458.477609:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304420224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015458.477660:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 81592320 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015458.477718:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304420224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015458.477726:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:2.0:1786015458.477755:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015458.477900:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304420224:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786015459.205428:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786015459.474193:0:20081:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12o: Layout-swap failure during Restore leaves file released ========================================================== 07:24:16 (1786015456) 00000100:00100000:2.0:1786015460.009898:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015460.019618:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280521472 00000100:00100000:3.0:1786015460.019642:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280521472 00000100:00100000:3.0:1786015460.019746:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1118 00000100:00100000:3.0:1786015460.019775:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+43:29334:x1872772280521472:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1786015460.019943:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+43:29334:x1872772280521472:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 187us (10063us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015460.019952:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1118 00000100:00100000:3.0:1786015460.022949:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7385444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304420352:0@lo:400:kworker.0 00000100:00100000:3.0:1786015460.023061:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015460.029028:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7385446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304420480:0@lo:400:kworker.0 00000100:00100000:0.0:1786015460.029163:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015460.029572:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7385444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304420736:0@lo:400:kworker.0 00000100:00100000:2.0:1786015460.029624:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015460.033971:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7385447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304420864:0@lo:400:kworker.0 00000100:00100000:0.0:1786015460.036173:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304420992:0@lo:400:kworker.0 00000100:00100000:0.0:1786015460.036303:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015460.036381:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786015460.036390:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7385445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304420608:0@lo:400:kworker.0 00000100:00100000:0.0:1786015460.036423:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015460.036491:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304420480 00000100:00100000:0.0:1786015460.036503:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304420480 00000100:00100000:0.0:1786015460.040533:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304420608 00000100:00100000:0.0:1786015460.040555:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304420608 00000100:00100000:0.0:1786015460.040633:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:0.0:1786015460.040646:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304420480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015460.040806:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304420480:12345-0@lo:400:kworker.0 Request processed in 163us (11643us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015460.040846:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:0.0:1786015460.040870:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1786015460.040877:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304420608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015460.040914:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304420608:12345-0@lo:400:kworker.0 Request processed in 38us (4489us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015460.040920:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1786015460.040962:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304420736 00000100:00100000:0.0:1786015460.040967:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304420736 00000100:00100000:0.0:1786015460.041020:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304420992 00000100:00100000:0.0:1786015460.041025:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304420992 00000100:00100000:0.0:1786015460.041052:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1786015460.041058:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304420736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015460.041099:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304420736:12345-0@lo:400:kworker.0 Request processed in 41us (11475us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015460.041106:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1786015460.041117:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1786015460.041123:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304420992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015460.041151:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304420992:12345-0@lo:400:kworker.0 Request processed in 28us (4849us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015460.041156:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1786015460.041229:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7385445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304420608:0@lo:400:kworker.0 00000100:00100000:0.0:1786015460.041244:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7385446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304420480:0@lo:400:kworker.0 00000100:00100000:0.0:1786015460.041254:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304420992:0@lo:400:kworker.0 00000100:00100000:3.0:1786015460.041395:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304420352 00000100:00100000:3.0:1786015460.041400:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304420352 00000100:00100000:3.0:1786015460.041432:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:3.0:1786015460.041439:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304420352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015460.041492:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304420352:12345-0@lo:400:kworker.0 Request processed in 54us (18433us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015460.041498:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:3.0:1786015460.044585:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015460.044662:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304420864 00000100:00100000:3.0:1786015460.044673:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304420864 00000100:00100000:3.0:1786015460.044745:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:3.0:1786015460.044757:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304420864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015460.045985:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7385444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304420736:0@lo:400:kworker.0 00000100:00080000:2.0:1786015460.046655:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015460.046677:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015460.046681:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015460.046858:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015460.047639:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280521600 00000100:00100000:0.0:1786015460.047667:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280521600 00000100:00100000:0.0:1786015460.047827:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1119 00000100:00100000:0.0:1786015460.047859:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+92:29335:x1872772280521600:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015460.047894:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015460.047930:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501e19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8905 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.048304:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501e20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.048324:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501e20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.048342:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501e20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.048360:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501e27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.048368:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501e27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.048375:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501e27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.048710:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501e20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.048721:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501e20 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.048728:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501e20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.048741:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015460.048747:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501e20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.048757:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501e20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.048802:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:0.0:1786015460.048805:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015460.048810:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501e20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786015460.049720:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015460.052949:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7385444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304420352:0@lo:400:kworker.0 00010000:00010000:0.0:1786015460.054107:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501e20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.054145:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501e27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.054152:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501e27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.054161:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501e27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.054168:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015460.054173:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501e27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.054183:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501e27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.054231:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1420b2e (ffff8b748f24ac00) 00010000:00010000:0.0:1786015460.054235:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015460.054241:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501e27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.054248:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501e27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.054327:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501e19 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8905 expref: 93 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.054342:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:0.0:1786015460.054344:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015460.054349:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501e19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8905 expref: 93 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.054359:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afcc00, rc 0) 00000100:00100000:0.0:1786015460.054611:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+92:29335:x1872772280521600:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 6770us (7755us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015460.054623:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1119 00000100:00100000:3.0:1786015460.060489:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304420864:12345-0@lo:400:kworker.0 Request processed in 15718us (15897us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015460.060510:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:3.0:1786015460.060604:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7385447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304420864:0@lo:400:kworker.0 00000100:00100000:3.0:1786015460.066506:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015460.068425:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280521856 00000100:00100000:1.0:1786015460.068448:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280521856 00000100:00100000:1.0:1786015460.068531:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1120 00000100:00100000:1.0:1786015460.068543:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+92:29335:x1872772280521856:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:1.0:1786015460.068644:0:12526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015460.068684:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501c28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8872 expref: 92 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.068707:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:1.0:1786015460.068714:0:12526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015460.069259:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e2e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.069283:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c52 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8880 expref: 42 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.069298:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e2e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.069343:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8880 expref: 42 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.069362:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8880 expref: 42 pid: 7673 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015460.069380:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304421120:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015460.069505:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7485a7c600 going to sleep for 11 seconds 00000100:00100000:1.0:1786015460.074947:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015460.075001:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280521984 00000100:00100000:1.0:1786015460.075014:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280521984 00010000:00010000:1.0:1786015460.075073:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c52 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8880 expref: 43 pid: 7673 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015460.075122:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 337 00000100:00100000:1.0:1786015460.075134:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:2354:x1872772280521984:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015460.075154:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015460.075162:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c52 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8880 expref: 43 pid: 7673 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.075179:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8880 expref: 43 pid: 7673 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.075213:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:1.0:1786015460.075219:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e2e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.075231:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.075240:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e2e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.075262:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015460.075323:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+43:2354:x1872772280521984:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 191us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015460.075332:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 337 00010000:00010000:2.0:1786015460.077471:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501c52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8880 expref: 42 pid: 7673 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015460.077501:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304421120:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015460.077534:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.077749:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.081049:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.081116:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501e35 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.081166:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501e35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.081184:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501e35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015460.083527:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x46:0x0]: returning size 512 00010000:00010000:0.0:1786015460.085486:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.085508:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e2e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.085518:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.085527:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015460.085532:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.085543:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e2e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.085567:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b749232d500) 00010000:00010000:0.0:1786015460.085571:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015460.085577:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e2e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.085585:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e2e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015460.085663:0:12526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000098801b2d reply state 0000000037d386ad transno 4294968037 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501e35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015460.085677:0:12526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015460.086965:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+93:29335:x1872772280521856:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 18406us (20459us total) trans 4294968037 rc 0/0 00000100:00100000:0.0:1786015460.086984:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1120 00010000:00010000:1.0:1786015460.096541:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501e35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.096567:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501e35 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.096577:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501e35 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.096584:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015460.096590:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501e35 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.096601:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501e35 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.096634:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1420b2e (ffff8b748f24ac00) 00010000:00010000:1.0:1786015460.096637:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015460.096643:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501e35 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.096650:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501e35 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015460.106334:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015460.108421:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280522112 00000100:00100000:0.0:1786015460.108444:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280522112 00000100:00100000:0.0:1786015460.108553:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1121 00000100:00100000:0.0:1786015460.108566:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+92:29336:x1872772280522112:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1786015460.108607:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015460.108642:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501e3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e890c expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.108788:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501e43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.108809:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501e43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.108834:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501e43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015460.108928:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1786015460.108933:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015460.108966:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501e43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.109043:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501e3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e890c expref: 94 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.109067:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501e43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e890c expref: 93 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.109079:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a600) 00010000:00010000:0.0:1786015460.109082:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015460.109086:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc000, rc 0) 00000100:00100000:0.0:1786015460.109193:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+93:29336:x1872772280522112:12345-192.168.202.56@tcp:101:bash.0 Request processed in 628us (2878us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015460.109202:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1121 00000100:00100000:1.0:1786015460.114066:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015460.116360:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280522240 00000100:00100000:3.0:1786015460.116387:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280522240 00000100:00100000:3.0:1786015460.116516:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1122 00000100:00100000:3.0:1786015460.116530:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+93:29336:x1872772280522240:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1786015460.116567:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015460.116602:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501e4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8913 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.116730:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.116748:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.116789:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.116806:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.116825:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.116832:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118618:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501e5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118642:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118669:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015460.118741:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x46:0x0]: returning size 512 00000004:00200000:3.0:1786015460.118744:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015460.118776:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118789:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118794:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118799:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118803:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015460.118806:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118810:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118831:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a600) 00010000:00010000:3.0:1786015460.118834:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015460.118839:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118844:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118874:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118881:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118887:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118892:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015460.118894:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118898:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118904:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1420b2e (ffff8b74a04b5500) 00010000:00010000:3.0:1786015460.118905:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015460.118908:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118912:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118958:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501e4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8913 expref: 95 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118968:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbda00/0xb1a5ef690c501e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8913 expref: 94 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.118982:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:3.0:1786015460.118984:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786015460.118986:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbda00, rc 0) 00000100:00100000:3.0:1786015460.119073:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+94:29336:x1872772280522240:12345-192.168.202.56@tcp:101:bash.0 Request processed in 2546us (5025us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015460.119080:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1122 00000100:00100000:3.0:1786015460.123718:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015460.123962:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280522368 00000100:00100000:1.0:1786015460.123976:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280522368 00000100:00100000:1.0:1786015460.124088:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1123 00000100:00100000:1.0:1786015460.124099:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+94:29336:x1872772280522368:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1786015460.124130:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015460.124159:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501e66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e891a expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124251:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501e6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124265:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501e6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124280:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501e6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124293:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124298:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124304:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124381:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501e6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124386:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501e6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124392:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501e6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124397:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015460.124400:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501e6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124405:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501e6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124414:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:1.0:1786015460.124416:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015460.124420:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501e6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124425:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501e6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124434:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124437:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124441:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124444:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015460.124446:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124449:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124452:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff8b7483ee6a00) 00010000:00010000:1.0:1786015460.124454:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015460.124455:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124458:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501e74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124483:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501e66 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e891a expref: 95 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124493:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:1.0:1786015460.124495:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015460.124497:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501e66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e891a expref: 95 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.124505:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47000, rc 0) 00000100:00100000:1.0:1786015460.124568:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+94:29336:x1872772280522368:12345-192.168.202.56@tcp:101:bash.0 Request processed in 471us (862us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015460.124577:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1123 00000020:00080000:2.0:1786015460.126594:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 22 batchid updated 00000020:00080000:0.0:1786015460.126646:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 22 00000020:00080000:0.0:1786015460.126667:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 22 00000004:00080000:2.0:1786015460.126724:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 20 committed 00000100:00100000:1.0:1786015460.127084:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786015460.127114:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304421248:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786015460.127216:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015460.127292:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304421248 00000100:00100000:2.0:1786015460.127306:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304421248 00000100:00100000:2.0:1786015460.127388:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1786015460.127402:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304421248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786015460.127455:0:11384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:24 count 1 00002000:00010000:2.0:1786015460.127515:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 158, mtime: 0x5b965aa7, atime: 0x6a746c46, ctime: 0x6a746ed9, blocks: 0xb 00010000:00010000:2.0:1786015460.127525:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501e7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.127548:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=695s v=(0 0) 00010000:00010000:2.0:1786015460.127554:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015460.127562:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501e7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.127608:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501e7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.127620:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501e7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.127629:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501e7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.127790:0:11384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786015460.129266:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786015460.129280:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501e7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.129296:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906e00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015460.129302:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501e7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.129315:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501e7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.129342:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501e7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.129351:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000142cecf3/0xb1a5ef690c501e7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.129373:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015460.129375:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015460.129376:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015460.129591:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304421248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2187us (2370us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1786015460.129603:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000004:00080000:2.0:1786015460.134471:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b7384fdea00/2, rc 0, transno 4294967366 00000100:00100000:2.0:1786015460.134492:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304421248:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786015460.137243:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000040:00080000:0.0:1786015460.140129:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015460.140331:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015460.141067:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1786015460.141080:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015460.143621:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280522496 00000100:00100000:1.0:1786015460.143647:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280522496 00000100:00100000:0.0:1786015460.145378:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1124 00000100:00100000:0.0:1786015460.145398:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+42:29337:x1872772280522496:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:0.0:1786015460.145428:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015460.145463:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501e82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8921 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.145570:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501e89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.145611:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501e89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.145626:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501e89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015460.145732:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1786015460.145737:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015460.145839:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501e89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.145871:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501e82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8921 expref: 44 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.145893:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501e89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8921 expref: 43 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.145901:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a600) 00010000:00010000:0.0:1786015460.145904:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015460.145907:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd400, rc 0) 00000100:00100000:0.0:1786015460.146012:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+43:29337:x1872772280522496:12345-192.168.202.56@tcp:101:rm.0 Request processed in 621us (8787us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015460.146019:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1124 00000100:00100000:0.0:1786015460.163953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015460.164133:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280522624 00000100:00100000:3.0:1786015460.164150:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280522624 00000100:00100000:3.0:1786015460.164257:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1125 00000100:00100000:3.0:1786015460.164272:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+43:29337:x1872772280522624:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015460.164311:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015460.164348:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501e90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8928 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.164466:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.164488:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.164504:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.164566:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.164576:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.164584:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.164977:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501ea5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.164990:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.164998:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015460.165129:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x46:0x0]: returning size 512 00000004:00200000:3.0:1786015460.165133:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015460.165169:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.165185:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.165192:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.165200:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.165220:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015460.165226:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.165235:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.165251:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a600) 00010000:00010000:3.0:1786015460.165254:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015460.165261:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.165267:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501e97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.165282:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.165288:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.165294:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.165299:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015460.165301:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.165308:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.165327:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1420b2e (ffff8b74a04b5500) 00010000:00010000:3.0:1786015460.165335:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015460.165338:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.165344:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501e9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.165387:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501e90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8928 expref: 45 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.165404:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd400/0xb1a5ef690c501ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8928 expref: 44 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.165412:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:3.0:1786015460.165414:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786015460.165416:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd400, rc 0) 00000100:00100000:3.0:1786015460.165534:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29337:x1872772280522624:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1264us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015460.170151:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1125 00000100:00100000:2.0:1786015460.180174:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015460.180617:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280522752 00000100:00100000:1.0:1786015460.180639:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280522752 00000100:00100000:1.0:1786015460.180744:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1126 00000100:00100000:1.0:1786015460.180811:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29337:x1872772280522752:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:1.0:1786015460.180850:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015460.180890:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501eac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e892f expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.180986:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501eb3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181005:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181020:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181037:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501eba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181045:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501eba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181051:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501eba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181145:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181152:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501eb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181163:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181170:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015460.181174:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181182:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501eb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181195:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:1.0:1786015460.181198:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015460.181202:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501eb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181208:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c501eb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181221:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501eba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181227:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501eba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181233:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501eba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181237:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015460.181239:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501eba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181248:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501eba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181258:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff8b7483ee6a00) 00010000:00010000:1.0:1786015460.181260:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015460.181263:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501eba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181268:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c501eba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181307:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501eac lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e892f expref: 45 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181316:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:1.0:1786015460.181318:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015460.181321:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c501eac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e892f expref: 45 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.181329:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47000, rc 0) 00000100:00100000:2.0:1786015460.181499:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29337:x1872772280522752:12345-192.168.202.56@tcp:101:rm.0 Request processed in 733us (1329us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015460.181517:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1126 00000100:00100000:2.0:1786015460.193993:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015460.194798:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280522880 00000100:00100000:3.0:1786015460.194848:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280522880 00000100:00100000:3.0:1786015460.194936:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1127 00000100:00100000:3.0:1786015460.194948:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29337:x1872772280522880:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015460.194982:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015460.195018:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501ec1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8936 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195166:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501ec8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195187:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195201:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195219:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501ecf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195226:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195232:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195333:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195341:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501ec8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195348:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195355:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015460.195360:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195380:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501ec8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195397:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:3.0:1786015460.195401:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015460.195406:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501ec8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195414:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c501ec8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195432:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195439:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501ecf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195446:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501ecf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195451:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015460.195454:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501ecf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195460:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501ecf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195467:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff8b74a04b5500) 00010000:00010000:3.0:1786015460.195470:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015460.195473:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501ecf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195490:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c501ecf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195532:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501ec1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8936 expref: 45 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195544:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:3.0:1786015460.195546:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015460.195697:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501ec1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8936 expref: 45 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.195711:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc200, rc 0) 00000100:00100000:3.0:1786015460.195863:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29337:x1872772280522880:12345-192.168.202.56@tcp:101:rm.0 Request processed in 915us (1886us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015460.195874:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1127 00010000:00010000:1.0:1786015460.205810:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015460.234681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015460.235309:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280523008 00000100:00100000:0.0:1786015460.235325:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280523008 00000100:00100000:0.0:1786015460.235405:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1128 00000100:00100000:0.0:1786015460.235416:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29338:x1872772280523008:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015460.235462:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015460.235488:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501ed6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e893d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235571:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501edd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235589:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501edd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235603:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501edd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235619:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501ee4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235624:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235629:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235730:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501edd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235737:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501edd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235741:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501edd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235746:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015460.235755:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501edd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235780:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501edd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235793:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:0.0:1786015460.235796:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015460.235800:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501edd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235805:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501edd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235831:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235838:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501ee4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235844:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235853:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015460.235856:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235863:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501ee4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235871:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff8b748f24af00) 00010000:00010000:0.0:1786015460.235873:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015460.235883:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501ee4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235889:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501ee4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235936:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501ed6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e893d expref: 45 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235949:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:0.0:1786015460.235957:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015460.235961:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501ed6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e893d expref: 45 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.235975:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc200, rc 0) 00000100:00100000:0.0:1786015460.236226:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29338:x1872772280523008:12345-192.168.202.56@tcp:101:cp.0 Request processed in 810us (1560us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015460.236237:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1128 00000100:00100000:2.0:1786015460.245927:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015460.246720:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280523136 00000100:00100000:0.0:1786015460.246738:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280523136 00000100:00100000:0.0:1786015460.246878:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1129 00000100:00100000:0.0:1786015460.246892:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29338:x1872772280523136:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015460.246925:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015460.246959:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501eeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8944 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247060:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501ef2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247100:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501ef2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247115:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501ef2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247535:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501ef9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247547:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247554:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247660:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501ef2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247668:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501ef2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247675:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501ef2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247682:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015460.247687:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501ef2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247695:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501ef2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247710:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:0.0:1786015460.247721:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015460.247728:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501ef2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247736:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501ef2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247754:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247807:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501ef9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247824:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247829:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015460.247832:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247838:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247846:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff8b748f24a300) 00010000:00010000:0.0:1786015460.247848:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015460.247851:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501ef9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247856:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501ef9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247906:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501eeb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8944 expref: 45 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247925:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:0.0:1786015460.247928:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015460.247932:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c501eeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8944 expref: 45 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.247944:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afce00, rc 0) 00000100:00100000:0.0:1786015460.248044:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29338:x1872772280523136:12345-192.168.202.56@tcp:101:cp.0 Request processed in 1154us (2138us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015460.248054:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1129 00000100:00100000:3.0:1786015460.258052:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015460.258384:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280523392 00000100:00100000:0.0:1786015460.258398:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280523392 00000100:00100000:0.0:1786015460.258484:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1130 00000100:00100000:0.0:1786015460.258497:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29338:x1872772280523392:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015460.258527:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015460.258570:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501f00 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e894b expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.258754:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501f07 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.258805:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501f07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.258852:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501f07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.258873:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501f0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.258900:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501f0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.258909:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501f0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786015460.269073:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x16:0x0], index 0: 0 00010000:00010000:2.0:1786015460.269369:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501f15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.269391:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501f15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.269406:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501f15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.269470:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501f07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.269479:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501f07 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.269486:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501f07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.269494:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015460.269499:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501f07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.269508:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501f07 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.269523:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:2.0:1786015460.269527:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015460.269533:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501f07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.269539:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c501f07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015460.269556:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000089819fdf reply state 000000001df3d753 transno 4294968038 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501f0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015460.269567:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786015460.269620:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c501f00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e894b expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.269651:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501f15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e894b expref: 46 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.269661:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232d000) 00010000:00010000:2.0:1786015460.269663:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015460.269666:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906000, rc 0) 00000100:00100000:2.0:1786015460.269868:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:29338:x1872772280523392:12345-192.168.202.56@tcp:101:cp.0 Request processed in 11373us (11835us total) trans 4294968038 rc 0/0 00000100:00100000:2.0:1786015460.269879:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1130 00010000:00010000:1.0:1786015460.282971:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501f0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.282995:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501f0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.283002:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501f0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.283010:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015460.283017:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501f0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.283028:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501f0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.283051:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff8b748f24af00) 00010000:00010000:1.0:1786015460.283055:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015460.283061:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501f0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.283068:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c501f0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015460.283275:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015460.283360:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280523520 00000100:00100000:0.0:1786015460.283372:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280523520 00000100:00080000:2.0:1786015460.283435:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015460.283458:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 299 00000100:00100000:0.0:1786015460.283471:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280523520:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015460.283493:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015460.283514:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b59939b/0xb1a5ef690c501f23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8952 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015460.283542:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786015460.283570:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=695s v=(0 0) 00010000:00010000:0.0:1786015460.283576:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015460.283588:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b59939b/0xb1a5ef690c501f23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8952 expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.283607:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002b59939b/0xb1a5ef690c501f23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8952 expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.283621:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afce00, rc 0) 00000100:00100000:0.0:1786015460.283693:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280523520:12345-192.168.202.56@tcp:101:cp.0 Request processed in 226us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015460.283719:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 299 00000100:00100000:0.0:1786015460.292376:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015460.292589:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280523648 00000100:00100000:3.0:1786015460.292607:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280523648 00000100:00100000:3.0:1786015460.292689:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 300 00000100:00100000:3.0:1786015460.292702:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:29338:x1872772280523648:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015460.292732:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015460.292756:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000677e1dc6/0xb1a5ef690c501f2a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8959 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.292861:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b59939b/0xb1a5ef690c501f23 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8952 expref: 10 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.292909:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015460.292916:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015460.292924:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000677e1dc6/0xb1a5ef690c501f2a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8959 expref: 10 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.292983:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b59939b/0xb1a5ef690c501f23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8952 expref: 10 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.293010:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b59939b/0xb1a5ef690c501f23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8952 expref: 10 pid: 6590 timeout: 795 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015460.293029:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304421376:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015460.293167:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d060c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015460.298712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015460.298894:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280523776 00000100:00100000:1.0:1786015460.298920:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280523776 00010000:00010000:1.0:1786015460.299007:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b59939b/0xb1a5ef690c501f23 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8952 expref: 11 pid: 6590 timeout: 795 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015460.299081:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 338 00000100:00100000:1.0:1786015460.299094:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280523776:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015460.299116:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015460.299155:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b59939b/0xb1a5ef690c501f23 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8952 expref: 11 pid: 6590 timeout: 795 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.299173:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b59939b/0xb1a5ef690c501f23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8952 expref: 11 pid: 6590 timeout: 795 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.299214:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015460.299221:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015460.299233:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000677e1dc6/0xb1a5ef690c501f2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8959 expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.299245:0:17038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000677e1dc6/0xb1a5ef690c501f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8959 expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015460.299299:0:17038:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000677e1dc6/0xb1a5ef690c501f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8959 expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015460.299317:0:17038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:17038:1872772304421504:192.168.202.56@tcp:105: 00000100:00100000:1.0:1786015460.299430:0:17038:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b014f240 going to sleep for 11 seconds 00010000:00010000:0.0:1786015460.299749:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b59939b/0xb1a5ef690c501f23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8952 expref: 11 pid: 6590 timeout: 795 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015460.299807:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304421376:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015460.299859:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000677e1dc6/0xb1a5ef690c501f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8959 expref: 10 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.299874:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc600, rc 0) 00000100:00100000:0.0:1786015460.299928:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:29338:x1872772280523648:12345-192.168.202.56@tcp:101:cp.0 Request processed in 7228us (7569us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015460.299938:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 300 00000100:00100000:1.0:1786015460.305224:0:17038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:17038:1872772304421504:192.168.202.56@tcp:105: 00010000:00010000:1.0:1786015460.305267:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015460.305352:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280523776:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 6259us (6672us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015460.305367:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 338 00000100:00100000:3.0:1786015460.318960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015460.319254:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280524032 00000100:00100000:0.0:1786015460.319267:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280524032 00000100:00100000:0.0:1786015460.319364:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 224 00000100:00100000:0.0:1786015460.319377:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+46:29338:x1872772280524032:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:0.0:1786015460.319984:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:29338:x1872772280524032:12345-192.168.202.56@tcp:35:cp.0 Request processed in 606us (1039us total) trans 4294968039 rc 0/0 00000100:00100000:0.0:1786015460.320008:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 224 00000100:00100000:3.0:1786015460.395066:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015460.395166:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280524160 00000100:00100000:2.0:1786015460.395182:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280524160 00000100:00100000:2.0:1786015460.395270:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1131 00000100:00100000:2.0:1786015460.395283:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916a3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+94:29341:x1872772280524160:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015460.395316:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015460.395354:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501f31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8960 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.395454:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501f38 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.395474:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501f38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.395488:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501f38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.395531:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501f3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.395539:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.395547:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.395689:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501f46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.395699:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501f46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.395706:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501f46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015460.395751:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00000004:00200000:2.0:1786015460.395756:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015460.396186:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501f46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.396202:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501f46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.396211:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501f38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.396219:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501f38 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.396241:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501f38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.396247:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015460.396251:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501f38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.396260:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501f38 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.396275:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:2.0:1786015460.396279:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015460.396284:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501f38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.396291:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c501f38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.396308:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.396314:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501f3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.396320:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501f3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.396325:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015460.396328:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501f3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.396344:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501f3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.396352:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff8b749232d500) 00010000:00010000:2.0:1786015460.396354:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015460.396357:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501f3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.396363:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c501f3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.396402:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c501f31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8960 expref: 96 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.396417:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501f46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8960 expref: 95 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015460.396425:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232d000) 00010000:00010000:2.0:1786015460.396427:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015460.396429:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907600, rc 0) 00000100:00100000:2.0:1786015460.396565:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916a3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+95:29341:x1872772280524160:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1284us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015460.396574:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1131 00000100:00100000:2.0:1786015460.406025:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015460.406185:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280524288 00000100:00100000:3.0:1786015460.406199:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280524288 00000100:00100000:3.0:1786015460.406292:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 301 00000100:00100000:3.0:1786015460.406304:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+15:2351:x1872772280524288:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015460.406333:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015460.406357:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c501f4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8967 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015460.406472:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fdc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304421632:192.168.202.56@tcp:106: 00000100:00080000:2.0:1786015460.406640:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015460.406698:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06d80 going to sleep for 11 seconds 00002000:00010000:0.0:1786015460.412255:0:11384:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb size: 0 -> 158 00002000:00010000:0.0:1786015460.412270:0:11384:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb mtime: 0 -> 1786015460 00002000:00010000:0.0:1786015460.412273:0:11384:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb atime: 0 -> 1786015460 00002000:00010000:0.0:1786015460.412276:0:11384:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb ctime: 0 -> 1786015460 00000100:00100000:0.0:1786015460.412312:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fdc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304421632:192.168.202.56@tcp:106: 00010000:00010000:0.0:1786015460.412387:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c501f4d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8967 expref: 16 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.412422:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c501f4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8967 expref: 16 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.412440:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc400, rc 0) 00000100:00100000:0.0:1786015460.412584:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+15:2351:x1872772280524288:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 6281us (6573us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015460.412596:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 301 00000100:00100000:1.0:1786015460.420648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015460.420943:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280524416 00000100:00100000:3.0:1786015460.420958:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280524416 00000100:00100000:3.0:1786015460.421043:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1132 00000100:00100000:3.0:1786015460.421055:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+95:29341:x1872772280524416:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015460.421087:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015460.421124:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c501f54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e896e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.421240:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c501f5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.421260:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c501f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.421276:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c501f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015460.421368:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x46:0x0]: returning size 512 00000004:00200000:3.0:1786015460.421373:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015460.421403:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c501f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.421436:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c501f54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e896e expref: 97 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.421460:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c501f5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e896e expref: 96 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015460.421494:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:3.0:1786015460.421497:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015460.421502:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd600, rc 0) 00000100:00100000:3.0:1786015460.421600:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+96:29341:x1872772280524416:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 546us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015460.421608:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1132 00000100:00100000:2.0:1786015460.429679:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015460.430234:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280524544 00000100:00100000:1.0:1786015460.430248:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280524544 00000100:00100000:1.0:1786015460.430314:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 302 00000100:00100000:1.0:1786015460.430324:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+15:2353:x1872772280524544:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015460.430343:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015460.430364:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ca44aba/0xb1a5ef690c501f62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8975 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015460.430426:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304421760:192.168.202.56@tcp:106: 00000100:00100000:1.0:1786015460.430520:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b014f240 going to sleep for 11 seconds 00000100:00100000:0.0:1786015460.438006:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304421760:192.168.202.56@tcp:106: 00010000:00010000:0.0:1786015460.438052:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000ca44aba/0xb1a5ef690c501f62 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8975 expref: 16 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.438083:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ca44aba/0xb1a5ef690c501f62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8975 expref: 16 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015460.438098:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47000, rc 0) 00000100:00100000:0.0:1786015460.438168:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+15:2353:x1872772280524544:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 7845us (8500us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015460.438178:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 302 00000100:00100000:3.0:1786015460.451521:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015460.451653:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280524800 00000100:00100000:2.0:1786015460.451665:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280524800 00000100:00100000:2.0:1786015460.451751:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1133 00000100:00100000:2.0:1786015460.451803:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+96:29341:x1872772280524800:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:2.0:1786015460.452272:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].31, 136 off12408 00000100:00100000:2.0:1786015460.452530:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+96:29341:x1872772280524800:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 767us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015460.452539:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1133 00000100:00100000:2.0:1786015460.525575:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304421888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015460.525654:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015460.528267:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304421888 00000100:00100000:0.0:1786015460.528284:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304421888 00000100:00100000:0.0:1786015460.528375:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1786015460.528386:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304421888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015460.528447:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 78184448 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015460.528536:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304421888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (2883us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015460.528542:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1786015460.528625:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304421888:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1786015461.166456:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015461.166542:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015461.166595:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 32 count 3 00000040:00080000:2.0:1786015461.166605:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015461.167281:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304422016:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786015461.167413:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b8e29300 going to sleep for 11 seconds 00000100:00100000:0.0:1786015461.178264:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304422016:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015461.179744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015461.179975:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280524928 00000100:00100000:0.0:1786015461.179989:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280524928 00000100:00100000:0.0:1786015461.180060:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1134 00000100:00100000:0.0:1786015461.180081:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+47:29351:x1872772280524928:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015461.180316:0:7673:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015461.180629:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+47:29351:x1872772280524928:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 557us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015461.180638:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1134 00000100:00100000:1.0:1786015461.185297:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015461.186228:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280525184 00000100:00100000:0.0:1786015461.186244:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280525184 00000100:00100000:0.0:1786015461.186326:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1135 00000100:00100000:0.0:1786015461.186336:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+47:29351:x1872772280525184:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015461.186366:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015461.186395:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501f69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e897c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.186533:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501f70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.186550:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501f70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.186588:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501f70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015461.186602:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:0.0:1786015461.186787:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501f69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e897c expref: 50 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.186820:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501f70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e897c expref: 49 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.186831:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232d000) 00010000:00010000:0.0:1786015461.186834:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015461.186838:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afcc00, rc 0) 00000100:00100000:0.0:1786015461.186920:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+49:29351:x1872772280525184:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 586us (1639us total) trans 4294968040 rc 0/0 00000100:00100000:0.0:1786015461.186928:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1135 00000100:00100000:3.0:1786015461.198230:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015461.198662:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015461.199079:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280525440 00000100:00100000:2.0:1786015461.199099:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280525312 00000100:00100000:2.0:1786015461.199104:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280525312 00000100:00100000:0.0:1786015461.199104:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280525440 00000100:00100000:0.0:1786015461.199186:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 50 00000100:00100000:0.0:1786015461.199202:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+49:2352:x1872772280525440:12345-192.168.202.56@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1786015461.199215:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 303 00000100:00100000:2.0:1786015461.199222:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280525312:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786015461.199226:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015461.199257:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501f70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e897c expref: 49 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015461.199270:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c501f7e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.199278:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232d000) 00010000:00010000:0.0:1786015461.199284:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015461.199291:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000677e1dc6/0xb1a5ef690c501f2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8959 expref: 9 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015461.199300:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x16:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786015461.199304:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786015461.199315:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c501f7e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015461.199354:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000677e1dc6/0xb1a5ef690c501f2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8959 expref: 9 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015461.199359:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+48:2352:x1872772280525440:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 164us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015461.199367:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 50 00010000:00010000:2.0:1786015461.199371:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000677e1dc6/0xb1a5ef690c501f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8959 expref: 9 pid: 6592 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015461.199388:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304422144:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015461.199457:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b8e29300 going to sleep for 11 seconds 00000100:00100000:0.0:1786015461.206195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015461.206338:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304422144:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015461.206378:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c501f7e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015461.206578:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280525568 00000100:00100000:3.0:1786015461.206589:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280525568 00002000:00100000:3.0:1786015461.206664:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x16:0x0] (0->157) req@ffff8b7384fe4a80 x1872772280525568/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:307/0 lens 648/0 e 0 to 0 dl 1786015472 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015461.206675:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384fe4a80 with x1872772280525568 ext(0->157) 00010000:00010000:3.0:1786015461.206686:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000677e1dc6/0xb1a5ef690c501f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8959 expref: 10 pid: 6592 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015461.206714:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000677e1dc6/0xb1a5ef690c501f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8959 expref: 10 pid: 6592 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015461.206723:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b7384fe4a80 00000100:00100000:3.0:1786015461.206788:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:3.0:1786015461.206800:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280525568:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:3.0:1786015461.207594:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280525568:12345-192.168.202.56@tcp:4:cp.0 Request processed in 793us (1413us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1786015461.207605:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 12 00002000:00100000:3.0:1786015461.207614:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x16:0x0] (0->157) req@ffff8b7384fe4a80 x1872772280525568/t4294967354(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:307/0 lens 648/448 e 0 to 0 dl 1786015472 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015461.207624:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384fe4a80 with x1872772280525568 ext(0->157) 00010000:00010000:3.0:1786015461.207633:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000677e1dc6/0xb1a5ef690c501f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8959 expref: 12 pid: 6592 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015461.207651:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000677e1dc6/0xb1a5ef690c501f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8959 expref: 12 pid: 6592 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015461.207661:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b7384fe4a80 00000100:00100000:0.0:1786015461.227225:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015461.227293:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280525696 00000100:00100000:0.0:1786015461.227306:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280525696 00010000:00010000:0.0:1786015461.227358:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000677e1dc6/0xb1a5ef690c501f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8959 expref: 12 pid: 6592 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015461.227410:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 339 00000100:00100000:0.0:1786015461.227424:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280525696:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015461.227444:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015461.228059:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000677e1dc6/0xb1a5ef690c501f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8959 expref: 12 pid: 6592 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.228141:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000677e1dc6/0xb1a5ef690c501f2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8959 expref: 12 pid: 6592 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.228175:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000677e1dc6/0xb1a5ef690c501f2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8959 expref: 12 pid: 6592 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.228198:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015461.228204:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015461.228212:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c501f7e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.228237:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c501f7e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.228276:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015461.228349:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280525696:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 928us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015461.228359:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 339 00010000:00010000:0.0:1786015461.228404:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c501f7e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.228416:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c501f7e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.228447:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c501f7e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.228457:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c501f7e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.228467:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c501f7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.230127:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906e00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015461.230136:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c501f7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.230169:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c501f7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.230191:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c501f7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.230201:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000142cecf3/0xb1a5ef690c501f7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015461.230307:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280525312:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 31080us (31641us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015461.230319:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 303 00010000:00010000:0.0:1786015461.240829:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015461.246746:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015461.246842:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280525952 00000100:00100000:0.0:1786015461.246857:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280525952 00000100:00100000:0.0:1786015461.246944:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1136 00000100:00100000:0.0:1786015461.246958:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:29351:x1872772280525952:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015461.247126:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:29351:x1872772280525952:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 171us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015461.247135:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1136 00000040:00080000:2.0:1786015461.248853:0:20130:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015461.248866:0:20130:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015461.249601:0:20130:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 32 count 3 00000040:00080000:2.0:1786015461.249612:0:20130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015461.274836:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015461.274885:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280526080 00000100:00100000:1.0:1786015461.278517:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280526080 00000100:00100000:1.0:1786015461.278702:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 304 00000100:00100000:1.0:1786015461.278717:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280526080:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015461.278744:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015461.278790:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c164013/0xb1a5ef690c501f85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8983 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015461.278845:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 158, mtime: 0x6a746ee4, atime: 0x0, ctime: 0x6a746ee4, blocks: 0x1 00010000:00010000:1.0:1786015461.278876:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=696s v=(0 0) 00010000:00010000:1.0:1786015461.278881:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015461.278905:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c164013/0xb1a5ef690c501f85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8983 expref: 11 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015461.278934:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c164013/0xb1a5ef690c501f85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8983 expref: 11 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015461.278952:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46e00, rc 0) 00000100:00100000:1.0:1786015461.279056:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280526080:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 341us (4235us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015461.279065:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 304 00000100:00100000:0.0:1786015461.296932:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015461.298663:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280526336 00000100:00100000:1.0:1786015461.298683:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280526336 00000100:00100000:1.0:1786015461.298785:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1137 00000100:00100000:1.0:1786015461.298813:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+48:29351:x1872772280526336:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786015461.300040:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+48:29351:x1872772280526336:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 1235us (3117us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015461.300056:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1137 00000100:00100000:1.0:1786015461.314506:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015461.325829:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280526464 00000100:00100000:3.0:1786015461.325861:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280526464 00002000:00100000:3.0:1786015461.325958:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x16:0x0] (0->4095) req@ffff8b74bf4bf480 x1872772280526464/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:307/0 lens 488/0 e 0 to 0 dl 1786015472 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015461.325975:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74bf4bf480 with x1872772280526464 ext(0->4095) 00002000:00010000:3.0:1786015461.325986:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74bf4bf480 00000100:00100000:3.0:1786015461.326443:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 101 00000100:00100000:3.0:1786015461.326457:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280526464:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1786015461.327386:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280526464:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 925us (12887us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786015461.327397:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 101 00002000:00100000:3.0:1786015461.327421:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x16:0x0] (0->4095) req@ffff8b74bf4bf480 x1872772280526464/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:307/0 lens 488/4536 e 0 to 0 dl 1786015472 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015461.327433:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74bf4bf480 with x1872772280526464 ext(0->4095) 00002000:00010000:3.0:1786015461.327439:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74bf4bf480 00000100:00100000:1.0:1786015461.342588:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015461.347917:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280526592 00000100:00100000:3.0:1786015461.347942:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280526592 00000100:00100000:3.0:1786015461.348026:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1138 00000100:00100000:3.0:1786015461.348040:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+48:29351:x1872772280526592:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015461.348079:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015461.348110:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501f8c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e898a expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015461.348169:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501f93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015461.348188:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501f93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015461.348403:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501f93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015461.348535:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501f8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e898a expref: 50 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015461.348556:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501f93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e898a expref: 49 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015461.348567:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232d000) 00010000:00010000:3.0:1786015461.348577:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786015461.348582:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbde00, rc 0) 00000100:00100000:3.0:1786015461.350940:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+49:29351:x1872772280526592:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 2884us (8665us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015461.350957:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1138 00000100:00100000:0.0:1786015461.361264:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015461.361392:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280526720 00000100:00100000:3.0:1786015461.361408:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280526720 00000100:00100000:3.0:1786015461.361497:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1139 00000100:00100000:3.0:1786015461.361510:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+49:29351:x1872772280526720:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015461.361558:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015461.361789:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+49:29351:x1872772280526720:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 252us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015461.361798:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1139 00000100:00100000:1.0:1786015461.365327:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015461.365894:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280526848 00000100:00100000:0.0:1786015461.365916:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280526848 00000100:00100000:0.0:1786015461.365989:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 305 00000100:00100000:0.0:1786015461.366001:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280526848:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786015461.366066:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501f9a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.366090:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015461.366095:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015461.366103:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501f9a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.366122:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501f9a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.366167:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501f9a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.366177:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501f9a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.366187:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501f9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.366196:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015461.366201:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501f9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.366223:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501f9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.366244:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501f9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015461.366252:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501f9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015461.366362:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280526848:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 362us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015461.366371:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 305 00000100:00100000:1.0:1786015461.373199:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015461.374903:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280527104 00000100:00100000:3.0:1786015461.374924:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280527104 00000100:00100000:3.0:1786015461.375012:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1140 00000100:00100000:3.0:1786015461.375025:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+49:29351:x1872772280527104:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786015461.375146:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501fa1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015461.375172:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501f93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e898a expref: 49 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015461.375184:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501fa1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015461.375239:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501f93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e898a expref: 49 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015461.375273:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501f93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e898a expref: 49 pid: 12526 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015461.375297:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fdd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304422272:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015461.375442:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06900 going to sleep for 11 seconds 00000100:00100000:0.0:1786015461.386894:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015461.387444:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fdd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304422272:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015461.387492:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501fa1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015461.389951:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280527232 00000100:00100000:1.0:1786015461.389972:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280527232 00010000:00010000:1.0:1786015461.390035:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501f93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e898a expref: 50 pid: 12526 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015461.390110:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 340 00000100:00100000:1.0:1786015461.390123:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b024d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+50:2353:x1872772280527232:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015461.390144:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015461.390153:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501f93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e898a expref: 50 pid: 12526 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015461.390170:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501f93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e898a expref: 50 pid: 12526 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015461.390200:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c501f93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e898a expref: 50 pid: 12526 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015461.390219:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232d000) 00010000:00010000:1.0:1786015461.390226:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501fa1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015461.390238:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501fa1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015461.390247:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501fa1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015461.390286:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015461.390317:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501fa1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015461.390326:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501fa1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015461.390370:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b024d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+49:2353:x1872772280527232:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 249us (3490us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015461.390378:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 340 00010000:00010000:2.0:1786015461.390849:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501fa1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015461.390861:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501fa1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015461.390867:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501fa1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015461.390874:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015461.390880:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501fa1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015461.390889:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501fa1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015461.390900:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232d000) 00010000:00010000:2.0:1786015461.390903:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015461.390980:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501fa1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015461.391050:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c501fa1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015461.391341:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+49:29351:x1872772280527104:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 16315us (18153us total) trans 4294968041 rc 0/0 00000100:00100000:2.0:1786015461.391353:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1140 00000040:00080000:1.0:1786015461.395635:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015461.395651:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015461.396259:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1786015461.396271:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015461.399946:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015461.400253:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280527488 00000100:00100000:1.0:1786015461.400267:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280527488 00000100:00100000:1.0:1786015461.400347:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 225 00000100:00100000:1.0:1786015461.400358:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:29351:x1872772280527488:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015461.401052:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:29351:x1872772280527488:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 690us (1117us total) trans 4294968042 rc 0/0 00000100:00100000:1.0:1786015461.401069:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 225 00010000:00010000:0.0:1786015462.252132:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015463.276478:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015463.455699:0:20181:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015463.455712:0:20181:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015463.456227:0:20181:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 32 count 3 00000040:00080000:0.0:1786015463.456236:0:20181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015463.488117:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015463.488166:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015463.488185:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015463.488207:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015463.488221:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015463.488234:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015463.488260:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015463.488302:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280528000 00000100:00100000:3.0:1786015463.488315:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280528000 00000100:00100000:3.0:1786015463.488393:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280528256 00000100:00100000:3.0:1786015463.488396:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280528256 00000100:00100000:3.0:1786015463.488407:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280527872 00000100:00100000:3.0:1786015463.488408:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280527872 00000100:00100000:3.0:1786015463.488416:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280528384 00000100:00100000:3.0:1786015463.488418:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280528384 00000100:00100000:3.0:1786015463.488432:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 445 00000100:00100000:3.0:1786015463.488440:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280528000:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015463.488526:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280528000:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 87us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015463.488531:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 445 00000100:00100000:3.0:1786015463.488561:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 446 00000100:00100000:3.0:1786015463.488564:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280528256:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015463.488583:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280528256:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 19us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015463.488587:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 446 00000100:00100000:3.0:1786015463.488592:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 447 00000100:00100000:3.0:1786015463.488595:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+15:2354:x1872772280527872:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015463.488608:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+15:2354:x1872772280527872:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 12us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015463.488611:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 447 00000100:00100000:3.0:1786015463.488616:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 448 00000100:00100000:3.0:1786015463.488619:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280528384:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015463.488631:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280528384:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 12us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015463.488635:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 448 00000100:00100000:3.0:1786015463.488651:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280527616 00000100:00100000:3.0:1786015463.488653:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280527616 00000100:00100000:3.0:1786015463.488673:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 587 00000100:00100000:3.0:1786015463.488679:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280527616:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015463.488703:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280527616:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015463.488709:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 587 00000100:00100000:3.0:1786015463.488750:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280527744 00000100:00100000:3.0:1786015463.488754:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280527744 00000100:00100000:3.0:1786015463.488844:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280528128 00000100:00100000:3.0:1786015463.488849:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280528128 00000100:00100000:3.0:1786015463.488887:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 460 00000100:00100000:3.0:1786015463.488894:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+96:2354:x1872772280527744:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015463.488934:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+96:2354:x1872772280527744:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 39us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015463.488944:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 461 00000100:00100000:2.0:1786015463.488981:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:2354:x1872772280528128:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015463.489076:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 460 00000100:00080000:3.0:1786015463.489105:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015463.489109:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786015463.489110:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015463.494403:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:2354:x1872772280528128:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 5430us (6151us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015463.494421:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 461 00000100:00100000:3.0:1786015463.561354:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015463.561473:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280528512 00000100:00100000:1.0:1786015463.561487:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280528512 00000100:00100000:1.0:1786015463.561594:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 306 00000100:00100000:1.0:1786015463.561607:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+15:2352:x1872772280528512:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015463.561633:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015463.561657:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041442349/0xb1a5ef690c501fa8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8991 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015463.561707:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1786015463.561712:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015463.561723:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041442349/0xb1a5ef690c501fa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8991 expref: 16 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015463.561744:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000041442349/0xb1a5ef690c501fa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8991 expref: 16 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015463.561790:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47a00, rc 0) 00000100:00100000:1.0:1786015463.561870:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2352:x1872772280528512:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 266us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015463.561877:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 306 00000100:00100000:1.0:1786015463.582348:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015463.582512:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280528768 00000100:00100000:3.0:1786015463.582527:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280528768 00000100:00100000:3.0:1786015463.582609:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1141 00000100:00100000:3.0:1786015463.582623:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+96:29361:x1872772280528768:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015463.582654:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015463.582684:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501faf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8998 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015463.582863:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501fb6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015463.582886:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501fb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015463.582902:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501fb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015463.582919:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:3.0:1786015463.583088:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c501faf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8998 expref: 99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015463.583104:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501fb6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8998 expref: 98 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015463.583111:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232d000) 00010000:00010000:3.0:1786015463.583114:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786015463.583116:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbce00, rc 0) 00000100:00100000:3.0:1786015463.583185:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+98:29361:x1872772280528768:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 567us (852us total) trans 4294968043 rc 0/0 00000100:00100000:3.0:1786015463.583193:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1141 00000100:00100000:1.0:1786015463.585664:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015463.585891:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280528896 00000100:00100000:0.0:1786015463.585904:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280528896 00000100:00100000:0.0:1786015463.585977:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 307 00000100:00100000:0.0:1786015463.585990:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280528896:12345-192.168.202.56@tcp:1:lfs.0 00010000:00010000:0.0:1786015463.586050:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501fc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.586089:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c164013/0xb1a5ef690c501f85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8983 expref: 10 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.586098:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000041442349/0xb1a5ef690c501fa8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8991 expref: 16 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.586107:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015463.586112:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015463.586116:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501fc4 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.586159:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000041442349/0xb1a5ef690c501fa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8991 expref: 16 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.586175:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000041442349/0xb1a5ef690c501fa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8991 expref: 16 pid: 6592 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015463.586192:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304422400:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015463.586309:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c164013/0xb1a5ef690c501f85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8983 expref: 10 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.586317:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c164013/0xb1a5ef690c501f85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8983 expref: 10 pid: 11384 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015463.586341:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304422528:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015463.586363:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b73848723c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015463.596543:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304422656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015463.596720:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015463.596835:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304422656 00000100:00100000:1.0:1786015463.596845:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304422656 00000100:00100000:1.0:1786015463.596916:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1786015463.596928:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304422656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015463.596973:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015463.597031:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304422656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015463.597040:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1786015463.597104:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304422656:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786015463.600213:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015463.617003:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304422400:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015463.617022:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304422528:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015463.617058:0:11384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501fc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015463.627464:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015463.627525:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280529024 00000100:00100000:2.0:1786015463.627549:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280529024 00010000:00010000:2.0:1786015463.627609:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000041442349/0xb1a5ef690c501fa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8991 expref: 17 pid: 6592 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015463.627661:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 341 00000100:00100000:2.0:1786015463.627674:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280529024:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015463.627694:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1786015463.627736:0:5781:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1786015463.627741:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:2.0:1786015463.627749:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000041442349/0xb1a5ef690c501fa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8991 expref: 17 pid: 6592 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015463.627805:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000041442349/0xb1a5ef690c501fa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8991 expref: 17 pid: 6592 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015463.627816:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280529152 00000100:00100000:0.0:1786015463.627822:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280529152 00010000:00010000:2.0:1786015463.627839:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041442349/0xb1a5ef690c501fa8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8991 expref: 17 pid: 6592 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.627846:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c164013/0xb1a5ef690c501f85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8983 expref: 11 pid: 11384 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015463.627866:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015463.627983:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280529024:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 311us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015463.627992:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 341 00000100:00100000:0.0:1786015463.628015:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 342 00000100:00100000:0.0:1786015463.628025:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280529152:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015463.628035:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015463.628049:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c164013/0xb1a5ef690c501f85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8983 expref: 11 pid: 11384 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.628061:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c164013/0xb1a5ef690c501f85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8983 expref: 11 pid: 11384 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.628090:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c164013/0xb1a5ef690c501f85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8983 expref: 11 pid: 11384 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.628105:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015463.628111:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015463.628119:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501fc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.628130:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501fc4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.628165:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015463.628192:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280529152:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 168us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015463.628215:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 342 00010000:00010000:0.0:1786015463.628380:0:11384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501fc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.628391:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501fc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.628429:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501fc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.628439:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501fc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.628454:0:11384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501fc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.628464:0:11384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015463.628470:0:11384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501fc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.628481:0:11384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501fc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.628495:0:11384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501fc4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015463.628501:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000609de14b/0xb1a5ef690c501fc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015463.628568:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+15:2353:x1872772280528896:12345-192.168.202.56@tcp:1:lfs.0 Request processed in 42580us (42914us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015463.628577:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 307 00000100:00100000:1.0:1786015463.633411:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015463.633478:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280529408 00000100:00100000:1.0:1786015463.633491:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280529408 00000100:00100000:3.0:1786015463.633595:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 226 00000100:00100000:3.0:1786015463.633613:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+98:29361:x1872772280529408:12345-192.168.202.56@tcp:35:lfs.0 00000004:00010000:3.0:1786015463.633836:0:5797:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x20:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501fb6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8998 expref: 98 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786015463.634155:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968044 00000001:00080000:3.0:1786015463.635098:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968045 00010000:00010000:3.0:1786015463.635191:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501fcb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015463.635218:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501f15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e894b expref: 49 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015463.635228:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501f46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8960 expref: 101 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015463.635252:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501fcb lrc: 5/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015463.635303:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501f46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8960 expref: 101 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015463.635323:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501f46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8960 expref: 101 pid: 7673 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015463.635342:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fdf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304422784:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015463.635478:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501f15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e894b expref: 49 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015463.635489:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501f15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e894b expref: 49 pid: 5795 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015463.635500:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fdc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304422912:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015463.635527:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7381ffb600 going to sleep for 11 seconds 00000100:00100000:1.0:1786015463.640075:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015463.640116:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fdf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304422784:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015463.640138:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fdc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304422912:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015463.640173:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:3.0:1786015463.640181:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501fcb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015463.640213:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280529664 00000100:00100000:1.0:1786015463.640222:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280529664 00010000:00010000:1.0:1786015463.640324:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501f15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e894b expref: 50 pid: 5795 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015463.640366:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280529536 00000100:00100000:1.0:1786015463.640370:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280529536 00010000:00010000:1.0:1786015463.640387:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501f46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8960 expref: 102 pid: 7673 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015463.640413:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 343 00000100:00100000:1.0:1786015463.640424:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+50:2354:x1872772280529664:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015463.640443:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015463.640452:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501f15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e894b expref: 50 pid: 5795 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015463.640465:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501f15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e894b expref: 50 pid: 5795 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015463.640495:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c501f15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e894b expref: 50 pid: 5795 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015463.640511:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232d000) 00010000:00010000:1.0:1786015463.640517:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501fcb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015463.640525:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501fcb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015463.640533:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015463.640598:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+49:2354:x1872772280529664:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 176us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015463.640607:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 343 00000100:00100000:1.0:1786015463.640629:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 344 00000100:00100000:1.0:1786015463.640637:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+102:2354:x1872772280529536:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015463.640646:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015463.640651:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501f46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8960 expref: 102 pid: 7673 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015463.640662:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501f46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8960 expref: 102 pid: 7673 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015463.640682:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c501f46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8960 expref: 102 pid: 7673 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015463.640693:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232d000) 00010000:00010000:1.0:1786015463.640697:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501fcb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015463.640707:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501fcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015463.640715:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501fcb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015463.640743:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015463.640795:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+101:2354:x1872772280529536:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 159us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015463.640803:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 344 00010000:00010000:3.0:1786015463.640946:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501fcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015463.641033:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501fcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786015463.641238:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968046 00000001:00080000:3.0:1786015463.641519:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968047 00000001:00080000:3.0:1786015463.641607:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968048 00000100:00100000:3.0:1786015463.641745:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fdc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304423040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1786015463.641862:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015463.641912:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486540300 going to sleep for 11 seconds 00000100:00100000:1.0:1786015463.644007:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304423040 00000100:00100000:1.0:1786015463.644025:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304423040 00000100:00100000:1.0:1786015463.644107:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1786015463.644119:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1872772304423040:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1786015463.644299:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1872772304423040:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 181us (2437us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015463.644308:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1786015463.644328:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fdc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304423040:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1786015463.644866:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968049 00000100:00100000:3.0:1786015463.644984:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fdc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304423168:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1786015463.645041:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015463.645085:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486540e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786015463.647394:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304423168 00000100:00100000:1.0:1786015463.647416:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304423168 00000100:00100000:1.0:1786015463.647499:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1786015463.647512:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1872772304423168:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1786015463.648589:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5797:x1872772304423168:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1075us (3542us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1786015463.648601:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1786015463.648645:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fdc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304423168:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:3.0:1786015463.648690:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501fcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015463.648706:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501fcb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015463.648716:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501fcb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015463.648723:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbdc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015463.648728:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501fcb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015463.648813:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501fcb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015463.648837:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232d000) 00010000:00010000:3.0:1786015463.648841:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1786015463.648848:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501fcb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015463.648854:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c501fcb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786015463.649168:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x47:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1786015463.649493:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].9, 64 off8792 00000004:00080000:3.0:1786015463.649507:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698900744963ns, next at 699900742363ns, rc = 0 00000001:00080000:3.0:1786015463.649518:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968050 00010000:00010000:3.0:1786015463.649598:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232d000) 00010000:00010000:3.0:1786015463.649602:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786015463.649614:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c501fb6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8998 expref: 105 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015463.649797:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+104:29361:x1872772280529408:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 16155us (16368us total) trans 4294968051 rc 0/0 00000100:00100000:3.0:1786015463.649809:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 226 00000020:00080000:3.0:1786015463.649816:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000001:00080000:2.0:1786015463.665466:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967354 is committed 00010000:00010000:3.0:1786015464.302056:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015465.134615:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304423424:0@lo:400:kworker.0 00000100:00100000:0.0:1786015465.134726:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015465.134828:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304423936:0@lo:400:kworker.0 00000100:00100000:0.0:1786015465.134861:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015465.134898:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1786015465.134905:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304423296:0@lo:400:kworker.0 00000100:00100000:0.0:1786015465.134941:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015465.134967:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304423808:0@lo:400:kworker.0 00000100:00100000:0.0:1786015465.134990:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015465.135017:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304423552:0@lo:400:kworker.0 00000100:00100000:0.0:1786015465.135043:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015465.135064:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015465.135069:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304423680:0@lo:400:kworker.0 00000100:00100000:0.0:1786015465.135092:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015465.135136:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304423424 00000100:00100000:0.0:1786015465.135146:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304423424 00000100:00100000:0.0:1786015465.135205:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304423808 00000100:00100000:0.0:1786015465.135208:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304423808 00000100:00100000:0.0:1786015465.135239:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304423552 00000100:00100000:0.0:1786015465.135242:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304423552 00000100:00100000:0.0:1786015465.135263:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1786015465.135274:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304423424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015465.135353:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304423424:12345-0@lo:400:kworker.0 Request processed in 80us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015465.135362:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1786015465.135382:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1786015465.135388:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304423808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015465.135419:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304423808:12345-0@lo:400:kworker.0 Request processed in 32us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015465.135426:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1786015465.135445:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1786015465.135450:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304423552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015465.135484:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304423552:12345-0@lo:400:kworker.0 Request processed in 33us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015465.135490:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1786015465.135515:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304423936 00000100:00100000:0.0:1786015465.135519:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304423936 00000100:00100000:0.0:1786015465.135552:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304423680 00000100:00100000:0.0:1786015465.135554:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304423680 00000100:00100000:0.0:1786015465.135577:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:0.0:1786015465.135584:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304423936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015465.135619:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304423936:12345-0@lo:400:kworker.0 Request processed in 35us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015465.135625:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:0.0:1786015465.135637:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:0.0:1786015465.135642:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304423680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015465.135666:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304423680:12345-0@lo:400:kworker.0 Request processed in 25us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015465.135671:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:0.0:1786015465.135692:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304423296 00000100:00100000:0.0:1786015465.135695:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304423296 00000100:00100000:0.0:1786015465.135723:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:0.0:1786015465.135730:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304423296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015465.135796:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304423296:12345-0@lo:400:kworker.0 Request processed in 29us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015465.135804:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00080000:0.0:1786015465.135852:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015465.135857:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015465.135860:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015465.135917:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304423680:0@lo:400:kworker.0 00000100:00100000:0.0:1786015465.135929:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304423552:0@lo:400:kworker.0 00000100:00100000:0.0:1786015465.136378:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304423296:0@lo:400:kworker.0 00000100:00100000:0.0:1786015465.136392:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304423808:0@lo:400:kworker.0 00000100:00100000:0.0:1786015465.136405:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304423424:0@lo:400:kworker.0 00000100:00100000:0.0:1786015465.136416:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304423936:0@lo:400:kworker.0 00000001:00080000:2.0:1786015465.296325:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967366 is committed 00010000:00010000:3.0:1786015465.325495:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786015465.371191:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968040 is committed 00000001:00080000:1.0:1786015465.371220:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968037 is committed 00000001:00080000:1.0:1786015465.371232:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968042 is committed 00000001:00080000:1.0:1786015465.371256:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968051 is committed 00000004:00080000:1.0:1786015465.371262:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000020:00080000:1.0:1786015465.371283:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b7486540300 refcount 2 committed 0 result 0 batchid 23 00000020:00080000:1.0:1786015465.371289:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b73813bba00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b74865406c0 00000020:00080000:1.0:1786015465.371292:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b73813bb600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74af061400 00000100:00100000:1.0:1786015465.371508:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304424064:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786015465.371600:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015465.371708:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304424064 00000100:00100000:1.0:1786015465.371718:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304424064 00000020:00080000:0.0:1786015465.375550:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 23 committed batchid 22 00000020:00080000:0.0:1786015465.375975:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 22 00000100:00100000:0.0:1786015465.378720:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1786015465.378781:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304424064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1786015465.378843:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:22 count 1 00002000:00010000:0.0:1786015465.378905:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 158, mtime: 0x6a746ee4, atime: 0x0, ctime: 0x6a746ee4, blocks: 0xb 00010000:00010000:0.0:1786015465.378916:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501fd2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015465.378937:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=700s v=(0 0) 00010000:00010000:0.0:1786015465.378942:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015465.378952:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501fd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015465.378974:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501fd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015465.378989:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501fd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015465.378999:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501fd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015465.379030:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786015465.379902:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1872772304424064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1159us (8297us total) trans 4294967356 rc 0/0 00000004:00080000:1.0:1786015465.380085:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b74b8978e00/2, rc 0, transno 4294967356 00000100:00100000:1.0:1786015465.380095:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304424064:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1786015465.380221:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786015465.380231:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501fd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015465.380243:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc600 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015465.380248:0:6606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501fd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015465.380259:0:6606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501fd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015465.380287:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501fd2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015465.380296:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecdab099/0xb1a5ef690c501fd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015465.380324:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015465.380327:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015465.380329:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015465.383483:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1786015465.644056:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786015465.644087:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304424192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015465.644183:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015465.644468:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304424192 00000100:00100000:0.0:1786015465.644479:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304424192 00000100:00100000:0.0:1786015465.644547:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1786015465.644559:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304424192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015465.644609:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 78184448 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015465.644673:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304424192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015465.644681:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1786015465.644756:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967366 gen 2 00000004:00080000:2.0:1786015465.644794:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b7384fdea00, transno 4294967366 00000100:00100000:2.0:1786015465.644815:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304424192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015466.212695:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015466.212790:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280529792 00000100:00100000:0.0:1786015466.212805:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280529792 00000100:00100000:0.0:1786015466.212885:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1142 00000100:00100000:0.0:1786015466.212899:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+94:29379:x1872772280529792:12345-192.168.202.56@tcp:101:diff.0 00010000:00010000:0.0:1786015466.212934:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015466.212973:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501fd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e899f expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.213074:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501fe0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.216540:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501fe0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.216580:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501fe0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.216626:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501fe7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.216640:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.216647:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.217166:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501fee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.217178:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501fee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.217185:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501fee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015466.217253:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00000004:00200000:0.0:1786015466.217260:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015466.217289:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501fee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.217307:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501fee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.217323:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501fe0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.217330:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501fe0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.217338:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501fe0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.217345:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afcc00 already unused, calling callback (ffffffffc20624f0) 00000100:00080000:2.0:1786015466.217531:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786015466.223623:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501fe0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.223647:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501fe0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.223673:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:0.0:1786015466.223677:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015466.223683:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501fe0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.223692:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c501fe0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.223710:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.223718:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501fe7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.223726:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.223734:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015466.223738:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.223744:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501fe7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.224274:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff8b748f24a100) 00010000:00010000:0.0:1786015466.224278:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015466.224282:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501fe7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.224289:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c501fe7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.224618:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c501fd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e899f expref: 96 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.224640:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501fee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e899f expref: 95 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.224649:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015466.224652:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015466.224655:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afda00, rc 0) 00000100:00100000:3.0:1786015466.229802:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+95:29379:x1872772280529792:12345-192.168.202.56@tcp:101:diff.0 Request processed in 16863us (17088us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015466.229842:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1142 00000100:00100000:0.0:1786015466.233398:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015466.234547:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280530048 00000100:00100000:1.0:1786015466.234565:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280530048 00000100:00100000:1.0:1786015466.234652:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1143 00000100:00100000:1.0:1786015466.234664:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+95:29379:x1872772280530048:12345-192.168.202.56@tcp:101:diff.0 00010000:00010000:1.0:1786015466.235304:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015466.235341:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501ff5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e89a6 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.235494:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501ffc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.235511:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501ffc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.235525:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501ffc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015466.235539:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:1.0:1786015466.237604:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c501ff5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89a6 expref: 98 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.237641:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501ffc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89a6 expref: 97 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.237652:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:1.0:1786015466.237655:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015466.237660:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47600, rc 0) 00000100:00100000:1.0:1786015466.238275:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+97:29379:x1872772280530048:12345-192.168.202.56@tcp:101:diff.0 Request processed in 3609us (4887us total) trans 4294968052 rc 0/0 00000100:00100000:1.0:1786015466.238287:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1143 00000100:00100000:0.0:1786015466.248125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.251330:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280530304 00000100:00100000:2.0:1786015466.251364:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280530304 00000100:00100000:2.0:1786015466.251472:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:2.0:1786015466.251496:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+97:29379:x1872772280530304:12345-192.168.202.56@tcp:103:diff.0 00010000:00010000:2.0:1786015466.251520:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1786015466.251553:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c501ffc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89a6 expref: 97 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.251572:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c501fee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e899f expref: 96 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.251581:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:2.0:1786015466.251592:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015466.251667:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+95:29379:x1872772280530304:12345-192.168.202.56@tcp:103:diff.0 Request processed in 185us (3558us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015466.251676:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:0.0:1786015466.255050:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.255210:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280530432 00000100:00100000:2.0:1786015466.255223:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280530432 00000100:00100000:2.0:1786015466.255323:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1144 00000100:00100000:2.0:1786015466.255336:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+95:29379:x1872772280530432:12345-192.168.202.56@tcp:58:diff.0 00010000:00010000:2.0:1786015466.255748:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50200a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.255813:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50200a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.255831:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50200a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786015466.257410:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].32, 136 off12544 00000100:00100000:2.0:1786015466.257804:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+95:29379:x1872772280530432:12345-192.168.202.56@tcp:58:diff.0 Request processed in 2463us (2760us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015466.257818:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1144 00000100:00100000:0.0:1786015466.261387:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015466.261516:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280530560 00000100:00100000:1.0:1786015466.261532:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280530560 00000100:00100000:1.0:1786015466.261622:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1145 00000100:00100000:1.0:1786015466.261635:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+95:29379:x1872772280530560:12345-192.168.202.56@tcp:101:diff.0 00010000:00010000:1.0:1786015466.261669:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015466.261701:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c502011 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e89ad expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.261830:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50200a lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.261844:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c502011 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89ad expref: 96 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.261879:0:12526:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50200a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.261903:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c502011 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89ad expref: 96 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.261923:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232dd00) 00010000:00010000:1.0:1786015466.261926:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015466.261930:0:12526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c502011 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89ad expref: 96 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.261950:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46600, rc 0) 00000100:00100000:1.0:1786015466.262046:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+96:29379:x1872772280530560:12345-192.168.202.56@tcp:101:diff.0 Request processed in 412us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015466.262055:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1145 00010000:00010000:0.0:1786015466.348394:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015466.540055:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015466.540070:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015466.540716:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 33 count 3 00000040:00080000:0.0:1786015466.540727:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015466.540966:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe7100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304424320:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786015466.541117:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872540 going to sleep for 11 seconds 00000100:00100000:1.0:1786015466.545819:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe7100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304424320:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786015466.550536:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015466.550903:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280530688 00000100:00100000:1.0:1786015466.550917:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280530688 00000100:00100000:1.0:1786015466.551033:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1146 00000100:00100000:1.0:1786015466.551047:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29380:x1872772280530688:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786015466.551100:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786015466.551285:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29380:x1872772280530688:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 240us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015466.551295:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1146 00000100:00080000:2.0:1786015466.551941:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015466.554981:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.555259:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280530816 00000100:00100000:2.0:1786015466.555275:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280530816 00000100:00100000:2.0:1786015466.555498:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1147 00000100:00100000:2.0:1786015466.555513:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29380:x1872772280530816:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1786015466.555633:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c502018 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.555659:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c502018 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.555674:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c502018 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.555712:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50201f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.555720:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50201f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.555728:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50201f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.556962:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502026 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.556985:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.556998:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015466.557065:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00000004:00200000:2.0:1786015466.557070:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015466.557092:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.557107:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c502018 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.557115:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c502018 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.557122:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c502018 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.557149:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015466.557154:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c502018 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.557163:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c502018 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.557179:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:2.0:1786015466.557182:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015466.557187:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c502018 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.557194:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c502018 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.558828:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50201f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.558845:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50201f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.558853:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50201f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.558858:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015466.558863:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50201f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.558871:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50201f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.558911:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x329c2aeb (ffff8b749232d500) 00010000:00010000:2.0:1786015466.558915:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015466.558920:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50201f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.558927:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50201f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.558952:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.558958:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502026 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.558964:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502026 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.558970:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015466.558973:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502026 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.558979:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502026 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.558987:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232dd00) 00010000:00010000:2.0:1786015466.558989:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015466.558992:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502026 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.558998:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502026 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015466.559242:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29380:x1872772280530816:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 3721us (4269us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015466.559256:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1147 00000100:00100000:3.0:1786015466.569559:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015466.569660:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280531072 00000100:00100000:0.0:1786015466.569676:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280531072 00000100:00100000:0.0:1786015466.569792:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1148 00000100:00100000:0.0:1786015466.569808:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29380:x1872772280531072:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015466.569841:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015466.569871:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50202d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e89b4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.570025:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502034 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.570047:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.570063:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015466.570079:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:0.0:1786015466.570225:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.570235:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502034 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.570245:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502034 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.570252:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015466.570258:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502034 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.570268:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502034 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.570283:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232dd00) 00010000:00010000:0.0:1786015466.570287:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015466.570292:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502034 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.570299:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502034 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.570423:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50202d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89b4 expref: 46 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.570437:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:0.0:1786015466.570440:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015466.570444:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50202d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89b4 expref: 46 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.570456:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afce00, rc 0) 00000100:00100000:0.0:1786015466.570533:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+45:29380:x1872772280531072:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 728us (988us total) trans 4294968053 rc 301/301 00000100:00100000:0.0:1786015466.570545:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1148 00000100:00100000:0.0:1786015466.577153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.577390:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280531200 00000100:00100000:2.0:1786015466.577404:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280531200 00000100:00100000:2.0:1786015466.577472:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1149 00000100:00100000:2.0:1786015466.577483:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+45:29380:x1872772280531200:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015466.577538:0:7673:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015466.577693:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+45:29380:x1872772280531200:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 212us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015466.577701:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1149 00000100:00100000:3.0:1786015466.586863:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.588605:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280531456 00000100:00100000:2.0:1786015466.588631:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280531456 00000100:00100000:2.0:1786015466.588742:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1150 00000100:00100000:2.0:1786015466.588813:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:29380:x1872772280531456:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015466.588856:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015466.588889:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502042 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e89bb expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.594832:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c502049 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.594868:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c502049 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.594882:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c502049 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015466.594907:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x21:0x0]: returning size 0 00010000:00010000:2.0:1786015466.594996:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502042 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89bb expref: 48 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.595018:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c502049 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89bb expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.595029:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8b749232d500) 00010000:00010000:2.0:1786015466.595032:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015466.595036:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907600, rc 0) 00000100:00100000:2.0:1786015466.595143:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:29380:x1872772280531456:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 6390us (8303us total) trans 4294968054 rc 0/0 00000100:00100000:2.0:1786015466.595155:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1150 00000100:00100000:3.0:1786015466.607718:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015466.608166:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280531712 00000100:00100000:1.0:1786015466.608184:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280531712 00000100:00100000:0.0:1786015466.608416:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1151 00000100:00100000:0.0:1786015466.608430:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+47:29380:x1872772280531712:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786015466.608519:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015466.608558:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c502049 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89bb expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.608583:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8b749232d500) 00010000:00010000:0.0:1786015466.608598:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015466.608631:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502057 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.608650:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c501f5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e896e expref: 95 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.608660:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502057 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.608831:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c501f5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e896e expref: 95 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.608850:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c501f5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e896e expref: 95 pid: 5794 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015466.608869:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304424448:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015466.609009:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015466.615451:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015466.615562:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280531840 00000100:00100000:1.0:1786015466.615578:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280531840 00010000:00010000:1.0:1786015466.615643:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c501f5b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e896e expref: 96 pid: 5794 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015466.615726:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 345 00000100:00100000:1.0:1786015466.615739:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+96:2353:x1872772280531840:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015466.615824:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015466.615835:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c501f5b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e896e expref: 96 pid: 5794 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.615851:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c501f5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e896e expref: 96 pid: 5794 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.615882:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:1.0:1786015466.615889:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502057 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.615903:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502057 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.615913:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502057 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.615942:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015466.616019:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+96:2353:x1872772280531840:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 281us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015466.616029:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 345 00010000:00010000:2.0:1786015466.616130:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c501f5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e896e expref: 95 pid: 5794 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015466.616150:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304424448:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015466.616181:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502057 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.616192:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502057 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.616198:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502057 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.616229:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50205e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x46:0x0].0xc5b72459 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.616259:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50205e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0xc5b72459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.616267:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50205e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0xc5b72459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.617133:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502057 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.617149:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502057 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.617157:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502057 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.617165:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015466.617171:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502057 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.617179:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502057 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.617191:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:2.0:1786015466.617194:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015466.617199:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502057 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.617205:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502057 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.617220:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50205e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0xc5b72459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.617233:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50205e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0xc5b72459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.617239:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50205e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0xc5b72459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.617244:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015466.617248:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50205e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0xc5b72459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.617255:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50205e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0xc5b72459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.617265:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0xc5b72459 (ffff8b749232d400) 00010000:00010000:2.0:1786015466.617268:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015466.617271:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50205e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0xc5b72459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.617278:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50205e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0xc5b72459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015466.617402:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+46:29380:x1872772280531712:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 8971us (9695us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786015466.617411:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1151 00000100:00100000:0.0:1786015466.620403:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015466.620576:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280531968 00000100:00100000:1.0:1786015466.620593:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280531968 00000100:00100000:1.0:1786015466.620676:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1152 00000100:00100000:1.0:1786015466.620691:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+46:29380:x1872772280531968:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015466.620722:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015466.621075:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502065 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e89c2 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.621246:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50206c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.621265:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50206c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.621305:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50206c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.621446:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502065 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89c2 expref: 48 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.621467:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50206c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89c2 expref: 47 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.621479:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:2.0:1786015466.621482:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015466.621486:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906800, rc 0) 00000100:00100000:2.0:1786015466.621589:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+47:29380:x1872772280531968:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 900us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015466.621599:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1152 00000100:00100000:2.0:1786015466.625016:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015466.625113:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280532224 00000100:00100000:0.0:1786015466.625129:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280532224 00000100:00100000:0.0:1786015466.625205:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1153 00000100:00100000:0.0:1786015466.625217:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:29380:x1872772280532224:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786015466.625340:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502073 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.625363:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502073 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.625377:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502073 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015466.625672:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000009c71fcd reply state 00000000e2b80720 transno 4294968055 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502073 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015466.625684:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015466.625871:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:29380:x1872772280532224:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 654us (869us total) trans 4294968055 rc 0/0 00000100:00100000:0.0:1786015466.625880:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1153 00010000:00010000:2.0:1786015466.628026:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502073 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.628048:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502073 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.628057:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502073 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.628064:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015466.628071:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502073 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.628104:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502073 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.628126:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:2.0:1786015466.628129:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786015466.628135:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502073 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.628140:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502073 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015466.629881:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015466.629986:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280532352 00000100:00100000:0.0:1786015466.630002:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280532352 00000100:00100000:0.0:1786015466.630078:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1154 00000100:00100000:0.0:1786015466.630092:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+48:29380:x1872772280532352:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015466.630126:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015466.630160:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50207a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e89c9 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.630250:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50207a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89c9 expref: 49 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.630268:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50207a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89c9 expref: 49 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.630279:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:0.0:1786015466.630281:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015466.630285:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afca00, rc 0) 00000100:00100000:0.0:1786015466.630358:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+49:29380:x1872772280532352:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 269us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015466.630366:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1154 00000100:00100000:1.0:1786015466.633401:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.633611:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280532480 00000100:00100000:2.0:1786015466.633627:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280532480 00000100:00100000:2.0:1786015466.633725:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 227 00000100:00100000:2.0:1786015466.633737:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:29380:x1872772280532480:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1786015466.633978:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:29380:x1872772280532480:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 Request processed in 242us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015466.633987:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 227 00000100:00100000:1.0:1786015466.636282:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.636366:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280532736 00000100:00100000:2.0:1786015466.636378:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280532736 00000100:00100000:2.0:1786015466.636454:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 228 00000100:00100000:2.0:1786015466.636464:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916b4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:29380:x1872772280532736:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015466.636833:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916b4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:29380:x1872772280532736:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 370us (565us total) trans 4294968056 rc 0/0 00000100:00100000:2.0:1786015466.636842:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 228 00000100:00100000:3.0:1786015466.649319:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015466.649465:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280532992 00000100:00100000:0.0:1786015466.649480:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280532992 00000100:00100000:0.0:1786015466.649608:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1155 00000100:00100000:0.0:1786015466.649622:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+50:29380:x1872772280532992:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015466.650061:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+50:29380:x1872772280532992:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 441us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015466.650071:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1155 00000100:00100000:1.0:1786015466.652207:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.653693:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280533248 00000100:00100000:2.0:1786015466.653714:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280533248 00000100:00100000:0.0:1786015466.654131:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1156 00000100:00100000:0.0:1786015466.654148:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:29380:x1872772280533248:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015466.654185:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015466.654221:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502081 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e89d0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.654369:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502088 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.654388:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50207a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89c9 expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.654398:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502088 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.654451:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50207a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89c9 expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.654468:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50207a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89c9 expref: 51 pid: 5796 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015466.654487:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304424576:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015466.654797:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872180 going to sleep for 11 seconds 00000100:00100000:0.0:1786015466.659558:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.659669:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304424576:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015466.659725:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502088 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015466.661744:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280533376 00000100:00100000:3.0:1786015466.661794:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280533376 00010000:00010000:3.0:1786015466.661888:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50207a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89c9 expref: 52 pid: 5796 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015466.661962:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 346 00000100:00100000:3.0:1786015466.661975:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b024c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+52:2353:x1872772280533376:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015466.662001:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015466.662010:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50207a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89c9 expref: 52 pid: 5796 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.662027:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50207a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89c9 expref: 52 pid: 5796 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.662056:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50207a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89c9 expref: 52 pid: 5796 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.662080:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:3.0:1786015466.662087:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502088 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.662098:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502088 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.662132:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502088 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.662173:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015466.666316:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502088 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.666356:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502088 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015466.666399:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x21:0x0]: returning size 0 00000004:00080000:2.0:1786015466.666977:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x19:0x0], index 1: 0 00010000:00010000:2.0:1786015466.667214:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502088 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.667225:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502088 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.667235:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502088 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.667241:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015466.667247:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502088 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.667257:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502088 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.667283:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:2.0:1786015466.667286:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015466.667317:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502088 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.667324:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502088 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.667421:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502081 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89d0 expref: 52 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.667434:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:2.0:1786015466.667437:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786015466.667441:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502081 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89d0 expref: 52 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.667452:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afce00, rc 0) 00000100:00100000:3.0:1786015466.670921:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b024c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+51:2353:x1872772280533376:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 8926us (11357us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015466.670951:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 346 00000100:00100000:2.0:1786015466.671468:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:29380:x1872772280533248:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 17320us (19270us total) trans 4294968057 rc 301/301 00000100:00100000:2.0:1786015466.671478:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1156 00000100:00100000:1.0:1786015466.678259:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.678663:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280533632 00000100:00100000:2.0:1786015466.678694:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280533632 00000100:00100000:2.0:1786015466.678829:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 229 00000100:00100000:2.0:1786015466.678855:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:29380:x1872772280533632:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015466.680043:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+51:29380:x1872772280533632:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 836us (1436us total) trans 4294968058 rc 0/0 00000100:00100000:2.0:1786015466.680058:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 229 00000100:00100000:3.0:1786015466.682475:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015466.682999:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280533760 00000100:00100000:1.0:1786015466.683015:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280533760 00000100:00100000:1.0:1786015466.683103:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1157 00000100:00100000:1.0:1786015466.684342:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+51:29380:x1872772280533760:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015466.684390:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015466.684427:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c502096 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e89d7 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.684529:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50209d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.684549:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50209d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.684564:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50209d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015466.684616:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x21:0x0]: returning size 0 00000004:00200000:1.0:1786015466.684621:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015466.684651:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50209d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.684685:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47a00/0xb1a5ef690c502096 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89d7 expref: 53 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.684707:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50209d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89d7 expref: 52 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.684718:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:1.0:1786015466.684721:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786015466.684726:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47600, rc 0) 00000100:00100000:1.0:1786015466.685155:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+52:29380:x1872772280533760:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 2039us (2696us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015466.688444:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1157 00000100:00100000:3.0:1786015466.689397:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015466.689497:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280533888 00000100:00100000:0.0:1786015466.689511:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280533888 00000100:00100000:0.0:1786015466.689630:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 309 00000100:00100000:0.0:1786015466.689643:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280533888:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015466.689672:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015466.689705:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b183e694/0xb1a5ef690c5020a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e89de expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015466.689746:0:14547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786015466.689812:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=701s v=(0 0) 00010000:00010000:0.0:1786015466.689819:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015466.689832:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b183e694/0xb1a5ef690c5020a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89de expref: 11 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.689962:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b183e694/0xb1a5ef690c5020a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89de expref: 11 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.689979:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd600, rc 0) 00000100:00100000:0.0:1786015466.690099:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280533888:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 459us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015466.690108:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 309 00000100:00080000:2.0:1786015466.690320:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015466.693806:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015466.694275:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280534144 00000100:00100000:1.0:1786015466.694291:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280534144 00000100:00100000:1.0:1786015466.694376:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1158 00000100:00100000:1.0:1786015466.694391:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+52:29380:x1872772280534144:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786015466.694561:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+52:29380:x1872772280534144:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 174us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015466.694570:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1158 00000100:00100000:3.0:1786015466.698410:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015466.698502:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280534272 00000100:00100000:0.0:1786015466.698516:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280534272 00000100:00100000:0.0:1786015466.698592:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 310 00000100:00100000:0.0:1786015466.698603:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:29380:x1872772280534272:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015466.698628:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015466.698657:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5020ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e89e5 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.698703:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b183e694/0xb1a5ef690c5020a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89de expref: 12 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.698715:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015466.698721:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015466.698727:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5020ab lrc: 4/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89e5 expref: 12 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.698806:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b183e694/0xb1a5ef690c5020a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89de expref: 12 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.698824:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b183e694/0xb1a5ef690c5020a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89de expref: 12 pid: 14547 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015466.698854:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304424704:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015466.699080:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872240 going to sleep for 11 seconds 00000100:00100000:0.0:1786015466.702088:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.702207:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304424704:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015466.702256:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5020ab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89e5 expref: 12 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.702305:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc600, rc 0) 00000100:00100000:2.0:1786015466.702389:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:29380:x1872772280534272:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 3787us (3996us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015466.702400:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 310 00000100:00100000:1.0:1786015466.702532:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280534400 00000100:00100000:1.0:1786015466.702541:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280534400 00010000:00010000:1.0:1786015466.702583:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b183e694/0xb1a5ef690c5020a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89de expref: 12 pid: 14547 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015466.702621:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 347 00000100:00100000:1.0:1786015466.702631:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280534400:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015466.702650:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015466.702682:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b183e694/0xb1a5ef690c5020a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89de expref: 12 pid: 14547 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.702697:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b183e694/0xb1a5ef690c5020a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89de expref: 12 pid: 14547 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.702726:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b183e694/0xb1a5ef690c5020a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89de expref: 12 pid: 14547 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.702743:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015466.702747:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015466.702797:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5020ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89e5 expref: 11 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.702808:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5020ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89e5 expref: 11 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.702851:0:6607:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5020ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89e5 expref: 11 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015466.702868:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6607:1872772304424832:192.168.202.56@tcp:105: 00000100:00100000:1.0:1786015466.703044:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06900 going to sleep for 11 seconds 00000100:00100000:3.0:1786015466.708074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015466.708239:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6607:1872772304424832:192.168.202.56@tcp:105: 00010000:00010000:1.0:1786015466.708271:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015466.708351:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280534400:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 5720us (6278us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015466.708366:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 347 00000100:00100000:2.0:1786015466.708464:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280534528 00000100:00100000:2.0:1786015466.708474:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280534528 00002000:00100000:2.0:1786015466.708537:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x19:0x0] (0->157) req@ffff8b7384fe5180 x1872772280534528/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:312/0 lens 648/0 e 0 to 0 dl 1786015477 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015466.708547:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384fe5180 with x1872772280534528 ext(0->157) 00002000:00010000:2.0:1786015466.708553:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384fe5180 00000100:00100000:2.0:1786015466.708587:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 102 00000100:00100000:2.0:1786015466.708596:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280534528:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1786015466.709309:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280534528:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 710us (1246us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1786015466.709318:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 102 00002000:00100000:2.0:1786015466.709326:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x19:0x0] (0->157) req@ffff8b7384fe5180 x1872772280534528/t4294967367(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:312/0 lens 648/448 e 0 to 0 dl 1786015477 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015466.709334:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384fe5180 with x1872772280534528 ext(0->157) 00002000:00010000:2.0:1786015466.709339:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384fe5180 00000100:00100000:3.0:1786015466.716105:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.716265:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280534656 00000100:00100000:2.0:1786015466.716279:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280534656 00000100:00100000:2.0:1786015466.716360:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1159 00000100:00100000:2.0:1786015466.716372:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+52:29380:x1872772280534656:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1786015466.776326:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968055 is committed 00000020:00080000:0.0:1786015466.776356:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 23 batchid updated 00000020:00080000:0.0:1786015466.776378:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 23 00000020:00080000:0.0:1786015466.776405:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 23 00000001:00080000:0.0:1786015466.776437:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968052 is committed 00000001:00080000:0.0:1786015466.776445:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968058 is committed 00000100:00100000:3.0:1786015466.777195:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+46:29380:x1872772280534656:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 60814us (61092us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015466.777211:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1159 00000100:00100000:0.0:1786015466.781110:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.781224:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280534784 00000100:00100000:2.0:1786015466.781239:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280534784 00000100:00100000:2.0:1786015466.781323:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 311 00000100:00100000:2.0:1786015466.781338:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280534784:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1786015466.825302:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967367 is committed 00000100:00100000:3.0:1786015466.825596:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280534784:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 44252us (44490us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015466.825611:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 311 00000100:00100000:0.0:1786015466.832666:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015466.833352:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280535040 00000100:00100000:3.0:1786015466.833373:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280535040 00000100:00100000:3.0:1786015466.833454:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1160 00000100:00100000:3.0:1786015466.833468:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+46:29380:x1872772280535040:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786015466.833546:0:12526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015466.833585:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50209d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89d7 expref: 46 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.833635:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:3.0:1786015466.833642:0:12526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015466.833701:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5020b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.833718:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5020b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.833730:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5020b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015466.834405:0:12526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b39a182 reply state 000000008e48a5a4 transno 4294968059 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5020b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015466.834420:0:12526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015466.834583:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+47:29380:x1872772280535040:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 1115us (1931us total) trans 4294968059 rc 0/0 00000100:00100000:3.0:1786015466.834593:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1160 00000100:00100000:1.0:1786015466.837190:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:0.0:1786015466.838228:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5020b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.838247:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5020b2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.838257:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5020b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.838269:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015466.838275:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5020b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.838284:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5020b2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.838307:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:0.0:1786015466.838310:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015466.838315:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5020b2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015466.838322:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5020b2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015466.838645:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280535168 00000100:00100000:3.0:1786015466.838661:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280535168 00000100:00100000:3.0:1786015466.838801:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1161 00000100:00100000:3.0:1786015466.838813:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+46:29380:x1872772280535168:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015466.838847:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015466.838873:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5020b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e89ec expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.838976:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5020b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89ec expref: 47 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.839021:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5020b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89ec expref: 47 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.839045:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:3.0:1786015466.839048:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015466.839051:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc600, rc 0) 00000100:00100000:3.0:1786015466.839150:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+47:29380:x1872772280535168:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 338us (1971us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015466.839158:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1161 00000100:00100000:1.0:1786015466.843430:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.843808:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280535296 00000100:00100000:2.0:1786015466.843825:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280535296 00000100:00100000:2.0:1786015466.843914:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 312 00000100:00100000:2.0:1786015466.843944:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280535296:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1786015466.844327:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1786015466.844332:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb mtime from disk: 0 -> 1786015460 00002000:00010000:2.0:1786015466.844334:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb atime from disk: 0 -> 1786015460 00002000:00010000:2.0:1786015466.844337:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb ctime from disk: 0 -> 1786015460 00002000:00010000:2.0:1786015466.844339:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1786015466.844425:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280535296:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 490us (1010us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1786015466.844435:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 312 00000100:00100000:1.0:1786015466.848873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015466.849267:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280535552 00000100:00100000:3.0:1786015466.849283:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280535552 00000100:00100000:3.0:1786015466.849362:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1162 00000100:00100000:3.0:1786015466.849378:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:29380:x1872772280535552:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1786015466.849478:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5020c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.849500:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50206c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89c2 expref: 47 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.849509:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5020c0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.849564:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50206c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89c2 expref: 47 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.849582:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50206c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89c2 expref: 47 pid: 12526 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015466.849623:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304424960:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015466.849817:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015466.853569:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.853706:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280535680 00000100:00100000:2.0:1786015466.853720:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280535680 00010000:00010000:2.0:1786015466.853823:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50206c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89c2 expref: 48 pid: 12526 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015466.853883:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 348 00000100:00100000:2.0:1786015466.853896:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:2353:x1872772280535680:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015466.853918:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015466.853941:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50206c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89c2 expref: 48 pid: 12526 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.853979:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50206c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89c2 expref: 48 pid: 12526 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.854010:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:2.0:1786015466.854016:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5020c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.854029:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5020c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.854039:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5020c0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.854063:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015466.854134:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:2353:x1872772280535680:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 240us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015466.854144:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 348 00010000:00010000:3.0:1786015466.854880:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c50206c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89c2 expref: 47 pid: 12526 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015466.854904:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304424960:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015466.855110:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5020c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.855268:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5020c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.855277:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5020c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.855323:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5020c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.855331:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5020c0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.855338:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5020c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.855366:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015466.855372:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5020c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.855381:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5020c0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.855396:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:2.0:1786015466.855399:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1786015466.855404:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5020c0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.855410:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5020c0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015466.855503:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+46:29380:x1872772280535552:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 6129us (6644us total) trans 0 rc -22/-22 00000100:00100000:2.0:1786015466.855514:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1162 00000100:00100000:1.0:1786015466.858823:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.865381:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280535808 00000100:00100000:2.0:1786015466.865404:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280535808 00000100:00100000:2.0:1786015466.865491:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 313 00000100:00100000:2.0:1786015466.865503:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280535808:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786015466.865696:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c5020c7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.865725:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5020ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89e5 expref: 12 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.866059:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x19:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786015466.866065:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786015466.866071:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c5020c7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.866127:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5020ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89e5 expref: 12 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.866145:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5020ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89e5 expref: 12 pid: 6591 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015466.866162:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304425088:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015466.866337:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74812eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015466.873355:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.874377:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304425088:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015466.874418:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c5020c7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015466.874594:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280535936 00000100:00100000:3.0:1786015466.874605:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280535936 00010000:00010000:3.0:1786015466.874661:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5020ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89e5 expref: 13 pid: 6591 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015466.874779:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 349 00000100:00100000:3.0:1786015466.874791:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280535936:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015466.874814:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015466.874858:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5020ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89e5 expref: 13 pid: 6591 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.874881:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5020ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89e5 expref: 13 pid: 6591 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.874917:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecdab099/0xb1a5ef690c5020ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89e5 expref: 13 pid: 6591 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.875261:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015466.875266:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015466.875274:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c5020c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.875286:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c5020c7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.875327:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015466.875418:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280535936:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 628us (2079us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015466.875427:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 349 00010000:00010000:2.0:1786015466.875506:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c5020c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.875515:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c5020c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.875558:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c5020c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.875575:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c5020c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.875585:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c5020c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.875594:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906000 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015466.875599:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c5020c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.875610:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c5020c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.875624:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c5020c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.875632:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad7507e1/0xb1a5ef690c5020c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015466.875689:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280535808:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 10188us (16883us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015466.875698:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 313 00000100:00100000:1.0:1786015466.878444:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.878795:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280536192 00000100:00100000:2.0:1786015466.878810:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280536192 00000100:00100000:2.0:1786015466.878893:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1163 00000100:00100000:2.0:1786015466.878939:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+46:29380:x1872772280536192:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1786015466.879053:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5020ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.879076:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5020ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.879091:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5020ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.879393:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5020d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.879407:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5020b9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89ec expref: 47 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.879416:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5020d5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.879463:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5020b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89ec expref: 47 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.879481:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5020b9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89ec expref: 47 pid: 7673 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015466.879499:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304425216:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015466.879619:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74812eda80 going to sleep for 11 seconds 00000100:00100000:1.0:1786015466.882680:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.885841:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304425216:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015466.885882:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5020d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015466.899163:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280536320 00000100:00100000:0.0:1786015466.899193:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280536320 00010000:00010000:1.0:1786015466.899652:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5020b9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89ec expref: 48 pid: 7673 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015466.899715:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 350 00000100:00100000:1.0:1786015466.899727:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+48:2353:x1872772280536320:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015466.899775:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015466.899785:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5020b9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89ec expref: 48 pid: 7673 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.899802:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5020b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89ec expref: 48 pid: 7673 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.899831:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5020b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89ec expref: 48 pid: 7673 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.899853:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:1.0:1786015466.899860:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5020d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.899871:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5020d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.899879:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5020d5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015466.899914:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015466.900016:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2353:x1872772280536320:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 290us (17353us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015466.900026:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 350 00010000:00010000:2.0:1786015466.900488:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5020d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.900501:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5020d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786015466.900829:0:12526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968060 00000004:02000000:2.0:1786015466.901412:0:12526:0:(mdd_object.c:3047:mdd_swap_layouts()) *** cfs_fail_loc=152, val=0*** 00000001:00080000:2.0:1786015466.910293:0:12526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968061 00010000:00010000:2.0:1786015466.910410:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5020d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.910428:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5020d5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.910439:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5020d5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.910446:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015466.910452:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5020d5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.910461:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5020d5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.910485:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:2.0:1786015466.910489:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015466.910496:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5020d5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.910503:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c5020d5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.910581:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50200a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.910588:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50200a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.910595:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50200a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.910600:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015466.910603:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50200a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.910609:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50200a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.910618:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232dd00) 00010000:00010000:2.0:1786015466.910621:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015466.910633:0:12526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c502011 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89ad expref: 93 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.910647:0:12526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c502011 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89ad expref: 93 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.910659:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c502011 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89ad expref: 93 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.910718:0:12526:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c502011 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89ad expref: 93 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015466.911083:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304425344:192.168.202.56@tcp:105: 00000100:00100000:2.0:1786015466.911209:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce1480 going to sleep for 11 seconds 00000100:00100000:2.0:1786015466.915178:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304425344:192.168.202.56@tcp:105: 00010000:00010000:2.0:1786015466.915235:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50200a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.915250:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50200a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.915301:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5020dc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.915320:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5020dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.915335:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5020dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.915351:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5020dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.915358:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5020dc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.915366:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5020dc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.915374:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015466.915379:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5020dc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.915412:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5020dc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.915428:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232dd00) 00010000:00010000:2.0:1786015466.915432:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015466.915436:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5020dc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.915442:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5020dc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.915453:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5020ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.915459:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5020ce lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.915465:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5020ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.915470:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015466.915472:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5020ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.915478:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5020ce lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.915485:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232dd00) 00010000:00010000:2.0:1786015466.915488:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015466.915490:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5020ce lrc: 2/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015466.915506:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5020ce lrc: 0/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015466.916301:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+48:29380:x1872772280536192:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 37371us (37862us total) trans 0 rc -95/-95 00000100:00100000:2.0:1786015466.916318:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1163 00000020:00080000:2.0:1786015466.916326:0:12526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1786015466.928078:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015466.928092:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015466.928617:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1786015466.928627:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015466.929154:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.929256:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015466.929798:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280536448 00000100:00100000:1.0:1786015466.929814:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280536448 00000100:00100000:3.0:1786015466.929945:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280536704 00000100:00100000:3.0:1786015466.929951:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280536704 00000100:00100000:3.0:1786015466.930023:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 230 00000100:00100000:3.0:1786015466.930035:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+48:29380:x1872772280536704:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1786015466.931099:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x21:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1786015466.931287:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].17, 64 off9376 00000004:00080000:3.0:1786015466.931301:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702182538795ns, next at 703182536424ns, rc = 0 00000001:00080000:3.0:1786015466.931310:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968062 00010000:00010000:3.0:1786015466.931371:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5020e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.931391:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5020e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.931419:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5020e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.931430:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5020e3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.931438:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5020e3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.931445:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5020e3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.931469:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786015466.931605:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+50:29380:x1872772280536704:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1568us (2344us total) trans 4294968063 rc 0/0 00000100:00100000:3.0:1786015466.931615:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 230 00000020:00080000:3.0:1786015466.931622:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786015466.931663:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786015466.931671:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5020e3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.931680:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd600 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015466.931684:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5020e3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.931694:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5020e3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.931709:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8b74a04b5b00) 00010000:00010000:3.0:1786015466.931713:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786015466.931725:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5020e3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.931732:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5020e3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015466.931785:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015466.931788:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015466.931790:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015466.932018:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 231 00000100:00100000:1.0:1786015466.932032:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+94:29379:x1872772280536448:12345-192.168.202.56@tcp:49:diff.0 00000100:00100000:1.0:1786015466.932124:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+94:29379:x1872772280536448:12345-192.168.202.56@tcp:49:diff.0 Request processed in 97us (2977us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015466.932131:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 231 00000100:00100000:1.0:1786015466.938724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015466.941833:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280536960 00000100:00100000:2.0:1786015466.942256:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280536960 00000100:00100000:2.0:1786015466.942367:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 232 00000100:00100000:2.0:1786015466.942381:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+94:29379:x1872772280536960:12345-192.168.202.56@tcp:35:diff.0 00000100:00100000:2.0:1786015466.943097:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+95:29379:x1872772280536960:12345-192.168.202.56@tcp:35:diff.0 Request processed in 714us (4386us total) trans 4294968064 rc 0/0 00000100:00100000:2.0:1786015466.943108:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 232 00010000:00010000:3.0:1786015467.372258:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015467.957535:0:20335:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015467.957545:0:20335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015467.958311:0:20335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 33 count 3 00000040:00080000:2.0:1786015467.958318:0:20335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015468.395938:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015468.613816:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015468.613861:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015468.613885:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015468.613907:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015468.613930:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015468.613950:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015468.614033:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015468.614072:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280537088 00000100:00100000:3.0:1786015468.614082:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280537088 00000100:00100000:3.0:1786015468.614136:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 589 00000100:00100000:3.0:1786015468.614145:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280537088:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015468.614222:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280537088:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 78us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015468.614230:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 589 00000100:00100000:3.0:1786015468.614268:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280537344 00000100:00100000:3.0:1786015468.614272:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280537344 00000100:00100000:3.0:1786015468.614315:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280537856 00000100:00100000:3.0:1786015468.614318:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280537856 00000100:00100000:3.0:1786015468.614334:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280537472 00000100:00100000:3.0:1786015468.614337:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280537472 00000100:00100000:3.0:1786015468.614370:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280537728 00000100:00100000:3.0:1786015468.614373:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280537728 00000100:00100000:3.0:1786015468.614388:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 451 00000100:00100000:3.0:1786015468.614394:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+15:2352:x1872772280537344:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015468.614425:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+15:2352:x1872772280537344:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015468.614432:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 451 00000100:00100000:3.0:1786015468.614444:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 452 00000100:00100000:3.0:1786015468.614450:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280537856:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015468.614474:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280537856:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015468.614481:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 452 00000100:00100000:3.0:1786015468.614492:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 453 00000100:00100000:3.0:1786015468.614498:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280537472:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015468.614519:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280537472:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015468.614525:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 453 00000100:00100000:3.0:1786015468.614536:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 454 00000100:00100000:3.0:1786015468.614543:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280537728:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015468.614568:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280537728:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015468.614574:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 454 00000100:00100000:3.0:1786015468.614595:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280537600 00000100:00100000:3.0:1786015468.614598:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280537600 00000100:00100000:3.0:1786015468.614636:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280537216 00000100:00100000:3.0:1786015468.614640:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280537216 00000100:00100000:3.0:1786015468.614660:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 465 00000100:00100000:3.0:1786015468.614666:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+50:2352:x1872772280537600:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015468.614704:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+50:2352:x1872772280537600:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015468.614710:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 465 00000100:00100000:3.0:1786015468.614720:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 466 00000100:00100000:3.0:1786015468.614726:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+95:2352:x1872772280537216:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015468.614791:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+95:2352:x1872772280537216:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 64us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015468.614797:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 466 00000100:00080000:3.0:1786015468.614948:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015468.614953:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015468.614955:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015468.731197:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304425472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015468.731275:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015468.731354:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304425472 00000100:00100000:1.0:1786015468.731363:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304425472 00000100:00100000:1.0:1786015468.731426:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1786015468.731436:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304425472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015468.731473:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015468.731519:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304425472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015468.731526:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1786015468.731574:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304425472:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786015468.731906:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1786015468.792795:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967356 is committed 00000100:00100000:1.0:1786015469.096948:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015469.097867:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280538112 00000100:00100000:3.0:1786015469.097881:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280538112 00000100:00100000:3.0:1786015469.097962:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1164 00000100:00100000:3.0:1786015469.097973:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+95:29402:x1872772280538112:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015469.098000:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015469.098024:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5020ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e89f3 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.098107:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5020f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.098140:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5020f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.098155:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5020f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.098172:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5020f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.098179:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5020f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.098185:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5020f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.098506:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5020ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.098517:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5020ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.099746:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5020ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015469.099824:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:3.0:1786015469.101367:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5020f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.101380:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5020f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.101388:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5020f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.101407:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015469.101412:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5020f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.101419:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5020f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.101436:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:3.0:1786015469.101439:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015469.101444:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5020f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.101449:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5020f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.101466:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5020f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.101472:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5020f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.101478:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5020f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.101483:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbdc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015469.101486:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5020f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.101492:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5020f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.101511:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff8b74a04b5b00) 00010000:00010000:3.0:1786015469.101514:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015469.101595:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5020f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.101603:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5020f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.101667:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5020ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89f3 expref: 98 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.101683:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5020ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89f3 expref: 97 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015469.101691:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232dd00) 00010000:00010000:3.0:1786015469.101693:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015469.101696:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbcc00, rc 0) 00000100:00100000:3.0:1786015469.101798:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+97:29402:x1872772280538112:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3826us (4858us total) trans 4294968065 rc 0/0 00000100:00100000:3.0:1786015469.101807:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1164 00000100:00100000:3.0:1786015469.122659:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015469.122829:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280538240 00000100:00100000:2.0:1786015469.122841:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280538240 00000100:00100000:2.0:1786015469.122904:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1165 00000100:00100000:2.0:1786015469.122913:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+97:29402:x1872772280538240:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:2.0:1786015469.122987:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50210d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015469.123024:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50210d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015469.123039:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50210d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015469.123071:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50210d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015469.123079:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50210d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015469.123085:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50210d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015469.123092:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015469.123096:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50210d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015469.123103:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50210d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015469.123115:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232dd00) 00010000:00010000:2.0:1786015469.123118:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786015469.123123:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50210d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015469.123129:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50210d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015469.123201:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+97:29402:x1872772280538240:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 288us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015469.123215:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1165 00000100:00100000:3.0:1786015469.137837:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015469.137933:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280538496 00000100:00100000:0.0:1786015469.137944:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280538496 00000100:00100000:0.0:1786015469.138018:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 233 00000100:00100000:0.0:1786015469.138028:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+97:29402:x1872772280538496:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:0.0:1786015469.138270:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+98:29402:x1872772280538496:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 242us (443us total) trans 4294968066 rc 0/0 00000100:00100000:0.0:1786015469.138278:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 233 00010000:00010000:0.0:1786015469.420148:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015470.262979:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304425728:0@lo:400:kworker.0 00000100:00100000:1.0:1786015470.263094:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015470.263167:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304426240:0@lo:400:kworker.0 00000100:00100000:1.0:1786015470.263200:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015470.263234:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015470.263240:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304425856:0@lo:400:kworker.0 00000100:00100000:1.0:1786015470.263266:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015470.263318:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304425728 00000100:00100000:1.0:1786015470.263329:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304425728 00000100:00100000:1.0:1786015470.263392:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304425856 00000100:00100000:1.0:1786015470.263396:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304425856 00000100:00100000:1.0:1786015470.263437:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1786015470.263448:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304425728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015470.263522:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304425728:12345-0@lo:400:kworker.0 Request processed in 74us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015470.263531:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1786015470.263551:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1786015470.263558:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304425856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015470.263585:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304425856:12345-0@lo:400:kworker.0 Request processed in 28us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015470.263591:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1786015470.263623:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304426240 00000100:00100000:1.0:1786015470.263627:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304426240 00000100:00100000:1.0:1786015470.263662:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1786015470.263669:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304426240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015470.263707:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304426240:12345-0@lo:400:kworker.0 Request processed in 40us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015470.263714:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00080000:1.0:1786015470.263757:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015470.263786:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015470.263832:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304425856:0@lo:400:kworker.0 00000100:00100000:1.0:1786015470.263843:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304425728:0@lo:400:kworker.0 00000100:00100000:1.0:1786015470.263852:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304426240:0@lo:400:kworker.0 00000100:00100000:3.0:1786015470.264267:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304425984:0@lo:400:kworker.0 00000100:00100000:3.0:1786015470.264316:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015470.264379:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786015470.264386:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304425600:0@lo:400:kworker.0 00000100:00100000:3.0:1786015470.264421:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015470.264468:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304426112:0@lo:400:kworker.0 00000100:00100000:3.0:1786015470.264496:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015470.264529:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304425600 00000100:00100000:3.0:1786015470.264535:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304425600 00000100:00100000:3.0:1786015470.264571:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:3.0:1786015470.264578:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304425600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015470.264634:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304425600:12345-0@lo:400:kworker.0 Request processed in 56us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015470.264640:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:3.0:1786015470.264675:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304426112 00000100:00100000:3.0:1786015470.264679:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304426112 00000100:00100000:3.0:1786015470.264709:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:3.0:1786015470.264715:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304426112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015470.264799:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304426112:12345-0@lo:400:kworker.0 Request processed in 84us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015470.264806:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:3.0:1786015470.264840:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304425600:0@lo:400:kworker.0 00000100:00100000:3.0:1786015470.264852:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304426112:0@lo:400:kworker.0 00000100:00100000:1.0:1786015470.267043:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304425984 00000100:00100000:1.0:1786015470.267065:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304425984 00000100:00100000:1.0:1786015470.267148:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1786015470.267159:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304425984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015470.267282:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304425984:12345-0@lo:400:kworker.0 Request processed in 126us (2965us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015470.267288:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00080000:1.0:1786015470.267314:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015470.267320:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015470.267369:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967356 gen 2 00000004:00080000:1.0:1786015470.267377:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967355 committed transno 4294967356 00000004:00080000:1.0:1786015470.267401:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b74b8978e00, transno 4294967356 00000100:00100000:1.0:1786015470.267417:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304425984:0@lo:400:kworker.0 00010000:00010000:1.0:1786015470.446626:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786015470.770776:0:7781:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 706022010641ns, next at 707021994764ns, rc = 0 00000100:00100000:0.0:1786015470.770831:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304426368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015470.770934:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015470.771079:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304426368 00000100:00100000:2.0:1786015470.771092:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304426368 00000100:00100000:2.0:1786015470.771164:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1786015470.771176:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304426368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015470.771223:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015470.771292:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304426368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015470.771301:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1786015470.771389:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304426368:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786015471.468442:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786015471.889167:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967368 is committed 00000004:00080000:3.0:1786015471.935498:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 22 committed 00000001:00080000:3.0:1786015471.935544:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968066 is committed 00000001:00080000:3.0:1786015471.935570:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968061 is committed 00000001:00080000:3.0:1786015471.935589:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968063 is committed 00000004:00080000:3.0:1786015471.935592:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 21 committed 00000100:00100000:2.0:1786015471.936126:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786015471.942899:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304426496:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786015471.943143:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015471.943496:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304426496 00000100:00100000:1.0:1786015471.943509:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304426496 00000100:00100000:1.0:1786015471.943589:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1786015471.943602:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304426496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786015471.943646:0:11384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:25 count 1 00002000:00010000:1.0:1786015471.943697:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 158, mtime: 0x6a746ee4, atime: 0x6a746ee4, ctime: 0x6a746ee4, blocks: 0xb 00010000:00010000:1.0:1786015471.943717:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c502114 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015471.943738:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=707s v=(0 0) 00010000:00010000:1.0:1786015471.943745:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015471.943753:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c502114 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015471.943810:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c502114 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015471.943822:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c502114 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015471.943831:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c502114 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015471.943855:0:11384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786015471.944988:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786015471.945011:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c502114 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015471.945025:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47a00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015471.945031:0:6606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c502114 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015471.945042:0:6606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c502114 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015471.945066:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c502114 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015471.945075:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041442349/0xb1a5ef690c502114 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015471.945100:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015471.945103:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015471.945105:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015471.945274:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304426496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1672us (2129us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1786015471.945282:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000004:00080000:0.0:1786015471.945484:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b74b8c5dc00/2, rc 0, transno 4294967369 00000100:00100000:0.0:1786015471.945493:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304426496:0@lo:6:osp-syn-1-0.0 00000040:00080000:2.0:1786015472.044323:0:20483:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015472.044342:0:20483:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015472.044398:0:20483:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 33 count 3 00000040:00080000:2.0:1786015472.044408:0:20483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015472.492423:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015473.516339:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015473.734465:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015473.734512:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015473.734546:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015473.734569:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015473.734589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015473.734613:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015473.734648:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015473.734695:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280538880 00000100:00100000:1.0:1786015473.734709:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280538880 00000100:00100000:1.0:1786015473.734812:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280539392 00000100:00100000:1.0:1786015473.734816:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280539392 00000100:00100000:1.0:1786015473.734834:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280539008 00000100:00100000:1.0:1786015473.734837:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280539008 00000100:00100000:1.0:1786015473.734849:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280539264 00000100:00100000:1.0:1786015473.734851:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280539264 00000100:00100000:1.0:1786015473.734876:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 457 00000100:00100000:1.0:1786015473.734889:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+15:2353:x1872772280538880:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015473.734990:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+15:2353:x1872772280538880:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 104us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015473.734998:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 457 00000100:00100000:1.0:1786015473.735016:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 458 00000100:00100000:1.0:1786015473.735022:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280539392:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015473.735045:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280539392:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015473.735050:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 458 00000100:00100000:1.0:1786015473.735059:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 459 00000100:00100000:1.0:1786015473.735064:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280539008:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015473.735081:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280539008:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 18us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015473.735086:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 459 00000100:00100000:1.0:1786015473.735094:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 460 00000100:00100000:1.0:1786015473.735099:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280539264:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015473.735117:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280539264:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 18us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015473.735123:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 460 00000100:00100000:1.0:1786015473.735142:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280539136 00000100:00100000:1.0:1786015473.735146:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280539136 00000100:00100000:1.0:1786015473.735174:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280538752 00000100:00100000:1.0:1786015473.735177:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280538752 00000100:00100000:1.0:1786015473.735201:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 470 00000100:00100000:1.0:1786015473.735208:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2353:x1872772280539136:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015473.735239:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2353:x1872772280539136:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015473.735245:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 470 00000100:00100000:1.0:1786015473.735257:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 471 00000100:00100000:1.0:1786015473.735264:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+95:2353:x1872772280538752:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015473.735293:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+95:2353:x1872772280538752:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015473.735299:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 471 00000100:00080000:1.0:1786015473.735331:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015473.735337:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015473.735339:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015473.736242:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280538624 00000100:00100000:3.0:1786015473.736264:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280538624 00000100:00100000:3.0:1786015473.736338:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 591 00000100:00100000:3.0:1786015473.736347:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280538624:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015473.736403:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280538624:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 57us (1953us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015473.736410:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 591 00000100:00100000:1.0:1786015473.836233:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786015473.836267:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304426624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015473.836374:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015473.836468:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304426624 00000100:00100000:1.0:1786015473.836479:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304426624 00000100:00100000:1.0:1786015473.836566:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1786015473.836577:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304426624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015473.836628:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015473.836681:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304426624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015473.836701:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:1.0:1786015473.836729:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015473.836799:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304426624:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786015474.540162:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015475.372229:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304426752:0@lo:400:kworker.0 00000100:00100000:0.0:1786015475.372352:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015475.372456:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015475.372479:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304426880:0@lo:400:kworker.0 00000100:00100000:0.0:1786015475.372512:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015475.372576:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786015475.372586:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304427008:0@lo:400:kworker.0 00000100:00100000:0.0:1786015475.372615:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015475.373220:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304426752 00000100:00100000:3.0:1786015475.373232:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304426752 00000100:00100000:3.0:1786015475.373297:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:3.0:1786015475.373308:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74864ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304426752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015475.373395:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74864ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304426752:12345-0@lo:400:kworker.0 Request processed in 88us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015475.373404:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:3.0:1786015475.373472:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304426752:0@lo:400:kworker.0 00000100:00100000:3.0:1786015475.373540:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304426880 00000100:00100000:3.0:1786015475.373544:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304426880 00000100:00100000:3.0:1786015475.373578:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304427008 00000100:00100000:3.0:1786015475.373581:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304427008 00000100:00100000:3.0:1786015475.373618:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:3.0:1786015475.373626:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304426880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015475.373803:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304426880:12345-0@lo:400:kworker.0 Request processed in 176us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015475.373811:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:3.0:1786015475.373825:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:3.0:1786015475.373831:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304427008:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1786015475.382537:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015475.382689:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304426880:0@lo:400:kworker.0 00000100:00100000:3.0:1786015475.383517:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304427008:12345-0@lo:400:kworker.0 Request processed in 9681us (10896us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015475.383533:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:1.0:1786015475.383849:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304427264:0@lo:400:kworker.0 00000100:00100000:1.0:1786015475.383928:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015475.383980:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304427264 00000100:00100000:1.0:1786015475.383988:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304427264 00000100:00100000:1.0:1786015475.384057:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1786015475.384065:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304427264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015475.384832:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304427264:12345-0@lo:400:kworker.0 Request processed in 763us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015475.384841:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00080000:1.0:1786015475.384871:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015475.384907:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304427264:0@lo:400:kworker.0 00000100:00100000:1.0:1786015475.384954:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015475.384962:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304427392:0@lo:400:kworker.0 00000100:00100000:1.0:1786015475.385014:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015475.385052:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304427392 00000100:00100000:1.0:1786015475.385057:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304427392 00000100:00100000:1.0:1786015475.385399:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1786015475.385408:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304427392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015475.385455:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304427392:12345-0@lo:400:kworker.0 Request processed in 48us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015475.385462:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00080000:1.0:1786015475.385481:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015475.385502:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304427392:0@lo:400:kworker.0 00000100:00100000:2.0:1786015475.385892:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304427136:0@lo:400:kworker.0 00000100:00100000:2.0:1786015475.385935:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015475.385972:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304427008:0@lo:400:kworker.0 00000100:00100000:1.0:1786015475.386091:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304427136 00000100:00100000:1.0:1786015475.386097:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304427136 00000100:00080000:2.0:1786015475.386191:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015475.386343:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1786015475.386353:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304427136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015475.386418:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304427136:12345-0@lo:400:kworker.0 Request processed in 66us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015475.386425:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:2.0:1786015475.386482:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304427136:0@lo:400:kworker.0 00010000:00010000:0.0:1786015475.564116:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015475.885407:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786015475.902231:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304427520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015475.902346:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015475.908987:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304427520 00000100:00100000:0.0:1786015475.909012:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304427520 00000100:00100000:0.0:1786015475.909345:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1786015475.909362:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304427520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015475.909420:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015475.909824:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304427520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 465us (7476us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015475.909833:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1786015475.910238:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304427520:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1786015476.140464:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015476.140477:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015476.140942:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 33 count 2 00000040:00080000:1.0:1786015476.140953:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015476.594744:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786015477.012240:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967369 is committed 00010000:00010000:1.0:1786015477.612161:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015478.636004:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015478.846678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015478.846733:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015478.846805:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015478.846828:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015478.846858:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015478.846879:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280539904 00000100:00100000:3.0:1786015478.846887:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280539904 00000100:00100000:3.0:1786015478.846930:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280539776 00000100:00100000:3.0:1786015478.846932:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280539776 00000100:00100000:3.0:1786015478.846953:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 463 00000100:00100000:3.0:1786015478.846962:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280539904:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015478.846979:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280539520 00000100:00100000:0.0:1786015478.846992:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280539520 00000100:00100000:3.0:1786015478.847035:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280539904:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 73us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015478.847043:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 463 00000100:00100000:0.0:1786015478.847066:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 593 00000100:00100000:3.0:1786015478.847067:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 464 00000100:00100000:3.0:1786015478.847079:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+15:2352:x1872772280539776:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015478.847088:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74864ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280539520:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015478.847099:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+15:2352:x1872772280539776:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015478.847106:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 464 00000100:00100000:3.0:1786015478.847123:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280539648 00000100:00100000:3.0:1786015478.847128:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280539648 00000100:00100000:3.0:1786015478.847157:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280540032 00000100:00100000:0.0:1786015478.847161:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74864ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280539520:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 78us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015478.847169:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 593 00000100:00100000:3.0:1786015478.847178:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280540032 00000100:00100000:3.0:1786015478.847226:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 475 00000100:00100000:3.0:1786015478.847235:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+95:2352:x1872772280539648:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015478.847290:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+95:2352:x1872772280539648:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 56us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015478.847295:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 475 00000100:00100000:3.0:1786015478.847313:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 476 00000100:00100000:3.0:1786015478.847320:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2352:x1872772280540032:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015478.847343:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2352:x1872772280540032:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015478.847349:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 476 00000100:00080000:2.0:1786015478.847848:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786015478.847854:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015478.847857:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015478.850227:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015478.850316:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015478.853625:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280540288 00000100:00100000:1.0:1786015478.853652:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280540288 00000100:00080000:3.0:1786015478.853842:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015478.854082:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280540160 00000100:00100000:1.0:1786015478.854087:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280540160 00000100:00100000:1.0:1786015478.854137:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 465 00000100:00100000:1.0:1786015478.854147:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280540288:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015478.854244:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280540288:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 98us (4025us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015478.854368:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 465 00000100:00100000:1.0:1786015478.854385:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 466 00000100:00100000:1.0:1786015478.854392:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2351:x1872772280540160:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015478.854418:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2351:x1872772280540160:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (4102us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015478.854424:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 466 00000100:00080000:3.0:1786015478.856423:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015478.956269:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786015478.956287:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304427648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015478.956354:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015478.956576:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304427648 00000100:00100000:1.0:1786015478.956584:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304427648 00000100:00100000:1.0:1786015478.956675:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1786015478.956685:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304427648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015478.956720:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015478.956799:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304427648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015478.956807:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:3.0:1786015478.956933:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015478.956962:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304427648:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786015479.660123:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015480.492827:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304428160:0@lo:400:kworker.0 00000100:00100000:0.0:1786015480.492903:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015480.492994:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786015480.493095:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304427904:0@lo:400:kworker.0 00000100:00100000:3.0:1786015480.493131:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015480.493157:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304428416:0@lo:400:kworker.0 00000100:00100000:3.0:1786015480.493178:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015480.493195:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786015480.493217:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304427776:0@lo:400:kworker.0 00000100:00100000:3.0:1786015480.493249:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015480.493271:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304428288:0@lo:400:kworker.0 00000100:00100000:3.0:1786015480.493290:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015480.493322:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304427776 00000100:00100000:3.0:1786015480.493330:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304427776 00000100:00100000:3.0:1786015480.493374:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:3.0:1786015480.493383:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304427776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015480.493447:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304427776:12345-0@lo:400:kworker.0 Request processed in 65us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015480.493455:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:3.0:1786015480.493502:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304427776:0@lo:400:kworker.0 00000100:00100000:3.0:1786015480.493525:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304427904 00000100:00100000:3.0:1786015480.493529:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304427904 00000100:00100000:3.0:1786015480.493552:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304428288 00000100:00100000:3.0:1786015480.493555:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304428288 00000100:00100000:3.0:1786015480.493583:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1786015480.493590:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304427904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015480.493639:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304427904:12345-0@lo:400:kworker.0 Request processed in 49us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015480.493646:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1786015480.493658:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1786015480.493664:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304428288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015480.493692:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304428288:12345-0@lo:400:kworker.0 Request processed in 28us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015480.493698:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00080000:3.0:1786015480.493721:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015480.493742:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304428288:0@lo:400:kworker.0 00000100:00100000:3.0:1786015480.493752:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304427904:0@lo:400:kworker.0 00000100:00100000:0.0:1786015480.494303:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304428032:0@lo:400:kworker.0 00000100:00100000:0.0:1786015480.494340:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015480.498312:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304428032 00000100:00100000:3.0:1786015480.498329:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304428032 00000100:00100000:3.0:1786015480.498427:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1786015480.498438:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304428032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015480.498542:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304428032:12345-0@lo:400:kworker.0 Request processed in 106us (4200us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015480.498550:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:1.0:1786015480.498732:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304428160 00000100:00100000:1.0:1786015480.498737:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304428160 00000100:00100000:1.0:1786015480.498786:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304428416 00000100:00100000:1.0:1786015480.498789:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304428416 00000100:00100000:1.0:1786015480.498819:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1786015480.498826:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304428160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015480.498864:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304428160:12345-0@lo:400:kworker.0 Request processed in 39us (5962us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015480.498869:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1786015480.498880:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1786015480.498884:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304428416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015480.498912:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304428416:12345-0@lo:400:kworker.0 Request processed in 28us (5733us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015480.498917:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1786015480.500720:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967369 gen 2 00000004:00080000:3.0:1786015480.500732:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b74b8c5dc00, transno 4294967369 00000100:00100000:3.0:1786015480.500752:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304428416:0@lo:400:kworker.0 00000100:00080000:0.0:1786015480.502497:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015480.502507:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015480.502510:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015480.502565:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304428032:0@lo:400:kworker.0 00000100:00100000:0.0:1786015480.502581:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304428160:0@lo:400:kworker.0 00010000:00010000:1.0:1786015480.685504:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015481.004443:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304428544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015481.004526:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015481.004729:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304428544 00000100:00100000:1.0:1786015481.004737:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304428544 00000100:00100000:1.0:1786015481.004812:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1786015481.004821:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b7e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304428544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015481.004862:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015481.005044:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304428544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015481.005216:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b7e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304428544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 394us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015481.005224:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00010000:00010000:1.0:1786015481.708133:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015482.732003:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015483.756041:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015483.968613:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015483.968661:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015483.968698:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015483.968726:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015483.968863:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280540416 00000100:00100000:3.0:1786015483.968874:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280540416 00000100:00100000:3.0:1786015483.968938:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 595 00000100:00100000:3.0:1786015483.968948:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280540416:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015483.969029:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280540416:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 82us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015483.969036:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 595 00000100:00100000:3.0:1786015483.969071:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280540672 00000100:00100000:3.0:1786015483.969074:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280540672 00000100:00100000:3.0:1786015483.969105:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280541184 00000100:00100000:3.0:1786015483.969122:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280541184 00000100:00100000:3.0:1786015483.969147:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 469 00000100:00100000:3.0:1786015483.969154:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+15:2354:x1872772280540672:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015483.969197:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+15:2354:x1872772280540672:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 43us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015483.969203:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 469 00000100:00100000:3.0:1786015483.969215:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 470 00000100:00100000:3.0:1786015483.969222:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280541184:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015483.969246:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280541184:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015483.969251:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 470 00000100:00100000:1.0:1786015483.969788:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280540928 00000100:00100000:1.0:1786015483.969794:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280540928 00000100:00100000:1.0:1786015483.969839:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 480 00000100:00100000:1.0:1786015483.969846:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2354:x1872772280540928:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015483.969898:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2354:x1872772280540928:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 52us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015483.969906:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 480 00000100:00080000:0.0:1786015483.970488:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015483.970494:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015483.970496:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015483.971402:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015483.971479:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015483.971511:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015483.973439:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280540800 00000100:00100000:2.0:1786015483.973453:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280540800 00000100:00100000:2.0:1786015483.973543:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280541056 00000100:00100000:2.0:1786015483.973547:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280541056 00000100:00100000:2.0:1786015483.973599:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 471 00000100:00100000:2.0:1786015483.973609:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280540800:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015483.973691:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280540800:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 84us (2211us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015483.973698:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 471 00000100:00100000:2.0:1786015483.973715:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 472 00000100:00100000:2.0:1786015483.973721:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280541056:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015483.973746:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280541056:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (2235us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015483.973752:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 472 00000100:00080000:0.0:1786015483.974172:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015483.974177:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015483.974649:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280540544 00000100:00100000:3.0:1786015483.974656:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280540544 00000100:00100000:3.0:1786015483.974758:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 481 00000100:00100000:3.0:1786015483.974794:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+95:2354:x1872772280540544:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015483.974852:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+95:2354:x1872772280540544:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 59us (3454us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015483.974858:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 481 00000100:00080000:0.0:1786015483.975391:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015484.077477:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786015484.077505:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304428672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015484.077607:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015484.077797:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304428672 00000100:00100000:1.0:1786015484.077807:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304428672 00000100:00100000:1.0:1786015484.077878:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1786015484.077888:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304428672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015484.077935:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015484.077986:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304428672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015484.077994:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:2.0:1786015484.078270:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015484.079178:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304428672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015484.182160:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015484.182442:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280541440 00000100:00100000:3.0:1786015484.182455:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280541440 00000100:00100000:3.0:1786015484.182516:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1166 00000100:00100000:3.0:1786015484.182685:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+95:29447:x1872772280541440:12345-192.168.202.56@tcp:101:diff.0 00010000:00010000:3.0:1786015484.182710:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015484.182734:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c50211b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e89fa expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.182871:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502122 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.182886:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502122 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.182898:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502122 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015484.182909:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:3.0:1786015484.183079:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c50211b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89fa expref: 98 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.183114:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502122 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89fa expref: 97 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.183123:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232dd00) 00010000:00010000:3.0:1786015484.183126:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015484.183130:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbce00, rc 0) 00000100:00100000:3.0:1786015484.183199:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+97:29447:x1872772280541440:12345-192.168.202.56@tcp:101:diff.0 Request processed in 517us (1048us total) trans 4294968067 rc 0/0 00000100:00100000:3.0:1786015484.184998:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1166 00000100:00100000:2.0:1786015484.201129:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015484.201395:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280541568 00000100:00100000:3.0:1786015484.201405:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280541568 00000100:00100000:3.0:1786015484.201494:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:3.0:1786015484.201504:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+97:2352:x1872772280541568:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015484.201520:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015484.201559:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502122 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89fa expref: 97 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.201579:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232dd00) 00010000:00010000:3.0:1786015484.201593:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015484.201655:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+96:2352:x1872772280541568:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 154us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015484.201663:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:2.0:1786015484.202905:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015484.203042:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280541824 00000100:00100000:1.0:1786015484.203050:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280541824 00000100:00100000:1.0:1786015484.203107:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:1.0:1786015484.203116:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+96:29447:x1872772280541824:12345-192.168.202.56@tcp:103:diff.0 00010000:00010000:1.0:1786015484.203129:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1786015484.203149:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5020ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89f3 expref: 96 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.203171:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c502011 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e89ad expref: 95 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.203181:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b749232dd00) 00010000:00010000:1.0:1786015484.203191:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015484.203251:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+94:29447:x1872772280541824:12345-192.168.202.56@tcp:103:diff.0 Request processed in 136us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015484.203262:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:0.0:1786015484.224745:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015484.224896:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280541952 00000100:00100000:3.0:1786015484.224908:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280541952 00000100:00100000:3.0:1786015484.224983:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1167 00000100:00100000:3.0:1786015484.224994:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+94:29447:x1872772280541952:12345-192.168.202.56@tcp:58:diff.0 00010000:00010000:3.0:1786015484.225120:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502130 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.225138:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502130 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.225151:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502130 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786015484.225519:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].33, 136 off12680 00000100:00100000:3.0:1786015484.225645:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+94:29447:x1872772280541952:12345-192.168.202.56@tcp:58:diff.0 Request processed in 651us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015484.225654:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1167 00000100:00100000:3.0:1786015484.230141:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015484.230389:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280542080 00000100:00100000:1.0:1786015484.230400:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280542080 00000100:00100000:1.0:1786015484.230458:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1168 00000100:00100000:1.0:1786015484.230468:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+94:29447:x1872772280542080:12345-192.168.202.56@tcp:101:diff.0 00010000:00010000:1.0:1786015484.230489:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015484.230513:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c502137 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a01 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.230579:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502130 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.230599:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c502137 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a01 expref: 95 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.230618:0:12526:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502130 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.230632:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c502137 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a01 expref: 95 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.230645:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b74a04b5300) 00010000:00010000:1.0:1786015484.230648:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015484.230652:0:12526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c502137 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a01 expref: 95 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.230659:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46600, rc 0) 00000100:00100000:1.0:1786015484.230719:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+95:29447:x1872772280542080:12345-192.168.202.56@tcp:101:diff.0 Request processed in 253us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015484.230726:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1168 00000040:00080000:1.0:1786015484.332917:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015484.332927:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015484.332985:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 34 count 3 00000040:00080000:1.0:1786015484.332992:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015484.333127:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304428800:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015484.333457:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748f268e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786015484.345932:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015484.346052:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280542208 00000100:00100000:0.0:1786015484.346062:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280542208 00000100:00100000:0.0:1786015484.346125:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1169 00000100:00100000:0.0:1786015484.346138:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:29448:x1872772280542208:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015484.346186:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015484.346297:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:29448:x1872772280542208:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 161us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015484.346306:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1169 00000100:00100000:1.0:1786015484.346688:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304428800:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786015484.352374:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015484.352665:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280542336 00000100:00100000:0.0:1786015484.352676:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280542336 00000100:00100000:0.0:1786015484.352738:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1170 00000100:00100000:0.0:1786015484.352747:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29448:x1872772280542336:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1786015484.352859:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c50213e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.352876:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c50213e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.352887:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c50213e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.352902:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502145 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.352909:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502145 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.352916:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502145 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.352938:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50214c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.352950:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50214c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353068:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50214c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015484.353109:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00000004:00200000:0.0:1786015484.353114:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015484.353128:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50214c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353139:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c50213e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353145:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c50213e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353152:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c50213e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353262:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015484.353267:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c50213e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353274:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c50213e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353286:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:0.0:1786015484.353289:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015484.353294:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c50213e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353305:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c50213e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353319:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502145 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353324:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502145 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353330:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502145 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353336:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015484.353338:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502145 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353344:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502145 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353350:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x329c2aeb (ffff8b748f24a300) 00010000:00010000:0.0:1786015484.353352:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015484.353355:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502145 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353360:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502145 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353373:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50214c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353379:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50214c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353386:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50214c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353391:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015484.353393:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50214c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353399:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50214c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353405:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b74a04b5300) 00010000:00010000:0.0:1786015484.353407:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015484.353409:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50214c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.353414:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50214c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015484.353486:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29448:x1872772280542336:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 739us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015484.353495:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1170 00000100:00100000:2.0:1786015484.365878:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015484.366469:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280542592 00000100:00100000:3.0:1786015484.366481:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280542592 00000100:00100000:3.0:1786015484.366549:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1171 00000100:00100000:3.0:1786015484.366560:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29448:x1872772280542592:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015484.366591:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015484.366617:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502153 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a08 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.366724:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50215a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.366739:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50215a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.366751:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50215a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015484.366791:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:3.0:1786015484.366890:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50215a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.366898:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50215a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.366904:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50215a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.367032:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015484.367036:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50215a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.367059:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50215a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.367072:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b74a04b5300) 00010000:00010000:3.0:1786015484.367075:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015484.367080:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50215a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.367085:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50215a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.367130:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502153 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a08 expref: 46 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.367139:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:3.0:1786015484.367141:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786015484.367146:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502153 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a08 expref: 46 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.367559:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc400, rc 0) 00000100:00100000:3.0:1786015484.367654:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+45:29448:x1872772280542592:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1094us (1784us total) trans 4294968068 rc 301/301 00000100:00100000:3.0:1786015484.367664:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1171 00000100:00100000:3.0:1786015484.374700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015484.376381:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280542720 00000100:00100000:2.0:1786015484.376420:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280542720 00000100:00100000:2.0:1786015484.376518:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1172 00000100:00100000:2.0:1786015484.376530:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+45:29448:x1872772280542720:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015484.376576:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015484.378644:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+45:29448:x1872772280542720:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 2098us (3935us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015484.378661:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1172 00000100:00100000:2.0:1786015484.397462:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015484.397885:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280542976 00000100:00100000:0.0:1786015484.397898:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280542976 00000100:00100000:0.0:1786015484.397980:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1173 00000100:00100000:0.0:1786015484.397991:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+45:29448:x1872772280542976:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015484.398014:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015484.398038:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502168 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a0f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.399072:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c50216f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.399088:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c50216f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.399100:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c50216f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015484.399111:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x22:0x0]: returning size 0 00010000:00010000:0.0:1786015484.399162:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502168 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a0f expref: 48 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.399181:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c50216f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a0f expref: 47 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.399189:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8b748f24a300) 00010000:00010000:0.0:1786015484.399192:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015484.399196:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd600, rc 0) 00000100:00100000:0.0:1786015484.399274:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+47:29448:x1872772280542976:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1283us (1820us total) trans 4294968069 rc 0/0 00000100:00100000:0.0:1786015484.399282:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1173 00000100:00100000:0.0:1786015484.413345:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015484.414010:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280543232 00000100:00100000:3.0:1786015484.414023:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280543232 00000100:00100000:3.0:1786015484.414265:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1174 00000100:00100000:3.0:1786015484.414279:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:29448:x1872772280543232:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786015484.414359:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015484.414389:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c50216f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a0f expref: 47 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.414408:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8b748f24a300) 00010000:00010000:3.0:1786015484.414419:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015484.414445:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50217d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.414459:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50217d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.414469:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50217d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.414485:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502184 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x46:0x0].0xb6517d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.414491:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502184 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0xb6517d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.414497:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502184 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0xb6517d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.415044:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50217d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.415053:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50217d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.415060:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50217d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.415073:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015484.415077:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50217d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.415084:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50217d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.415093:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:3.0:1786015484.415096:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015484.415110:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50217d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.415117:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c50217d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.415128:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502184 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0xb6517d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.415133:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502184 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0xb6517d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.415139:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502184 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0xb6517d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.415144:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015484.415146:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502184 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0xb6517d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.415151:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502184 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0xb6517d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.415170:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0xb6517d7 (ffff8b74a04b5900) 00010000:00010000:3.0:1786015484.415172:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015484.415175:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502184 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0xb6517d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.415180:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502184 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0xb6517d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015484.415317:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+46:29448:x1872772280543232:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 1039us (1981us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786015484.423743:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1174 00000100:00100000:3.0:1786015484.426429:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015484.426548:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280543360 00000100:00100000:0.0:1786015484.426558:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280543360 00000100:00100000:0.0:1786015484.426630:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1175 00000100:00100000:0.0:1786015484.426640:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+46:29448:x1872772280543360:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015484.426666:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015484.426691:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50218b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a16 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.426732:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502192 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.426746:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502192 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.426758:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502192 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.427182:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50218b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a16 expref: 48 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.427200:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502192 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a16 expref: 47 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.427209:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:0.0:1786015484.427212:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015484.427215:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afcc00, rc 0) 00000100:00100000:0.0:1786015484.427470:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+47:29448:x1872772280543360:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 830us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015484.427478:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1175 00000100:00100000:0.0:1786015484.441364:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015484.447215:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280543616 00000100:00100000:3.0:1786015484.447233:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280543616 00000100:00100000:2.0:1786015484.447597:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1176 00000100:00100000:2.0:1786015484.447610:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+47:29448:x1872772280543616:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786015484.447709:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502199 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.447726:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502199 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.447738:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502199 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015484.448035:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ed852cb4 reply state 00000000284fa1b2 transno 4294968070 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502199 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015484.448047:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786015484.448160:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+49:29448:x1872772280543616:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 551us (6805us total) trans 4294968070 rc 0/0 00000100:00100000:2.0:1786015484.448168:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1176 00010000:00010000:2.0:1786015484.451025:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502199 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.451067:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502199 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.451075:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502199 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.451082:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015484.451088:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502199 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.451095:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502199 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.451113:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:2.0:1786015484.451117:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786015484.451121:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502199 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.451127:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502199 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015484.457860:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015484.458074:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280543744 00000100:00100000:3.0:1786015484.458086:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280543744 00000100:00100000:3.0:1786015484.458142:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1177 00000100:00100000:3.0:1786015484.458153:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:29448:x1872772280543744:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015484.458180:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015484.458206:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c5021a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a1d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.458275:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c5021a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a1d expref: 49 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.458291:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c5021a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a1d expref: 49 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.458306:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:3.0:1786015484.458309:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015484.458313:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc000, rc 0) 00000100:00100000:3.0:1786015484.458381:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:29448:x1872772280543744:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 230us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015484.458389:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1177 00000100:00100000:1.0:1786015484.466048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015484.466230:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280543872 00000100:00100000:3.0:1786015484.466243:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280543872 00000100:00100000:3.0:1786015484.466317:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 234 00000100:00100000:3.0:1786015484.466326:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+49:29448:x1872772280543872:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1786015484.466490:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+49:29448:x1872772280543872:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 Request processed in 164us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015484.466497:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 234 00000100:00100000:0.0:1786015484.473899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015484.474062:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280544128 00000100:00100000:3.0:1786015484.474074:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280544128 00000100:00100000:3.0:1786015484.474146:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 235 00000100:00100000:3.0:1786015484.474157:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+49:29448:x1872772280544128:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786015484.474430:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+50:29448:x1872772280544128:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 274us (541us total) trans 4294968071 rc 0/0 00000100:00100000:3.0:1786015484.474439:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 235 00000100:00100000:2.0:1786015484.490170:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015484.490930:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280544384 00000100:00100000:3.0:1786015484.490942:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280544384 00000100:00100000:3.0:1786015484.490999:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1178 00000100:00100000:3.0:1786015484.491010:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+50:29448:x1872772280544384:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786015484.491134:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+50:29448:x1872772280544384:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 125us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015484.491142:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1178 00000100:00100000:1.0:1786015484.498293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015484.498631:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280544640 00000100:00100000:3.0:1786015484.498642:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280544640 00000100:00100000:3.0:1786015484.498717:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1179 00000100:00100000:3.0:1786015484.498729:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+50:29448:x1872772280544640:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015484.498790:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015484.498817:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5021a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a24 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.498929:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5021ae lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.498945:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c5021a0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a1d expref: 51 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.498954:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5021ae lrc: 4/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.498991:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c5021a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a1d expref: 51 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.499007:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c5021a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a1d expref: 51 pid: 5795 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015484.499022:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304428928:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015484.499218:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486540780 going to sleep for 11 seconds 00000100:00100000:1.0:1786015484.501547:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304428928:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015484.501575:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5021ae lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015484.503188:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015484.503319:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280544768 00000100:00100000:3.0:1786015484.503328:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280544768 00010000:00010000:3.0:1786015484.503370:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c5021a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a1d expref: 52 pid: 5795 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015484.503421:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 351 00000100:00100000:3.0:1786015484.503431:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b024f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+52:2353:x1872772280544768:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015484.503446:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015484.503453:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c5021a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a1d expref: 52 pid: 5795 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.503466:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c5021a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a1d expref: 52 pid: 5795 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.503490:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c5021a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a1d expref: 52 pid: 5795 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.503506:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:3.0:1786015484.503510:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5021ae lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.503519:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5021ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.503526:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5021ae lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.503547:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015484.503624:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b024f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+51:2353:x1872772280544768:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 193us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015484.503632:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 351 00010000:00010000:1.0:1786015484.504322:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5021ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.504332:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5021ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015484.504351:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x22:0x0]: returning size 0 00000004:00080000:1.0:1786015484.504700:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x17:0x0], index 0: 0 00010000:00010000:1.0:1786015484.505070:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5021ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.505079:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5021ae lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.505087:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5021ae lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.505093:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015484.505098:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5021ae lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.505106:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5021ae lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.505119:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:1.0:1786015484.505122:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015484.505126:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5021ae lrc: 2/0,0 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.505132:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5021ae lrc: 0/0,0 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.505186:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5021a7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a24 expref: 51 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.505196:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8b74a04b5200) 00010000:00010000:1.0:1786015484.505199:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786015484.505202:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5021a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a24 expref: 51 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.505212:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc800, rc 0) 00000100:00100000:1.0:1786015484.505275:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+50:29448:x1872772280544640:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 6547us (6992us total) trans 4294968072 rc 301/301 00000100:00100000:1.0:1786015484.505289:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1179 00000100:00100000:1.0:1786015484.520644:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015484.522799:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280545024 00000100:00100000:3.0:1786015484.522815:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280545024 00000100:00100000:3.0:1786015484.522892:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 236 00000100:00100000:3.0:1786015484.522904:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+50:29448:x1872772280545024:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786015484.523274:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:29448:x1872772280545024:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 372us (2641us total) trans 4294968073 rc 0/0 00000100:00100000:3.0:1786015484.523282:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 236 00000100:00100000:2.0:1786015484.528615:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015484.528693:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280545152 00000100:00100000:1.0:1786015484.528703:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280545152 00000100:00100000:1.0:1786015484.528793:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1180 00000100:00100000:1.0:1786015484.528803:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+51:29448:x1872772280545152:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015484.528828:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015484.528849:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5021bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a2b expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.528923:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5021c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.528937:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5021c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.528949:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5021c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015484.528988:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x22:0x0]: returning size 0 00000004:00200000:1.0:1786015484.528992:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015484.529013:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5021c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.529039:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c5021bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a2b expref: 53 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.529059:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5021c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a2b expref: 52 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.529073:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:1.0:1786015484.529076:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786015484.529080:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46e00, rc 0) 00000100:00100000:1.0:1786015484.529145:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+52:29448:x1872772280545152:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 344us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015484.529152:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1180 00000100:00100000:2.0:1786015484.543308:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015484.547219:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280545280 00000100:00100000:0.0:1786015484.547239:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280545280 00000100:00100000:0.0:1786015484.547469:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 315 00000100:00100000:0.0:1786015484.547481:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280545280:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015484.547502:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015484.547528:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dca504a0/0xb1a5ef690c5021ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a32 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015484.547558:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786015484.547593:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1786015484.547599:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015484.547610:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dca504a0/0xb1a5ef690c5021ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a32 expref: 9 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.547636:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dca504a0/0xb1a5ef690c5021ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a32 expref: 9 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.547650:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afda00, rc 0) 00000100:00100000:0.0:1786015484.547803:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280545280:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 324us (4502us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015484.547810:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 315 00000100:00100000:1.0:1786015484.559299:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015484.560929:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280545536 00000100:00100000:3.0:1786015484.560947:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280545536 00000100:00100000:3.0:1786015484.561024:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1181 00000100:00100000:3.0:1786015484.561036:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+52:29448:x1872772280545536:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786015484.561473:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+52:29448:x1872772280545536:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 438us (2189us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015484.561482:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1181 00000100:00100000:2.0:1786015484.565012:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015484.565111:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280545664 00000100:00100000:0.0:1786015484.565125:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280545664 00000100:00100000:0.0:1786015484.565195:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 316 00000100:00100000:0.0:1786015484.565207:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:29448:x1872772280545664:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015484.565228:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015484.565249:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c5021d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a39 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.565288:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dca504a0/0xb1a5ef690c5021ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a32 expref: 10 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.565298:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015484.565303:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015484.565310:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c5021d1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a39 expref: 10 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.565344:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dca504a0/0xb1a5ef690c5021ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a32 expref: 10 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.565361:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dca504a0/0xb1a5ef690c5021ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a32 expref: 10 pid: 6592 timeout: 819 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015484.565378:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304429056:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015484.565491:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015484.575378:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304429056:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015484.575423:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c5021d1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a39 expref: 10 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.575446:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd800, rc 0) 00000100:00100000:0.0:1786015484.575520:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:29448:x1872772280545664:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 10314us (10521us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015484.575532:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 316 00000100:00100000:3.0:1786015484.580703:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015484.580806:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280545792 00000100:00100000:2.0:1786015484.580817:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280545792 00010000:00010000:2.0:1786015484.580860:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dca504a0/0xb1a5ef690c5021ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a32 expref: 10 pid: 6592 timeout: 819 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015484.580932:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 352 00000100:00100000:2.0:1786015484.580941:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280545792:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015484.580958:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015484.580984:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dca504a0/0xb1a5ef690c5021ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a32 expref: 10 pid: 6592 timeout: 819 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.580999:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dca504a0/0xb1a5ef690c5021ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a32 expref: 10 pid: 6592 timeout: 819 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.581026:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dca504a0/0xb1a5ef690c5021ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a32 expref: 10 pid: 6592 timeout: 819 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.581044:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015484.581049:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015484.581057:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c5021d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a39 expref: 9 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.581068:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c5021d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a39 expref: 9 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.581109:0:6607:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c5021d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a39 expref: 9 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015484.581124:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304429184:192.168.202.56@tcp:105: 00000100:00100000:2.0:1786015484.581214:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872900 going to sleep for 11 seconds 00000100:00100000:3.0:1786015484.588937:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304429184:192.168.202.56@tcp:105: 00010000:00010000:3.0:1786015484.588970:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015484.589031:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280545792:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 8090us (8337us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015484.589041:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 352 00000100:00100000:3.0:1786015484.602049:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015484.602142:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280545920 00000100:00100000:0.0:1786015484.602153:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280545920 00002000:00100000:0.0:1786015484.602206:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x17:0x0] (0->157) req@ffff8b74b8c5e680 x1872772280545920/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:330/0 lens 648/0 e 0 to 0 dl 1786015495 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015484.602219:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74b8c5e680 with x1872772280545920 ext(0->157) 00002000:00010000:0.0:1786015484.602226:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74b8c5e680 00000100:00100000:0.0:1786015484.602265:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 103 00000100:00100000:0.0:1786015484.602275:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280545920:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1786015484.603081:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280545920:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 803us (1039us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1786015484.603091:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 103 00002000:00100000:0.0:1786015484.603101:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x17:0x0] (0->157) req@ffff8b74b8c5e680 x1872772280545920/t4294967357(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:330/0 lens 648/448 e 0 to 0 dl 1786015495 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015484.603110:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74b8c5e680 with x1872772280545920 ext(0->157) 00002000:00010000:0.0:1786015484.603115:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74b8c5e680 00000100:00100000:2.0:1786015484.615805:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015484.617471:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280546048 00000100:00100000:1.0:1786015484.617484:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280546048 00000100:00100000:1.0:1786015484.617544:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1182 00000100:00100000:1.0:1786015484.617555:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+52:29448:x1872772280546048:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1786015484.730705:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+52:29448:x1872772280546048:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 113143us (114899us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015484.730721:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1182 00000001:00080000:2.0:1786015484.730797:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968069 is committed 00000001:00080000:2.0:1786015484.730813:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968072 is committed 00000001:00080000:2.0:1786015484.730827:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968073 is committed 00000001:00080000:2.0:1786015484.730842:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968067 is committed 00000100:00100000:1.0:1786015484.746986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015484.747034:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280546176 00000100:00100000:1.0:1786015484.747045:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280546176 00000100:00100000:1.0:1786015484.747114:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 317 00000100:00100000:1.0:1786015484.747126:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280546176:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1786015484.788132:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786015484.863485:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967357 is committed 00000100:00100000:1.0:1786015484.864014:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280546176:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 116882us (117031us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015484.864027:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 317 00000100:00100000:1.0:1786015484.876385:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015484.886951:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280546432 00000100:00100000:2.0:1786015484.886970:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280546432 00000100:00100000:2.0:1786015484.887035:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1183 00000100:00100000:2.0:1786015484.887046:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+46:29448:x1872772280546432:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786015484.887110:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015484.887139:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5021c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a2b expref: 46 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.887162:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:2.0:1786015484.887169:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015484.887210:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5021d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.887224:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5021d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.887234:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5021d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015484.887445:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000442b8aa8 reply state 0000000050a792d5 transno 4294968074 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5021d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015484.887467:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786015484.887615:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+47:29448:x1872772280546432:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 569us (11240us total) trans 4294968074 rc 0/0 00000100:00100000:2.0:1786015484.887622:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1183 00010000:00010000:0.0:1786015484.894952:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5021d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.894972:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5021d8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.894981:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5021d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.894993:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015484.894999:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5021d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.895006:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5021d8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.895025:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:0.0:1786015484.895028:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015484.895034:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5021d8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.895039:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c5021d8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015484.897309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015484.901546:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280546560 00000100:00100000:3.0:1786015484.901563:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280546560 00000100:00100000:3.0:1786015484.901634:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1184 00000100:00100000:3.0:1786015484.901644:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+46:29448:x1872772280546560:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015484.901670:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015484.901692:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5021df lrc: 2/0,0 mode: --/CR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a40 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.905940:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5021df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a40 expref: 47 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.905979:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5021df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a40 expref: 47 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.906024:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:3.0:1786015484.906027:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015484.906032:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd200, rc 0) 00000100:00100000:3.0:1786015484.906121:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+47:29448:x1872772280546560:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 4476us (8820us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015484.906131:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1184 00000100:00100000:3.0:1786015484.915016:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015484.915970:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280546688 00000100:00100000:3.0:1786015484.915983:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280546688 00000100:00100000:3.0:1786015484.916053:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 318 00000100:00100000:3.0:1786015484.916064:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280546688:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1786015484.916354:0:14547:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1786015484.916358:0:14547:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb mtime from disk: 0 -> 1786015460 00002000:00010000:3.0:1786015484.916362:0:14547:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb atime from disk: 0 -> 1786015460 00002000:00010000:3.0:1786015484.916364:0:14547:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb ctime from disk: 0 -> 1786015460 00002000:00010000:3.0:1786015484.916366:0:14547:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1786015484.916431:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280546688:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 368us (1424us total) trans 4294967358 rc 0/0 00000100:00100000:3.0:1786015484.916440:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 318 00000100:00100000:3.0:1786015484.925958:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015484.927013:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280546944 00000100:00100000:2.0:1786015484.927027:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280546944 00000100:00100000:2.0:1786015484.927133:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1185 00000100:00100000:2.0:1786015484.927144:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+47:29448:x1872772280546944:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1786015484.927208:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5021e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.927224:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502192 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a16 expref: 47 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.927234:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5021e6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.933377:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502192 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a16 expref: 47 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.933416:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502192 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a16 expref: 47 pid: 5796 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015484.933436:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304429312:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015484.933554:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872900 going to sleep for 11 seconds 00000100:00100000:3.0:1786015484.956340:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015484.956449:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304429312:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015484.956500:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5021e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015484.956589:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280547072 00000100:00100000:1.0:1786015484.956599:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280547072 00010000:00010000:1.0:1786015484.956646:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502192 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a16 expref: 48 pid: 5796 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015484.956693:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 353 00000100:00100000:1.0:1786015484.956702:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+48:2353:x1872772280547072:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015484.956720:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015484.956727:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502192 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a16 expref: 48 pid: 5796 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.956739:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502192 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a16 expref: 48 pid: 5796 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.956807:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502192 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a16 expref: 48 pid: 5796 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.956825:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:1.0:1786015484.956831:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5021e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.956842:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5021e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.956851:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5021e6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.956874:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015484.956932:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2353:x1872772280547072:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 230us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015484.956941:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 353 00010000:00010000:2.0:1786015484.957184:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5021e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.957192:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5021e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.957228:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5021e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.957235:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5021e6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.957241:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5021e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.957248:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015484.957252:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5021e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.957260:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5021e6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.957269:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:2.0:1786015484.957272:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1786015484.957276:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5021e6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.957283:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c5021e6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015484.957346:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+46:29448:x1872772280546944:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 30202us (31397us total) trans 0 rc -22/-22 00000100:00100000:2.0:1786015484.957355:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1185 00000100:00100000:3.0:1786015484.963481:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015484.963562:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280547200 00000100:00100000:0.0:1786015484.963574:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280547200 00000100:00100000:0.0:1786015484.963655:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 319 00000100:00100000:0.0:1786015484.963667:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280547200:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786015484.963907:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000053ed007/0xb1a5ef690c5021ed lrc: 3/1,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.963932:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c5021d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a39 expref: 10 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.963942:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x17:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786015484.963947:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015484.963952:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000053ed007/0xb1a5ef690c5021ed lrc: 4/1,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.963998:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c5021d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a39 expref: 10 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.964013:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c5021d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a39 expref: 10 pid: 6591 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015484.964030:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304429440:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015484.964134:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b749302ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015484.968952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015484.969030:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280547328 00000100:00100000:3.0:1786015484.969041:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280547328 00010000:00010000:3.0:1786015484.969086:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c5021d1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a39 expref: 11 pid: 6591 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015484.969143:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 354 00000100:00100000:1.0:1786015484.969152:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304429440:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015484.969156:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280547328:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015484.969179:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015484.969186:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000053ed007/0xb1a5ef690c5021ed lrc: 3/1,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.969208:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c5021d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a39 expref: 11 pid: 6591 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.969223:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c5021d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a39 expref: 11 pid: 6591 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.969246:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6646e5c/0xb1a5ef690c5021d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a39 expref: 11 pid: 6591 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.969261:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015484.969266:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015484.969272:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000053ed007/0xb1a5ef690c5021ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.969282:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000053ed007/0xb1a5ef690c5021ed lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.969312:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015484.969379:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280547328:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 227us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015484.969391:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 354 00010000:00010000:1.0:1786015484.969402:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000053ed007/0xb1a5ef690c5021ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.969414:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000053ed007/0xb1a5ef690c5021ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.969449:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000053ed007/0xb1a5ef690c5021ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.969459:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000053ed007/0xb1a5ef690c5021ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.969467:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000053ed007/0xb1a5ef690c5021ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.969474:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afcc00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015484.969479:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000053ed007/0xb1a5ef690c5021ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.969487:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000053ed007/0xb1a5ef690c5021ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.969498:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000053ed007/0xb1a5ef690c5021ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015484.969506:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000053ed007/0xb1a5ef690c5021ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015484.969556:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280547200:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 5891us (6086us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015484.969564:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 319 00000100:00100000:2.0:1786015484.981372:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015484.981930:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280547584 00000100:00100000:0.0:1786015484.981945:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280547584 00000100:00100000:0.0:1786015484.982020:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1186 00000100:00100000:0.0:1786015484.982033:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+46:29448:x1872772280547584:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786015484.982162:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5021f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.982183:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5021f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.982197:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5021f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.982515:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5021fb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.982529:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5021df lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a40 expref: 47 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.982542:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5021fb lrc: 4/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.982605:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5021df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a40 expref: 47 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015484.982624:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5021df lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a40 expref: 47 pid: 12526 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015484.982643:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304429568:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015484.983073:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b749302ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015484.997070:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015484.997205:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304429568:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015484.997232:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5021fb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015484.997318:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280547712 00000100:00100000:3.0:1786015484.997327:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280547712 00010000:00010000:3.0:1786015484.997368:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5021df lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a40 expref: 48 pid: 12526 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015484.997410:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 355 00000100:00100000:3.0:1786015484.997420:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+48:2353:x1872772280547712:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015484.997438:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015484.997457:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5021df lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a40 expref: 48 pid: 12526 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.997471:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5021df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a40 expref: 48 pid: 12526 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.997495:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5021df lrc: 0/0,0 mode: --/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a40 expref: 48 pid: 12526 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.997517:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:3.0:1786015484.997522:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5021fb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.997532:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5021fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.997541:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5021fb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015484.997572:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015484.997639:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2353:x1872772280547712:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 220us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015484.997648:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 355 00010000:00010000:2.0:1786015484.997711:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5021fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015484.997719:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5021fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786015484.997956:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968075 00000001:00080000:2.0:1786015484.998115:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968076 00000001:00080000:2.0:1786015484.998163:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968077 00000100:00100000:2.0:1786015484.998256:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8978000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304429696:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786015484.998309:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015484.998337:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786015484.998553:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304429696 00000100:00100000:3.0:1786015484.998560:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304429696 00000100:00100000:3.0:1786015484.998641:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1786015484.998650:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5795:x1872772304429696:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786015484.998723:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5795:x1872772304429696:12345-0@lo:1000:mdt00_001.0 Request processed in 76us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015484.998730:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1786015484.998895:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8978000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304429696:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1786015484.999274:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968078 00000100:00100000:2.0:1786015484.999335:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8978000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304429824:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786015484.999371:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015484.999399:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872900 going to sleep for 11 seconds 00000100:00100000:3.0:1786015484.999568:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304429824 00000100:00100000:3.0:1786015484.999573:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304429824 00000100:00100000:3.0:1786015484.999621:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1786015484.999630:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5795:x1872772304429824:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786015484.999857:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5795:x1872772304429824:12345-0@lo:1000:mdt00_001.0 Request processed in 228us (484us total) trans 4294967359 rc 0/0 00000100:00100000:3.0:1786015484.999868:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1786015485.000028:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8978000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304429824:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1786015485.000132:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968079 00010000:00010000:2.0:1786015485.000162:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5021fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.000173:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5021fb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.000181:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5021fb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.000187:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015485.000191:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5021fb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.000199:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5021fb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.000217:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:2.0:1786015485.000220:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015485.000225:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5021fb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.000231:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5021fb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.000270:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502130 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.000277:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502130 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.000282:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502130 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.001629:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015485.001636:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502130 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.001646:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502130 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.001665:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b74a04b5300) 00010000:00010000:2.0:1786015485.001668:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015485.001679:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c502137 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a01 expref: 93 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.001691:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c502137 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a01 expref: 93 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.001701:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c502137 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a01 expref: 93 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015485.002610:0:5795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46600/0xb1a5ef690c502137 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a01 expref: 93 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015485.002634:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304429952:192.168.202.56@tcp:105: 00000100:00100000:0.0:1786015485.002838:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb180 going to sleep for 11 seconds 00000100:00100000:0.0:1786015485.009913:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015485.010589:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280547840 00000100:00100000:3.0:1786015485.010604:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280547840 00000100:00100000:3.0:1786015485.010708:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 237 00000100:00100000:3.0:1786015485.010722:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+94:29447:x1872772280547840:12345-192.168.202.56@tcp:49:diff.0 00000100:00100000:3.0:1786015485.010926:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+94:29447:x1872772280547840:12345-192.168.202.56@tcp:49:diff.0 Request processed in 207us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015485.010935:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 237 00000100:00100000:2.0:1786015485.011069:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304429952:192.168.202.56@tcp:105: 00010000:00010000:2.0:1786015485.011098:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502130 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.011109:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502130 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.011145:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502202 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.011159:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502202 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.011171:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502202 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.011181:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502202 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.011188:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502202 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.011194:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502202 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.011201:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015485.011204:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502202 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.011212:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502202 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.011223:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b74a04b5300) 00010000:00010000:2.0:1786015485.011226:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015485.011230:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502202 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.011236:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502202 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.011246:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5021f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.011253:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5021f4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.011259:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5021f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.011343:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015485.011347:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5021f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.011353:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5021f4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.011362:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8b74a04b5300) 00010000:00010000:2.0:1786015485.011365:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015485.011368:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5021f4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015485.011504:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5021f4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015485.011793:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+51:29448:x1872772280547584:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 29762us (30432us total) trans 4294968080 rc 0/0 00000100:00100000:2.0:1786015485.011803:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1186 00000020:00080000:2.0:1786015485.011808:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:1.0:1786015485.011968:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015485.011973:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015485.012738:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1786015485.012750:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015485.017597:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00080000:0.0:1786015485.018348:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015485.018419:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280548096 00000100:00100000:1.0:1786015485.018431:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280548096 00000100:00080000:0.0:1786015485.018564:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015485.019397:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 238 00000100:00100000:1.0:1786015485.019412:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+51:29448:x1872772280548096:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1786015485.020866:0:5798:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x22:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1786015485.020982:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968081 00010000:00010000:0.0:1786015485.021314:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502209 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015485.021335:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502209 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015485.021350:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502209 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015485.021360:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502209 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015485.021368:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502209 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015485.021373:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502209 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015485.021391:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786015485.021547:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+53:29448:x1872772280548096:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 2133us (3964us total) trans 4294968082 rc 0/0 00000100:00100000:0.0:1786015485.021559:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 238 00000020:00080000:0.0:1786015485.021567:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786015485.021672:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786015485.021680:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502209 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015485.021689:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd600 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015485.021693:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502209 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015485.021702:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502209 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015485.021717:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8b748f24a300) 00010000:00010000:1.0:1786015485.021720:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786015485.021726:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502209 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015485.021732:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502209 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015485.021750:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015485.021752:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015485.021754:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015485.024557:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015485.024639:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280548224 00000100:00100000:1.0:1786015485.024649:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280548224 00000100:00100000:1.0:1786015485.024733:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 320 00000100:00100000:1.0:1786015485.024747:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+15:29447:x1872772280548224:12345-192.168.202.56@tcp:101:diff.0 00010000:00010000:1.0:1786015485.024793:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015485.024819:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041442349/0xb1a5ef690c502210 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a47 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015485.024851:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 158, mtime: 0x6a746ee4, atime: 0x6a746ee4, ctime: 0x6a746ee4, blocks: 0xb 00010000:00010000:1.0:1786015485.024876:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=720s v=(0 0) 00010000:00010000:1.0:1786015485.024881:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015485.024892:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041442349/0xb1a5ef690c502210 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a47 expref: 16 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015485.024910:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000041442349/0xb1a5ef690c502210 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a47 expref: 16 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015485.024924:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47a00, rc 0) 00000100:00100000:1.0:1786015485.024987:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+16:29447:x1872772280548224:12345-192.168.202.56@tcp:101:diff.0 Request processed in 243us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015485.024996:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 320 00000100:00080000:2.0:1786015485.025444:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015485.032490:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015485.032626:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280548352 00000100:00100000:1.0:1786015485.032640:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280548352 00002000:00100000:1.0:1786015485.032882:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x17:0x0] (0->4095) req@ffff8b74b8978e00 x1872772280548352/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:331/0 lens 488/0 e 0 to 0 dl 1786015496 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015485.032894:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74b8978e00 with x1872772280548352 ext(0->4095) 00002000:00010000:1.0:1786015485.032900:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74b8978e00 00000100:00100000:1.0:1786015485.032979:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 104 00000100:00100000:1.0:1786015485.032990:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280548352:12345-192.168.202.56@tcp:3:diff.0 00000100:00100000:1.0:1786015485.033257:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280548352:12345-192.168.202.56@tcp:3:diff.0 Request processed in 268us (775us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786015485.033264:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 104 00002000:00100000:1.0:1786015485.033271:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x17:0x0] (0->4095) req@ffff8b74b8978e00 x1872772280548352/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:331/0 lens 488/4536 e 0 to 0 dl 1786015496 ref 1 fl Complete:/600/0 rc 4096/4096 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015485.033279:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74b8978e00 with x1872772280548352 ext(0->4095) 00002000:00010000:1.0:1786015485.033282:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74b8978e00 00000100:00100000:3.0:1786015485.039115:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015485.039381:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280548608 00000100:00100000:1.0:1786015485.039393:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280548608 00000100:00100000:1.0:1786015485.039472:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 239 00000100:00100000:1.0:1786015485.039482:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+94:29447:x1872772280548608:12345-192.168.202.56@tcp:35:diff.0 00000100:00100000:1.0:1786015485.039795:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+95:29447:x1872772280548608:12345-192.168.202.56@tcp:35:diff.0 Request processed in 313us (1049us total) trans 4294968083 rc 0/0 00000100:00100000:1.0:1786015485.039803:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 239 00000100:00100000:2.0:1786015485.612074:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304430336:0@lo:400:kworker.0 00000100:00100000:2.0:1786015485.612153:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015485.612213:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786015485.612221:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304430464:0@lo:400:kworker.0 00000100:00100000:2.0:1786015485.612246:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015485.612279:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304430336 00000100:00100000:2.0:1786015485.612298:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304430336 00000100:00100000:0.0:1786015485.612460:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304430208:0@lo:400:kworker.0 00000100:00100000:0.0:1786015485.612491:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015485.612602:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304430080:0@lo:400:kworker.0 00000100:00100000:3.0:1786015485.612639:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015485.612678:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304430592:0@lo:400:kworker.0 00000100:00100000:3.0:1786015485.612702:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015485.624148:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304430464 00000100:00100000:2.0:1786015485.624165:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304430464 00000100:00100000:2.0:1786015485.624213:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304430208 00000100:00100000:2.0:1786015485.624216:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304430208 00000100:00100000:2.0:1786015485.624235:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1786015485.624245:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304430336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015485.624367:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304430336:12345-0@lo:400:kworker.0 Request processed in 123us (12214us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015485.624377:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1786015485.624395:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1786015485.624401:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304430464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015485.624430:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304430464:12345-0@lo:400:kworker.0 Request processed in 30us (12183us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015485.624436:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1786015485.624447:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1786015485.624453:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304430208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015485.624489:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304430208:12345-0@lo:400:kworker.0 Request processed in 36us (11996us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015485.624494:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1786015485.624522:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304430592 00000100:00100000:2.0:1786015485.624526:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304430592 00000100:00100000:2.0:1786015485.624583:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1786015485.624591:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304430592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015485.624630:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304430592:12345-0@lo:400:kworker.0 Request processed in 41us (11926us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015485.624636:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1786015485.624988:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304430208:0@lo:400:kworker.0 00000100:00100000:2.0:1786015485.625042:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304430464:0@lo:400:kworker.0 00000100:00100000:2.0:1786015485.625055:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304430336:0@lo:400:kworker.0 00000100:00100000:2.0:1786015485.625087:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304430592:0@lo:400:kworker.0 00000100:00080000:0.0:1786015485.628692:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015485.628702:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015485.630885:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304430080 00000100:00100000:0.0:1786015485.630899:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304430080 00000100:00100000:0.0:1786015485.630964:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1786015485.630974:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304430080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015485.631149:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304430080:12345-0@lo:400:kworker.0 Request processed in 175us (18507us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015485.631157:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:2.0:1786015485.631953:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304430080:0@lo:400:kworker.0 00010000:00010000:0.0:1786015485.810407:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015486.063596:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015486.063606:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015486.067610:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 34 count 2 00000040:00080000:3.0:1786015486.067622:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015486.125703:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304430720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015486.129993:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015486.131943:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304430720 00000100:00100000:2.0:1786015486.131958:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304430720 00000100:00100000:2.0:1786015486.132020:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1786015486.132031:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304430720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015486.132077:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015486.132164:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304430720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015486.132172:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1786015486.133817:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304430720:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1786015486.742402:0:20659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015486.742414:0:20659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015486.742463:0:20659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 34 count 2 00000040:00080000:1.0:1786015486.742469:0:20659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015486.829939:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015487.851940:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015488.878643:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015489.095131:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015489.095166:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015489.095188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015489.095206:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015489.095218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015489.095232:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015489.095249:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015489.095270:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280549248 00000100:00100000:2.0:1786015489.095277:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280549248 00000100:00100000:2.0:1786015489.095319:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280548864 00000100:00100000:2.0:1786015489.095321:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280548864 00000100:00100000:2.0:1786015489.095334:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 485 00000100:00100000:2.0:1786015489.095341:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2354:x1872772280549248:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015489.095428:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2354:x1872772280549248:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015489.095435:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 485 00000100:00100000:2.0:1786015489.095451:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 486 00000100:00100000:2.0:1786015489.095458:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+95:2354:x1872772280548864:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015489.095485:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+95:2354:x1872772280548864:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015489.095491:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 486 00000100:00100000:2.0:1786015489.095509:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280548992 00000100:00100000:2.0:1786015489.095512:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280548992 00000100:00100000:2.0:1786015489.095536:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280549504 00000100:00100000:2.0:1786015489.095570:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280549504 00000100:00100000:2.0:1786015489.095585:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280549120 00000100:00100000:2.0:1786015489.095587:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280549120 00000100:00100000:2.0:1786015489.095601:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280549376 00000100:00100000:2.0:1786015489.095603:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280549376 00000100:00100000:2.0:1786015489.095617:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 474 00000100:00100000:2.0:1786015489.095623:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280548992:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015489.095649:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280548992:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015489.095654:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 474 00000100:00100000:2.0:1786015489.095667:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 475 00000100:00100000:2.0:1786015489.095672:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280549504:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015489.095698:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280549504:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015489.095704:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 475 00000100:00100000:2.0:1786015489.095715:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 476 00000100:00100000:2.0:1786015489.095720:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280549120:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015489.095743:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280549120:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015489.095749:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 476 00000100:00100000:2.0:1786015489.095790:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 477 00000100:00100000:2.0:1786015489.095798:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280549376:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015489.095822:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280549376:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015489.095828:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 477 00000100:00100000:0.0:1786015489.096348:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280548736 00000100:00100000:0.0:1786015489.096352:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280548736 00000100:00100000:0.0:1786015489.096399:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 597 00000100:00100000:0.0:1786015489.096406:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280548736:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015489.096448:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280548736:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 42us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015489.096454:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 597 00000100:00080000:0.0:1786015489.096476:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015489.096480:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015489.096483:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015489.196947:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786015489.196972:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304430848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015489.197043:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015489.197545:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304430848 00000100:00100000:3.0:1786015489.197554:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304430848 00000100:00100000:3.0:1786015489.197632:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1786015489.197641:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304430848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015489.197678:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015489.197737:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304430848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015489.197745:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1786015489.197817:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304430848:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786015489.197936:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1786015489.779290:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968075 is committed 00000001:00080000:2.0:1786015489.779315:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968083 is committed 00000001:00080000:2.0:1786015489.779322:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968082 is committed 00000020:00080000:2.0:1786015489.779339:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b7384872e40 refcount 2 committed 0 result 0 batchid 24 00000020:00080000:2.0:1786015489.779344:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b7491d58900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b7384872000 00000020:00080000:2.0:1786015489.779347:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b7491d58f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74b8cc2800 00000020:00080000:0.0:1786015489.779489:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 24 committed batchid 23 00000020:00080000:0.0:1786015489.779692:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 23 00010000:00010000:0.0:1786015489.901227:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786015490.312505:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967359 is committed 00000001:00080000:0.0:1786015490.312523:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967358 is committed 00000100:00100000:2.0:1786015490.731967:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786015490.732089:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304431104:0@lo:400:kworker.0 00000100:00100000:1.0:1786015490.732160:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015490.732224:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015490.732230:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304431232:0@lo:400:kworker.0 00000100:00100000:1.0:1786015490.732252:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015490.732520:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786015490.732562:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304431360:0@lo:400:kworker.0 00000100:00100000:3.0:1786015490.732598:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015490.732646:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304431104 00000100:00100000:3.0:1786015490.732653:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304431104 00000100:00100000:3.0:1786015490.732715:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304431232 00000100:00100000:3.0:1786015490.732719:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304431232 00000100:00100000:3.0:1786015490.732751:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:3.0:1786015490.732785:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304431104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015490.732854:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304431104:12345-0@lo:400:kworker.0 Request processed in 94us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015490.732861:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:3.0:1786015490.732882:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:3.0:1786015490.732888:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304431232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015490.732916:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304431232:12345-0@lo:400:kworker.0 Request processed in 29us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015490.732923:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:3.0:1786015490.732969:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304431232:0@lo:400:kworker.0 00000100:00100000:3.0:1786015490.732981:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304431104:0@lo:400:kworker.0 00000100:00100000:1.0:1786015490.733576:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304431360 00000100:00100000:1.0:1786015490.733582:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304431360 00000100:00100000:1.0:1786015490.733636:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1786015490.733643:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304431360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015490.733692:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304431360:12345-0@lo:400:kworker.0 Request processed in 50us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015490.733698:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1786015490.733740:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967359 gen 2 00000004:00080000:1.0:1786015490.733749:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967359 committed transno 4294967359 00000100:00100000:1.0:1786015490.733788:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304431360:0@lo:400:kworker.0 00000100:00100000:2.0:1786015490.735658:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304430976:0@lo:400:kworker.0 00000100:00100000:2.0:1786015490.735751:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015490.736033:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304430976 00000100:00100000:3.0:1786015490.736041:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304430976 00000100:00100000:3.0:1786015490.736100:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:3.0:1786015490.736109:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304430976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015490.736176:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304430976:12345-0@lo:400:kworker.0 Request processed in 68us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015490.736182:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00080000:3.0:1786015490.736231:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015490.736598:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304430976:0@lo:400:kworker.0 00000100:00100000:0.0:1786015490.737241:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786015490.737258:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304431616:0@lo:400:kworker.0 00000100:00100000:0.0:1786015490.737307:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015490.737398:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304431616 00000100:00100000:2.0:1786015490.737404:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304431616 00000100:00100000:2.0:1786015490.737462:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1786015490.737471:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304431616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015490.737542:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304431616:12345-0@lo:400:kworker.0 Request processed in 73us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015490.737549:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1786015490.737583:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304431616:0@lo:400:kworker.0 00000100:00100000:2.0:1786015490.737601:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786015490.737606:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304431488:0@lo:400:kworker.0 00000100:00100000:2.0:1786015490.737643:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015490.737672:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304431488 00000100:00100000:2.0:1786015490.737675:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304431488 00000100:00100000:2.0:1786015490.737715:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1786015490.737722:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304431488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015490.737778:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304431488:12345-0@lo:400:kworker.0 Request processed in 38us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015490.737785:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1786015490.737814:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304431488:0@lo:400:kworker.0 00000100:00080000:0.0:1786015490.738219:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015490.738224:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786015490.925000:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015491.245877:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304431744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015491.245978:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015491.246545:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304431744 00000100:00100000:2.0:1786015491.246555:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304431744 00000100:00100000:2.0:1786015491.246623:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1786015491.246635:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304431744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015491.246684:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015491.246742:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304431744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015491.246750:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1786015491.246858:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304431744:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786015491.953355:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015492.828891:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015492.829141:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280549632 00000100:00100000:3.0:1786015492.829152:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280549632 00000100:00100000:3.0:1786015492.829228:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1187 00000100:00100000:3.0:1786015492.829252:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29334:x1872772280549632:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1786015492.829375:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:29334:x1872772280549632:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 137us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015492.829383:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1187 00000100:00080000:0.0:1786015492.830644:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786015492.972187:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015493.996442:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015494.207648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015494.207935:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280549888 00000100:00100000:1.0:1786015494.207950:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280549888 00000100:00100000:1.0:1786015494.208047:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 490 00000100:00100000:1.0:1786015494.208059:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+94:2352:x1872772280549888:12345-192.168.202.56@tcp:400:kworker.0 00000100:00080000:3.0:1786015494.208236:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015494.208347:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+94:2352:x1872772280549888:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 289us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015494.208356:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 490 00000100:00100000:2.0:1786015494.212958:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015494.213039:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015494.213085:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015494.213112:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015494.213133:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015494.213160:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015494.213206:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280549760 00000100:00100000:2.0:1786015494.213218:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280549760 00000100:00100000:2.0:1786015494.213286:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 599 00000100:00100000:2.0:1786015494.213297:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280549760:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015494.213396:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280549760:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 100us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015494.213405:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 599 00000100:00100000:2.0:1786015494.213451:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280550144 00000100:00100000:2.0:1786015494.213455:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280550144 00000100:00100000:2.0:1786015494.213506:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280550400 00000100:00100000:2.0:1786015494.213510:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280550400 00000100:00100000:2.0:1786015494.213526:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280550016 00000100:00100000:2.0:1786015494.213529:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280550016 00000100:00100000:2.0:1786015494.213542:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280550528 00000100:00100000:2.0:1786015494.213544:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280550528 00000100:00100000:2.0:1786015494.213560:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 480 00000100:00100000:2.0:1786015494.213567:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280550144:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015494.213598:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+12:2352:x1872772280550144:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015494.213605:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 480 00000100:00100000:2.0:1786015494.213617:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 481 00000100:00100000:2.0:1786015494.213623:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280550400:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015494.213647:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280550400:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015494.213654:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 481 00000100:00100000:2.0:1786015494.213664:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 482 00000100:00100000:2.0:1786015494.213671:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2352:x1872772280550016:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015494.213714:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2352:x1872772280550016:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 42us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015494.213719:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 483 00000100:00100000:3.0:1786015494.213922:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2352:x1872772280550528:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015494.213960:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2352:x1872772280550528:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 231us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015494.215947:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280550272 00000100:00100000:1.0:1786015494.215967:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280550272 00000100:00100000:2.0:1786015494.216142:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 482 00000100:00080000:2.0:1786015494.216968:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786015494.216977:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015494.216981:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015494.217908:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 483 00000100:00100000:3.0:1786015494.217981:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 491 00000100:00100000:3.0:1786015494.218001:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2352:x1872772280550272:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015494.218116:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2352:x1872772280550272:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 125us (4981us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015494.218125:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 491 00000100:00100000:3.0:1786015494.316088:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304431872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015494.316193:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015494.316331:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304431872 00000100:00100000:1.0:1786015494.316342:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304431872 00000100:00100000:1.0:1786015494.316424:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1786015494.316434:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304431872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015494.316481:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015494.316554:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304431872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015494.316562:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:3.0:1786015494.316835:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015494.316888:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304431872:0@lo:13:osp-pre-0-0.0 00000020:00080000:2.0:1786015494.945334:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 24 batchid updated 00000020:00080000:0.0:1786015494.946000:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 24 00000020:00080000:0.0:1786015494.946023:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 24 00000001:02000400:0.0:1786015494.971506:0:20859:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12p: implicit restore of a file on copytool mount point ========================================================== 07:24:53 (1786015493) 00010000:00010000:1.0:1786015495.029067:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015495.210134:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015495.210180:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280550656 00000100:00100000:1.0:1786015495.210194:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280550656 00000100:00100000:1.0:1786015495.210271:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1188 00000100:00100000:1.0:1786015495.210283:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+44:30060:x1872772280550656:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1786015495.210496:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+44:30060:x1872772280550656:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 215us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015495.210504:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1188 00000100:00100000:0.0:1786015495.227115:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015495.227198:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280550784 00000100:00100000:1.0:1786015495.227212:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280550784 00000100:00100000:1.0:1786015495.227289:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1189 00000100:00100000:1.0:1786015495.227302:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+94:30061:x1872772280550784:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015495.227413:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015495.227443:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c502217 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a4e expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.227539:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50221e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.227556:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50221e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.227569:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50221e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.227585:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502225 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.227592:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.227598:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.228628:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50221e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.228643:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50221e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.228651:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50221e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.228661:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015495.228666:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50221e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.228675:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50221e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.228693:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a600) 00010000:00010000:1.0:1786015495.228696:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015495.228702:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50221e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.228708:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50221e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.228720:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.228726:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502225 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.228732:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.228737:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015495.228740:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.228747:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502225 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.228757:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55434c71 (ffff8b7483ee6a00) 00010000:00010000:1.0:1786015495.229218:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015495.229224:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502225 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.229231:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502225 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.229295:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c502217 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a4e expref: 95 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.229377:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a600) 00010000:00010000:1.0:1786015495.229380:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015495.229385:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c502217 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a4e expref: 95 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.229396:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47000, rc 0) 00000100:00100000:2.0:1786015495.229547:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+94:30061:x1872772280550784:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 2245us (2444us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015495.229559:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1189 00000100:00100000:1.0:1786015495.239947:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015495.239998:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280551040 00000100:00100000:2.0:1786015495.240014:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280551040 00000100:00100000:2.0:1786015495.240098:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1190 00000100:00100000:2.0:1786015495.240110:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+94:30061:x1872772280551040:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:2.0:1786015495.240261:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015495.240299:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c501e43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e890c expref: 94 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.240405:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a600) 00010000:00010000:2.0:1786015495.240413:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015495.240913:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50222c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.240932:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501e89 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8921 expref: 43 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.240942:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50222c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.240987:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501e89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8921 expref: 43 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.241005:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501e89 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8921 expref: 43 pid: 7673 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015495.241024:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304432000:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015495.241161:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d2540 going to sleep for 11 seconds 00000100:00100000:2.0:1786015495.243913:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304432000:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015495.243956:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50222c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015495.246099:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015495.246226:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280551168 00000100:00100000:3.0:1786015495.246241:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280551168 00010000:00010000:3.0:1786015495.246300:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501e89 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8921 expref: 44 pid: 7673 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015495.246354:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 356 00000100:00100000:3.0:1786015495.246368:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2354:x1872772280551168:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015495.246393:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015495.246402:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501e89 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8921 expref: 44 pid: 7673 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.246419:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501e89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8921 expref: 44 pid: 7673 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.246450:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c501e89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8921 expref: 44 pid: 7673 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.246471:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a600) 00010000:00010000:3.0:1786015495.246487:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50222c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.246510:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50222c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.246521:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50222c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.246610:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015495.246697:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+43:2354:x1872772280551168:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 331us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015495.246707:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 356 00010000:00010000:2.0:1786015495.248890:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50222c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.248916:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50222c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.248958:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c502233 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.248975:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c502233 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.248989:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c502233 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015495.251346:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 512 00010000:00010000:3.0:1786015495.251378:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50222c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.251391:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50222c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.251400:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50222c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.251409:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015495.251415:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50222c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.251424:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50222c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.251450:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a600) 00010000:00010000:3.0:1786015495.251453:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015495.251460:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50222c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.251467:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50222c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015495.251508:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dc6e38d3 reply state 000000004cd8dc80 transno 4294968084 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c502233 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015495.251520:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015495.251805:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+95:30061:x1872772280551040:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 11688us (11863us total) trans 4294968084 rc 0/0 00000100:00100000:3.0:1786015495.251817:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1190 00010000:00010000:2.0:1786015495.253941:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c502233 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.253963:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c502233 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.253972:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c502233 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.253979:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015495.253985:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c502233 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.253994:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c502233 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.254017:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55434c71 (ffff8b749232d500) 00010000:00010000:2.0:1786015495.254021:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015495.254026:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c502233 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.254033:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c502233 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015495.268455:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015495.269016:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280551296 00000100:00100000:1.0:1786015495.269035:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280551296 00000100:00100000:1.0:1786015495.269128:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1191 00000100:00100000:1.0:1786015495.269141:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+94:30062:x1872772280551296:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1786015495.269176:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015495.269221:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50223a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a55 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.269340:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c502241 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.269359:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c502241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.269374:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c502241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015495.269476:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1786015495.269491:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 30 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015495.269525:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c502241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.269556:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c50223a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a55 expref: 96 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.269579:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c502241 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a55 expref: 95 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.269589:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:1.0:1786015495.269592:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015495.269598:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47000, rc 0) 00000100:00100000:1.0:1786015495.269715:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+95:30062:x1872772280551296:12345-192.168.202.56@tcp:101:bash.0 Request processed in 573us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015495.269724:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1191 00000040:00080000:0.0:1786015495.276134:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015495.276151:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015495.277031:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1786015495.277045:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015495.278749:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015495.279141:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280551424 00000100:00100000:2.0:1786015495.279157:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280551424 00000100:00100000:2.0:1786015495.279731:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1192 00000100:00100000:2.0:1786015495.279748:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+95:30062:x1872772280551424:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1786015495.279803:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015495.279834:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c502248 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a5c expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.279931:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50224f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.279951:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50224f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.279966:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50224f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.279986:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502256 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.279992:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502256 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.279999:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502256 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.280143:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c50225d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.280149:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c50225d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.280155:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c50225d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015495.280187:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 512 00000004:00200000:2.0:1786015495.281324:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015495.281392:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c50225d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.281413:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50224f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.281418:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50224f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.281424:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50224f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.281428:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015495.281431:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50224f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.281437:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50224f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.281451:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:2.0:1786015495.281454:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015495.281458:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50224f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.281462:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c50224f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.281489:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502256 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.281497:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502256 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.281506:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502256 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.281512:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015495.281515:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502256 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.281521:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502256 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.281530:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55434c71 (ffff8b749232d500) 00010000:00010000:2.0:1786015495.281532:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015495.281535:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502256 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.281541:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c502256 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.281869:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c502248 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a5c expref: 97 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.281887:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906e00/0xb1a5ef690c50225d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a5c expref: 96 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.281902:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:2.0:1786015495.281905:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786015495.281908:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906e00, rc 0) 00000100:00100000:2.0:1786015495.283837:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+96:30062:x1872772280551424:12345-192.168.202.56@tcp:101:bash.0 Request processed in 4075us (5080us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015495.283856:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1192 00000100:00100000:0.0:1786015495.288002:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015495.288077:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280551552 00000100:00100000:3.0:1786015495.288091:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280551552 00000100:00100000:3.0:1786015495.288182:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1193 00000100:00100000:3.0:1786015495.288408:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+96:30062:x1872772280551552:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1786015495.288441:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015495.288489:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502264 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a63 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288604:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50226b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288626:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50226b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288643:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50226b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288662:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502272 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288674:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288681:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288835:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50226b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288845:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50226b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288852:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50226b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288859:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015495.288864:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50226b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288872:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50226b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288886:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:3.0:1786015495.288890:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015495.288896:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50226b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288902:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50226b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288916:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288923:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502272 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288928:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502272 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288934:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbdc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015495.288937:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502272 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288943:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502272 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288950:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8b74a04b5500) 00010000:00010000:3.0:1786015495.288952:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015495.288955:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502272 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.288960:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502272 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.289023:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502264 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a63 expref: 97 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.289035:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:3.0:1786015495.289038:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015495.289042:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502264 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a63 expref: 97 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.289059:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc600, rc 0) 00000100:00100000:3.0:1786015495.289149:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+96:30062:x1872772280551552:12345-192.168.202.56@tcp:101:bash.0 Request processed in 955us (1163us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015495.289158:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1193 00000100:00100000:3.0:1786015495.304645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015495.305372:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280551680 00000100:00100000:1.0:1786015495.305392:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280551680 00000100:00100000:1.0:1786015495.305509:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1194 00000100:00100000:1.0:1786015495.305524:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+43:30063:x1872772280551680:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:1.0:1786015495.305559:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015495.305606:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c502279 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a6a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.305971:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502280 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.305990:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.306004:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015495.306088:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1786015495.306092:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 30 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015495.306126:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.306159:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c502279 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a6a expref: 45 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.306180:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502280 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a6a expref: 44 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.308572:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:1.0:1786015495.308587:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015495.308596:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47c00, rc 0) 00000100:00100000:1.0:1786015495.308798:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:30063:x1872772280551680:12345-192.168.202.56@tcp:101:rm.0 Request processed in 3269us (4162us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015495.308809:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1194 00000100:00100000:1.0:1786015495.311160:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015495.312093:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280551808 00000100:00100000:2.0:1786015495.312113:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280551808 00000100:00100000:2.0:1786015495.312304:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1195 00000100:00100000:2.0:1786015495.312318:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+44:30063:x1872772280551808:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015495.312350:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015495.312381:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c502287 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a71 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312488:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50228e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312507:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50228e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312522:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50228e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312541:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c502295 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312549:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c502295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312562:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c502295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312721:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50229c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312730:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50229c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312738:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50229c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015495.312813:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 512 00000004:00200000:2.0:1786015495.312818:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015495.312845:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50229c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312859:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50228e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312865:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50228e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312871:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50228e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312878:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015495.312883:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50228e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312890:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50228e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312905:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:2.0:1786015495.312909:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015495.312914:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50228e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312921:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50228e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312936:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c502295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312943:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c502295 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312949:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c502295 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312953:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015495.312956:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c502295 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312962:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c502295 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312968:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55434c71 (ffff8b749232d500) 00010000:00010000:2.0:1786015495.312970:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015495.312973:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c502295 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.312978:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c502295 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.313017:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c502287 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a71 expref: 46 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.313031:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907600/0xb1a5ef690c50229c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a71 expref: 45 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.313039:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:2.0:1786015495.313041:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786015495.313044:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383907600, rc 0) 00000100:00100000:2.0:1786015495.313291:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:30063:x1872772280551808:12345-192.168.202.56@tcp:101:rm.0 Request processed in 974us (2143us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015495.313302:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1195 00000100:00100000:0.0:1786015495.317119:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015495.317246:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280551936 00000100:00100000:3.0:1786015495.317261:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280551936 00000100:00100000:3.0:1786015495.317351:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1196 00000100:00100000:3.0:1786015495.317365:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+45:30063:x1872772280551936:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015495.317400:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015495.317437:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5022a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a78 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.317549:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.317570:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.317585:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.317602:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.317609:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.317622:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.317739:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.317748:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.317757:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.317932:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbdc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015495.317938:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.317947:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.317965:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:3.0:1786015495.317969:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015495.317975:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.317982:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.317999:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.318006:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.318013:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.318019:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015495.318022:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.318028:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.318035:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8b74a04b5500) 00010000:00010000:3.0:1786015495.318038:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015495.318041:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.318046:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.318094:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5022a3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a78 expref: 46 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.318106:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:3.0:1786015495.318109:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015495.318112:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5022a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a78 expref: 46 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.318124:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc600, rc 0) 00000100:00100000:3.0:1786015495.318247:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+45:30063:x1872772280551936:12345-192.168.202.56@tcp:101:rm.0 Request processed in 884us (1144us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015495.318260:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1196 00000100:00100000:0.0:1786015495.323354:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015495.323428:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280552064 00000100:00100000:1.0:1786015495.323443:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280552064 00000100:00100000:1.0:1786015495.323537:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1197 00000100:00100000:1.0:1786015495.323550:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+45:30063:x1872772280552064:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:1.0:1786015495.323582:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015495.323613:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5022b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a7f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.324542:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5022bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.324567:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5022bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.324584:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5022bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.324603:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5022c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.324610:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5022c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.324617:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5022c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.324716:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5022bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.324724:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5022bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.324732:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5022bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.324739:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015495.324744:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5022bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.324752:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5022bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.324808:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:0.0:1786015495.324812:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015495.325016:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5022bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.325025:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5022bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.325177:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5022c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.325183:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5022c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.325197:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5022c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.325203:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015495.325206:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5022c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.325217:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5022c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.325226:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8b748f24a900) 00010000:00010000:0.0:1786015495.325229:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015495.325232:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5022c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.325238:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5022c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.325291:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5022b8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a7f expref: 46 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.325304:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:0.0:1786015495.325401:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015495.325406:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5022b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a7f expref: 46 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.325419:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b46e00, rc 0) 00000100:00100000:0.0:1786015495.325524:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+45:30063:x1872772280552064:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1975us (2185us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015495.325535:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1197 00000100:00100000:2.0:1786015495.336508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015495.336867:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280552192 00000100:00100000:3.0:1786015495.336885:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280552192 00000100:00100000:3.0:1786015495.337026:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1198 00000100:00100000:3.0:1786015495.337041:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:30064:x1872772280552192:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015495.337071:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015495.337104:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5022cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a86 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.337207:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.337228:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.337244:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.337364:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.337374:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.337383:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.337496:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.337509:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.337516:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.337524:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015495.337535:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.337544:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.337560:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:3.0:1786015495.337563:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015495.337736:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.337744:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5022d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.337998:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.338006:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.338013:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.338018:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbdc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015495.338023:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.338030:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.338039:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8b74a04b5500) 00010000:00010000:3.0:1786015495.338042:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015495.338045:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.338051:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5022db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.338109:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5022cd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a86 expref: 46 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.338122:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:3.0:1786015495.338125:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015495.338129:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5022cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a86 expref: 46 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.338141:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc600, rc 0) 00000100:00100000:3.0:1786015495.338236:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:30064:x1872772280552192:12345-192.168.202.56@tcp:101:cp.0 Request processed in 1198us (1754us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015495.338246:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1198 00000100:00100000:3.0:1786015495.345821:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015495.346044:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280552320 00000100:00100000:1.0:1786015495.346061:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280552320 00000100:00100000:1.0:1786015495.346144:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1199 00000100:00100000:1.0:1786015495.346157:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+45:30064:x1872772280552320:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015495.346190:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015495.346222:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5022e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a8d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346329:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5022e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346348:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5022e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346364:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5022e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346390:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5022f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346398:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5022f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346405:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5022f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346516:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5022e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346526:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5022e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346533:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5022e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346541:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015495.346547:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5022e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346556:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5022e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346582:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:1.0:1786015495.346586:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015495.346593:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5022e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346601:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c5022e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346619:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5022f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346625:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5022f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346632:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5022f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346638:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015495.346641:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5022f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346648:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5022f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346654:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8b7483ee6900) 00010000:00010000:1.0:1786015495.346666:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015495.346670:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5022f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346676:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5022f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346973:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5022e2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a8d expref: 46 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.346986:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:1.0:1786015495.346989:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015495.346994:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c5022e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a8d expref: 46 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.347004:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47600, rc 0) 00000100:00100000:1.0:1786015495.347098:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+45:30064:x1872772280552320:12345-192.168.202.56@tcp:101:cp.0 Request processed in 944us (1295us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015495.347108:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1199 00000100:00100000:1.0:1786015495.350217:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015495.350468:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280552576 00000100:00100000:2.0:1786015495.350491:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280552576 00000100:00100000:2.0:1786015495.350570:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1200 00000100:00100000:2.0:1786015495.350589:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+45:30064:x1872772280552576:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015495.350623:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015495.350656:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c5022f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a94 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.350911:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5022fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.350930:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5022fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.350950:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5022fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.350973:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c502305 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.350981:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c502305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.350989:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c502305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786015495.352011:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a:0x0], index 1: 0 00010000:00010000:2.0:1786015495.353319:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50230c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.353345:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50230c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.353361:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50230c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.353434:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5022fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.353442:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5022fe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.353448:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5022fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.353454:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015495.353460:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5022fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.353468:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5022fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.353493:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:2.0:1786015495.353497:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015495.353503:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5022fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.353509:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c5022fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015495.353524:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000861c8ce6 reply state 00000000c575cfad transno 4294968085 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c502305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015495.353534:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786015495.353596:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c5022f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a94 expref: 48 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.353613:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50230c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a94 expref: 47 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.353621:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:2.0:1786015495.353624:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015495.353627:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2179200, rc 0) 00000100:00100000:2.0:1786015495.354287:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+48:30064:x1872772280552576:12345-192.168.202.56@tcp:101:cp.0 Request processed in 3697us (4082us total) trans 4294968085 rc 0/0 00000100:00100000:2.0:1786015495.354298:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1200 00010000:00010000:1.0:1786015495.365142:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c502305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.365173:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c502305 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.365182:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c502305 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.365188:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015495.365195:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c502305 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.365203:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c502305 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.365228:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8b749232d500) 00010000:00010000:1.0:1786015495.365232:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015495.365238:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c502305 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.365245:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c502305 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015495.371218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015495.372258:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280552704 00000100:00100000:1.0:1786015495.372276:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280552704 00000100:00100000:1.0:1786015495.372387:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 321 00000100:00100000:1.0:1786015495.372400:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280552704:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015495.372426:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015495.372455:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d53db8ae/0xb1a5ef690c50231a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8a9b expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015495.372505:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786015495.372533:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=730s v=(0 0) 00010000:00010000:1.0:1786015495.372538:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015495.372551:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d53db8ae/0xb1a5ef690c50231a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a9b expref: 11 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.372584:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d53db8ae/0xb1a5ef690c50231a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a9b expref: 11 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.372602:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920600, rc 0) 00000100:00100000:1.0:1786015495.372733:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280552704:12345-192.168.202.56@tcp:101:cp.0 Request processed in 335us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015495.372742:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 321 00000100:00100000:3.0:1786015495.378325:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015495.378513:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280552832 00000100:00100000:2.0:1786015495.378526:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280552832 00000100:00100000:2.0:1786015495.378605:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 322 00000100:00100000:2.0:1786015495.378616:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:30064:x1872772280552832:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015495.378642:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015495.379027:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1ed4291/0xb1a5ef690c502321 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8aa2 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.379074:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d53db8ae/0xb1a5ef690c50231a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a9b expref: 12 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.379085:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015495.379090:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015495.379096:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ed4291/0xb1a5ef690c502321 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa2 expref: 12 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.379138:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d53db8ae/0xb1a5ef690c50231a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a9b expref: 12 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.379154:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d53db8ae/0xb1a5ef690c50231a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a9b expref: 12 pid: 11384 timeout: 830 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015495.379171:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304432128:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015495.379279:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d2900 going to sleep for 11 seconds 00000100:00100000:3.0:1786015495.383125:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015495.383217:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280552960 00000100:00100000:0.0:1786015495.383229:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280552960 00010000:00010000:0.0:1786015495.383283:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d53db8ae/0xb1a5ef690c50231a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a9b expref: 13 pid: 11384 timeout: 830 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015495.383343:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 357 00000100:00100000:0.0:1786015495.383354:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280552960:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015495.383376:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015495.383409:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d53db8ae/0xb1a5ef690c50231a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a9b expref: 13 pid: 11384 timeout: 830 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.383427:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d53db8ae/0xb1a5ef690c50231a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a9b expref: 13 pid: 11384 timeout: 830 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.383460:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015495.383466:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015495.383487:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1ed4291/0xb1a5ef690c502321 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa2 expref: 13 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.383501:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ed4291/0xb1a5ef690c502321 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa2 expref: 13 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015495.383551:0:6607:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f1ed4291/0xb1a5ef690c502321 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa2 expref: 13 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015495.383568:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6607:1872772304432256:192.168.202.56@tcp:105: 00010000:00010000:2.0:1786015495.383829:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d53db8ae/0xb1a5ef690c50231a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a9b expref: 13 pid: 11384 timeout: 830 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015495.383856:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304432128:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015495.383893:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1ed4291/0xb1a5ef690c502321 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa2 expref: 12 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.383905:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6600, rc 0) 00000100:00100000:2.0:1786015495.383939:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:30064:x1872772280552832:12345-192.168.202.56@tcp:101:cp.0 Request processed in 5325us (5633us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015495.383949:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 322 00000100:00100000:0.0:1786015495.384559:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb4300 going to sleep for 11 seconds 00000100:00100000:3.0:1786015495.401536:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6607:1872772304432256:192.168.202.56@tcp:105: 00010000:00010000:3.0:1786015495.401585:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015495.401677:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280552960:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 18316us (18559us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015495.401691:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 357 00000100:00100000:3.0:1786015495.404624:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015495.407989:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280553216 00000100:00100000:2.0:1786015495.408016:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280553216 00000100:00100000:2.0:1786015495.408137:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 240 00000100:00100000:2.0:1786015495.408151:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916ae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:30064:x1872772280553216:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:2.0:1786015495.409099:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916ae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:30064:x1872772280553216:12345-192.168.202.56@tcp:35:cp.0 Request processed in 943us (4479us total) trans 4294968086 rc 0/0 00000100:00100000:2.0:1786015495.409110:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 240 00000100:00100000:2.0:1786015495.457998:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015495.458097:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280553344 00000100:00100000:3.0:1786015495.458111:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280553344 00000100:00100000:3.0:1786015495.458198:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1201 00000100:00100000:3.0:1786015495.458212:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+96:30067:x1872772280553344:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015495.458268:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015495.458300:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502328 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8aa9 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.458399:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50232f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.458418:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50232f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.458432:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50232f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.458449:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502336 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.458456:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.458462:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.458629:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50233d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.458639:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50233d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015495.458646:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50233d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015495.459833:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00000004:00200000:2.0:1786015495.459845:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015495.459882:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50233d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.459904:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50233d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.459916:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50232f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.459925:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50232f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.459933:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50232f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.459940:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbdc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015495.459946:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50232f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.459955:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50232f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.459975:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:2.0:1786015495.459979:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015495.459985:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50232f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.459990:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c50232f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.460012:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.460018:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502336 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.460024:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502336 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.460029:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015495.460033:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502336 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.460038:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502336 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.460045:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8b74a04b5500) 00010000:00010000:2.0:1786015495.460048:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015495.460050:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502336 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.460056:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502336 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.460114:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502328 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa9 expref: 98 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.460132:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50233d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa9 expref: 97 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.460140:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:2.0:1786015495.460142:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015495.460145:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc400, rc 0) 00000100:00100000:2.0:1786015495.460252:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+97:30067:x1872772280553344:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 2042us (2266us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015495.460264:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1201 00000100:00100000:0.0:1786015495.476106:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015495.476208:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280553472 00000100:00100000:3.0:1786015495.476222:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280553472 00000100:00100000:3.0:1786015495.476297:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 323 00000100:00100000:3.0:1786015495.476310:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280553472:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015495.476337:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015495.476365:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502344 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ab0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015495.476458:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304432384:192.168.202.56@tcp:106: 00000100:00100000:3.0:1786015495.476596:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872b40 going to sleep for 11 seconds 00002000:00010000:2.0:1786015495.479271:0:14547:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1786015495.479286:0:14547:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb mtime: 0 -> 1786015495 00002000:00010000:2.0:1786015495.479288:0:14547:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb atime: 0 -> 1786015495 00002000:00010000:2.0:1786015495.479291:0:14547:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb ctime: 0 -> 1786015495 00000100:00100000:2.0:1786015495.479327:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304432384:192.168.202.56@tcp:106: 00010000:00010000:2.0:1786015495.479379:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502344 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ab0 expref: 13 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.479414:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502344 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ab0 expref: 13 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015495.479433:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc200, rc 0) 00000100:00100000:2.0:1786015495.479531:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280553472:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3222us (3441us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015495.479543:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 323 00000100:00100000:2.0:1786015495.487963:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015495.488538:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280553600 00000100:00100000:1.0:1786015495.488552:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280553600 00000100:00100000:1.0:1786015495.488636:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1202 00000100:00100000:1.0:1786015495.488649:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+97:30067:x1872772280553600:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015495.488692:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015495.488722:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c50234b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ab7 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.488868:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502352 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.488889:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.488905:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015495.488999:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 512 00000004:00200000:1.0:1786015495.489005:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015495.489034:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.489068:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c50234b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ab7 expref: 99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.489093:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ab7 expref: 98 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.489104:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:1.0:1786015495.489107:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015495.489112:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920800, rc 0) 00000100:00100000:1.0:1786015495.489197:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+98:30067:x1872772280553600:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 550us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015495.489205:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1202 00000100:00100000:1.0:1786015495.494136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015495.494382:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280553728 00000100:00100000:2.0:1786015495.494398:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280553728 00000100:00100000:2.0:1786015495.494485:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 324 00000100:00100000:2.0:1786015495.494497:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280553728:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015495.494524:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015495.494551:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c502359 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8abe expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015495.494639:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304432512:192.168.202.56@tcp:106: 00000100:00100000:2.0:1786015495.495113:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786015495.499715:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304432512:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015495.499808:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c502359 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8abe expref: 13 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.499843:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c502359 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8abe expref: 13 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015495.499859:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e7e00, rc 0) 00000100:00100000:1.0:1786015495.499942:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280553728:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 5445us (5819us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015495.499953:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 324 00000100:00100000:3.0:1786015495.507279:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015495.507394:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280553984 00000100:00100000:2.0:1786015495.507410:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280553984 00000100:00100000:2.0:1786015495.507516:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1203 00000100:00100000:2.0:1786015495.507529:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+98:30067:x1872772280553984:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:2.0:1786015495.508011:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].34, 136 off12816 00000100:00100000:2.0:1786015495.508145:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+98:30067:x1872772280553984:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 617us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015495.508155:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1203 00000100:00100000:0.0:1786015495.852358:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304432640:0@lo:400:kworker.0 00000100:00100000:0.0:1786015495.852487:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015495.852559:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304433152:0@lo:400:kworker.0 00000100:00100000:0.0:1786015495.852592:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015495.852627:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786015495.852633:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304433024:0@lo:400:kworker.0 00000100:00100000:1.0:1786015495.852790:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304432640 00000100:00100000:1.0:1786015495.852802:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304432640 00000100:00100000:1.0:1786015495.852866:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1786015495.852878:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304432640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015495.852950:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304432640:12345-0@lo:400:kworker.0 Request processed in 75us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015495.852958:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:0.0:1786015495.853107:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015495.853156:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304432640:0@lo:400:kworker.0 00000100:00100000:0.0:1786015495.853191:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304432768:0@lo:400:kworker.0 00000100:00100000:0.0:1786015495.853218:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015495.853239:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304433280:0@lo:400:kworker.0 00000100:00100000:0.0:1786015495.853260:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015495.853279:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015495.853285:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304432896:0@lo:400:kworker.0 00000100:00100000:0.0:1786015495.853304:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015495.853337:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304433152 00000100:00100000:0.0:1786015495.853341:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304433152 00000100:00100000:0.0:1786015495.853389:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304432768 00000100:00100000:0.0:1786015495.853392:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304432768 00000100:00100000:0.0:1786015495.853412:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304432896 00000100:00100000:0.0:1786015495.853415:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304432896 00000100:00100000:0.0:1786015495.853434:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1786015495.853441:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304433152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015495.853497:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304433152:12345-0@lo:400:kworker.0 Request processed in 56us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015495.853504:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1786015495.853519:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1786015495.853526:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304432768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015495.853558:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304432768:12345-0@lo:400:kworker.0 Request processed in 32us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015495.853564:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1786015495.853575:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1786015495.853581:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304432896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015495.853610:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304432896:12345-0@lo:400:kworker.0 Request processed in 29us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015495.853616:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1786015495.853643:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304433024 00000100:00100000:0.0:1786015495.853647:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304433024 00000100:00100000:1.0:1786015495.854117:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304433280 00000100:00100000:1.0:1786015495.854122:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304433280 00000100:00100000:1.0:1786015495.854166:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:1.0:1786015495.854174:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304433280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015495.854219:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304433280:12345-0@lo:400:kworker.0 Request processed in 46us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015495.854225:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1786015495.856065:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:0.0:1786015495.856092:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304433024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015495.856206:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304433024:12345-0@lo:400:kworker.0 Request processed in 125us (3097us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015495.856214:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00080000:1.0:1786015495.856336:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015495.856346:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015495.863532:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304433024:0@lo:400:kworker.0 00000100:00100000:3.0:1786015495.863562:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304433152:0@lo:400:kworker.0 00000100:00100000:2.0:1786015495.866065:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304432896:0@lo:400:kworker.0 00000100:00100000:2.0:1786015495.866091:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304432768:0@lo:400:kworker.0 00000100:00100000:2.0:1786015495.866105:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304433280:0@lo:400:kworker.0 00010000:00010000:1.0:1786015496.046422:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015496.308480:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015496.308495:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015496.308688:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 35 count 2 00000040:00080000:3.0:1786015496.308696:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015496.309052:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304433408:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015496.309177:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74af54bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1786015496.315150:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304433408:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015496.316652:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015496.317910:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280554112 00000100:00100000:0.0:1786015496.317932:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280554112 00000100:00100000:0.0:1786015496.318050:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1204 00000100:00100000:0.0:1786015496.318063:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+48:30078:x1872772280554112:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015496.318114:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x23:0x0] from 18446744073709551615 #0 00000100:00080000:1.0:1786015496.318115:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015496.320455:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+48:30078:x1872772280554112:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 2380us (3797us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015496.320504:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1204 00000100:00100000:3.0:1786015496.353927:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015496.354060:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280554368 00000100:00100000:0.0:1786015496.354074:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280554368 00000100:00100000:0.0:1786015496.354149:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1205 00000100:00100000:0.0:1786015496.354160:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:30078:x1872772280554368:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015496.354202:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015496.354232:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502360 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ac5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.354360:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c502367 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.354378:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c502367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.354394:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c502367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015496.354408:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:0.0:1786015496.354591:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502360 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ac5 expref: 51 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.354615:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c502367 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ac5 expref: 50 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.354625:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:0.0:1786015496.354628:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015496.354632:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afda00, rc 0) 00000100:00100000:0.0:1786015496.354895:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:30078:x1872772280554368:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 737us (982us total) trans 4294968087 rc 0/0 00000100:00100000:0.0:1786015496.354904:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1205 00000100:00100000:3.0:1786015496.366671:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304433536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015496.366821:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015496.367052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015496.367141:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280554496 00000100:00100000:3.0:1786015496.367152:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280554496 00000100:00100000:3.0:1786015496.367251:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 325 00000100:00100000:3.0:1786015496.367266:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280554496:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015496.367330:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c502375 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015496.367356:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1ed4291/0xb1a5ef690c502321 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa2 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015496.367368:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1a:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786015496.367372:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015496.367378:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c502375 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015496.367417:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1ed4291/0xb1a5ef690c502321 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa2 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015496.367440:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1ed4291/0xb1a5ef690c502321 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa2 expref: 11 pid: 6590 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015496.367455:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304433664:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015496.367551:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74af54bc00 going to sleep for 11 seconds 00000100:00080000:3.0:1786015496.367565:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015496.368229:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304433536 00000100:00100000:1.0:1786015496.368239:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304433536 00000100:00100000:1.0:1786015496.368306:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1786015496.368316:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304433536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015496.368356:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015496.368441:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304433536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015496.368448:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1786015496.368689:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304433536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015496.372435:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015496.372552:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280554624 00000100:00100000:3.0:1786015496.372567:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280554624 00000100:00100000:3.0:1786015496.372659:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 54 00000100:00100000:3.0:1786015496.372671:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b024c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+50:2354:x1872772280554624:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015496.372692:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015496.372725:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c502367 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ac5 expref: 50 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015496.372746:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:3.0:1786015496.372751:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015496.372858:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b024c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+49:2354:x1872772280554624:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 189us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015496.372868:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 54 00000100:00100000:3.0:1786015496.384236:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015496.384380:0:17969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280554752 00000100:00100000:0.0:1786015496.384393:0:17969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280554752 00002000:00100000:0.0:1786015496.384460:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1a:0x0] (0->157) req@ffff8b738299dc00 x1872772280554752/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:342/0 lens 648/0 e 0 to 0 dl 1786015507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015496.384483:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b738299dc00 with x1872772280554752 ext(0->157) 00010000:00010000:0.0:1786015496.384495:0:17969:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f1ed4291/0xb1a5ef690c502321 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa2 expref: 12 pid: 6590 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.384515:0:17969:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f1ed4291/0xb1a5ef690c502321 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa2 expref: 12 pid: 6590 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015496.384524:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b738299dc00 00000100:00100000:0.0:1786015496.384568:0:17969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:0.0:1786015496.384580:0:17969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280554752:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:0.0:1786015496.385502:0:17969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2354:x1872772280554752:12345-192.168.202.56@tcp:4:cp.0 Request processed in 916us (1271us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1786015496.385514:0:17969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00002000:00100000:0.0:1786015496.385526:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1a:0x0] (0->157) req@ffff8b738299dc00 x1872772280554752/t4294967370(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:342/0 lens 648/448 e 0 to 0 dl 1786015507 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015496.385536:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b738299dc00 with x1872772280554752 ext(0->157) 00010000:00010000:0.0:1786015496.385546:0:17969:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f1ed4291/0xb1a5ef690c502321 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa2 expref: 14 pid: 6590 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.385563:0:17969:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f1ed4291/0xb1a5ef690c502321 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa2 expref: 14 pid: 6590 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015496.385571:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b738299dc00 00000100:00100000:1.0:1786015496.385817:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304433664:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015496.385849:0:11384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c502375 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015496.395584:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015496.405599:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280554880 00000100:00100000:0.0:1786015496.405621:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280554880 00010000:00010000:0.0:1786015496.405690:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ed4291/0xb1a5ef690c502321 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa2 expref: 14 pid: 6590 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015496.405748:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 358 00000100:00100000:0.0:1786015496.405774:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2353:x1872772280554880:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015496.405796:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015496.405833:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1ed4291/0xb1a5ef690c502321 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa2 expref: 14 pid: 6590 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.405850:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1ed4291/0xb1a5ef690c502321 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa2 expref: 14 pid: 6590 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.405882:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1ed4291/0xb1a5ef690c502321 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa2 expref: 14 pid: 6590 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.405906:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015496.405911:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015496.405919:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c502375 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.405932:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c502375 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.405975:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015496.406062:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280554880:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 304us (10496us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015496.406076:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 358 00010000:00010000:1.0:1786015496.406240:0:11384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c502375 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015496.406252:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c502375 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015496.406284:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c502375 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015496.406294:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c502375 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015496.406305:0:11384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c502375 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015496.406313:0:11384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015496.406317:0:11384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c502375 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015496.406326:0:11384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c502375 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015496.406339:0:11384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c502375 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015496.406347:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c502375 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015496.406403:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280554496:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 39142us (39353us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015496.406411:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 325 00000100:00100000:2.0:1786015496.415424:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015496.415519:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280555136 00000100:00100000:0.0:1786015496.415535:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280555136 00000100:00100000:0.0:1786015496.415622:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1206 00000100:00100000:0.0:1786015496.415635:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+49:30078:x1872772280555136:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015496.415822:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+49:30078:x1872772280555136:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 189us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015496.415830:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1206 00000100:00100000:3.0:1786015496.423336:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015496.423391:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280555264 00000100:00100000:2.0:1786015496.423404:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280555264 00000100:00100000:2.0:1786015496.423479:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 326 00000100:00100000:2.0:1786015496.423492:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280555264:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015496.423518:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015496.423547:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c50237c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8acc expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015496.423597:0:14547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 158, mtime: 0x6a746f07, atime: 0x0, ctime: 0x6a746f07, blocks: 0x1 00010000:00010000:2.0:1786015496.423625:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=731s v=(0 0) 00010000:00010000:2.0:1786015496.423631:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015496.423653:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c50237c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8acc expref: 13 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015496.423684:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c50237c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8acc expref: 13 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015496.423702:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e7e00, rc 0) 00000100:00100000:2.0:1786015496.423817:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280555264:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 328us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015496.423826:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 326 00000100:00100000:0.0:1786015496.431712:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015496.431840:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280555520 00000100:00100000:3.0:1786015496.431856:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280555520 00000100:00100000:3.0:1786015496.431939:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1207 00000100:00100000:3.0:1786015496.431950:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+49:30078:x1872772280555520:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786015496.432100:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+49:30078:x1872772280555520:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 151us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015496.432109:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1207 00000100:00100000:2.0:1786015496.459233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015496.459562:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280555648 00000100:00100000:3.0:1786015496.459578:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280555648 00002000:00100000:3.0:1786015496.459665:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1a:0x0] (0->4095) req@ffff8b7381f9ce00 x1872772280555648/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:342/0 lens 488/0 e 0 to 0 dl 1786015507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015496.459677:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381f9ce00 with x1872772280555648 ext(0->4095) 00002000:00010000:3.0:1786015496.459685:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7381f9ce00 00000100:00100000:3.0:1786015496.459725:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 105 00000100:00100000:3.0:1786015496.459735:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280555648:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1786015496.460041:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280555648:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 306us (819us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786015496.460050:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 105 00002000:00100000:3.0:1786015496.460058:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1a:0x0] (0->4095) req@ffff8b7381f9ce00 x1872772280555648/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:342/0 lens 488/4536 e 0 to 0 dl 1786015507 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015496.460066:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381f9ce00 with x1872772280555648 ext(0->4095) 00002000:00010000:3.0:1786015496.460070:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7381f9ce00 00000040:00080000:0.0:1786015496.469456:0:20909:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015496.469477:0:20909:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015496.469541:0:20909:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 35 count 2 00000040:00080000:0.0:1786015496.469548:0:20909:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015496.483870:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015496.484003:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280555776 00000100:00100000:1.0:1786015496.484018:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280555776 00000100:00100000:1.0:1786015496.484101:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1208 00000100:00100000:1.0:1786015496.484114:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:30078:x1872772280555776:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015496.484148:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015496.484180:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502383 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ad3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015496.484241:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c50238a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015496.484260:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c50238a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015496.484275:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c50238a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015496.484415:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502383 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ad3 expref: 51 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015496.484438:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c50238a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ad3 expref: 50 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015496.484449:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:1.0:1786015496.484452:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015496.484456:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921a00, rc 0) 00000100:00100000:1.0:1786015496.484548:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:30078:x1872772280555776:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 438us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015496.484556:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1208 00000100:00100000:3.0:1786015496.497820:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015496.498074:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280555904 00000100:00100000:2.0:1786015496.498087:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280555904 00000100:00100000:2.0:1786015496.499034:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1209 00000100:00100000:2.0:1786015496.499055:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+50:30078:x1872772280555904:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015496.499103:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x23:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015496.499283:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+50:30078:x1872772280555904:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 235us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015496.499292:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1209 00000100:00100000:1.0:1786015496.512723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015496.514919:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280556032 00000100:00100000:3.0:1786015496.514943:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280556032 00000100:00100000:3.0:1786015496.515036:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 327 00000100:00100000:3.0:1786015496.515049:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280556032:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015496.515116:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502391 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015496.515140:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015496.515146:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015496.515155:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502391 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015496.515172:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502391 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015496.515214:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502391 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015496.515224:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502391 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015496.515232:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502391 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015496.515240:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015496.515245:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502391 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015496.515254:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502391 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015496.515271:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502391 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015496.515279:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502391 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015496.515391:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280556032:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 343us (2689us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015496.515400:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 327 00000100:00100000:2.0:1786015496.529112:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015496.529242:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280556288 00000100:00100000:0.0:1786015496.529255:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280556288 00000100:00100000:0.0:1786015496.529333:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1210 00000100:00100000:0.0:1786015496.529345:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+50:30078:x1872772280556288:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786015496.529452:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502398 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.529485:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c50238a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ad3 expref: 50 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.529496:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502398 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.529545:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c50238a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ad3 expref: 50 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.529563:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c50238a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ad3 expref: 50 pid: 5795 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015496.529582:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cace00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304433792:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015496.529700:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb4840 going to sleep for 11 seconds 00000100:00100000:1.0:1786015496.543734:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015496.543805:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280556416 00000100:00100000:1.0:1786015496.543819:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280556416 00010000:00010000:1.0:1786015496.543884:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c50238a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ad3 expref: 51 pid: 5795 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015496.543943:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 359 00000100:00100000:1.0:1786015496.543955:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+51:2353:x1872772280556416:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015496.543976:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015496.543985:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c50238a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ad3 expref: 51 pid: 5795 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015496.544003:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c50238a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ad3 expref: 51 pid: 5795 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015496.544036:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:1.0:1786015496.544042:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502398 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015496.544054:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502398 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015496.544064:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502398 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015496.544088:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015496.544160:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+51:2353:x1872772280556416:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 207us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015496.544169:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 359 00010000:00010000:0.0:1786015496.544387:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c50238a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ad3 expref: 50 pid: 5795 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015496.544409:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cace00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304433792:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015496.544435:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502398 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.544445:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502398 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.544453:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502398 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.544743:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502398 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.544752:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502398 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.544782:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502398 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.544790:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015496.544796:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502398 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.544805:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502398 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.544816:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:0.0:1786015496.544819:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015496.544824:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502398 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015496.544830:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502398 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015496.544986:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+50:30078:x1872772280556288:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 15643us (15890us total) trans 4294968088 rc 0/0 00000100:00100000:0.0:1786015496.544997:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1210 00000040:00080000:1.0:1786015496.548455:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015496.548481:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015496.549007:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1786015496.549019:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015496.557690:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015496.557802:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280556672 00000100:00100000:3.0:1786015496.557822:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280556672 00000100:00100000:3.0:1786015496.557931:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 241 00000100:00100000:3.0:1786015496.557944:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+50:30078:x1872772280556672:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786015496.558300:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:30078:x1872772280556672:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 357us (622us total) trans 4294968089 rc 0/0 00000100:00100000:3.0:1786015496.558310:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 241 00010000:00010000:1.0:1786015497.068610:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786015497.520854:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967370 is committed 00010000:00010000:0.0:1786015498.092613:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015498.695707:0:20962:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015498.695721:0:20962:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015498.695791:0:20962:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 35 count 2 00000040:00080000:2.0:1786015498.695797:0:20962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015498.884782:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015498.884841:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280556928 00000100:00100000:2.0:1786015498.884855:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280556928 00000100:00100000:2.0:1786015498.884939:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1211 00000100:00100000:2.0:1786015498.884951:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+98:30093:x1872772280556928:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1786015498.884981:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015498.885009:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c50239f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ada expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015498.885150:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5023a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015498.885170:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5023a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015498.885187:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5023a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015498.885201:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:2.0:1786015498.885376:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c50239f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ada expref: 101 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015498.885399:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5023a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ada expref: 100 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015498.885408:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:2.0:1786015498.885412:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015498.885416:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6600, rc 0) 00000100:00100000:2.0:1786015498.885516:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+100:30093:x1872772280556928:12345-192.168.202.56@tcp:101:cat.0 Request processed in 566us (763us total) trans 4294968090 rc 0/0 00000100:00100000:2.0:1786015498.885524:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1211 00000100:00080000:2.0:1786015498.885554:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015498.901216:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015498.901272:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280557056 00000100:00100000:1.0:1786015498.901285:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280557056 00000100:00100000:1.0:1786015498.901362:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:1.0:1786015498.901375:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+100:2354:x1872772280557056:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015498.901396:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015498.901430:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c5023a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ada expref: 100 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015498.901461:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:1.0:1786015498.901468:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015498.901542:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+99:2354:x1872772280557056:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 169us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015498.901550:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:1.0:1786015498.910537:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015498.910647:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280557184 00000100:00100000:3.0:1786015498.910662:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280557184 00000100:00100000:3.0:1786015498.910797:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 328 00000100:00100000:3.0:1786015498.910811:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280557184:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:3.0:1786015498.910836:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015498.910862:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c5023b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ae1 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015498.910904:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1786015498.910910:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015498.910920:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c5023b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ae1 expref: 13 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015498.910941:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c5023b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ae1 expref: 13 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015498.910958:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc600, rc 0) 00000100:00100000:3.0:1786015498.911030:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+13:2354:x1872772280557184:12345-192.168.202.56@tcp:101:cat.0 Request processed in 222us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015498.911037:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 328 00000100:00080000:0.0:1786015498.911852:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015498.916708:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015498.917276:0:17970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280557312 00000100:00100000:0.0:1786015498.917291:0:17970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280557312 00002000:00100000:0.0:1786015498.917364:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1a:0x0] (0->4095) req@ffff8b7384fe6a00 x1872772280557312/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:344/0 lens 488/0 e 0 to 0 dl 1786015509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015498.917379:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384fe6a00 with x1872772280557312 ext(0->4095) 00002000:00010000:0.0:1786015498.917387:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384fe6a00 00000100:00100000:0.0:1786015498.917800:0:17970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 106 00000100:00100000:0.0:1786015498.917815:0:17970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41677fca-39fb-471c-b582-96bce6540a36+13:2352:x1872772280557312:12345-192.168.202.56@tcp:3:cat.0 00000100:00100000:0.0:1786015498.918120:0:17970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41677fca-39fb-471c-b582-96bce6540a36+13:2352:x1872772280557312:12345-192.168.202.56@tcp:3:cat.0 Request processed in 307us (1425us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786015498.918134:0:17970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 106 00002000:00100000:0.0:1786015498.918142:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1a:0x0] (0->4095) req@ffff8b7384fe6a00 x1872772280557312/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:344/0 lens 488/4536 e 0 to 0 dl 1786015509 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015498.918151:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384fe6a00 with x1872772280557312 ext(0->4095) 00002000:00010000:0.0:1786015498.918156:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384fe6a00 00000100:00100000:1.0:1786015498.924139:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015498.924390:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280557568 00000100:00100000:2.0:1786015498.924405:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280557568 00000100:00100000:2.0:1786015498.924522:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 242 00000100:00100000:2.0:1786015498.924543:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+99:30093:x1872772280557568:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:2.0:1786015498.924955:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+100:30093:x1872772280557568:12345-192.168.202.56@tcp:35:cat.0 Request processed in 420us (835us total) trans 4294968091 rc 0/0 00000100:00100000:2.0:1786015498.924965:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 242 00000100:00100000:2.0:1786015498.969656:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015498.969739:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280557824 00000100:00100000:3.0:1786015498.969754:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280557824 00000100:00100000:2.0:1786015498.970030:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1212 00000100:00100000:2.0:1786015498.970043:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+100:30094:x1872772280557824:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015498.970077:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015498.970119:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c5023bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ae8 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015498.970257:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c5023c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015498.970272:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c5023c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015498.970282:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c5023c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015498.970295:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:2.0:1786015498.970440:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c5023bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ae8 expref: 103 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015498.970475:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c5023c2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ae8 expref: 102 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015498.970487:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:2.0:1786015498.970489:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786015498.970492:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1c00, rc 0) 00000100:00100000:2.0:1786015498.970572:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+102:30094:x1872772280557824:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 531us (931us total) trans 4294968092 rc 0/0 00000100:00100000:2.0:1786015498.970580:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1212 00000100:00100000:0.0:1786015498.977381:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015498.979947:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280557952 00000100:00100000:2.0:1786015498.979969:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280557952 00000100:00100000:2.0:1786015498.980044:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 329 00000100:00100000:2.0:1786015498.980056:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+13:2353:x1872772280557952:12345-192.168.202.56@tcp:1:lfs.0 00010000:00010000:2.0:1786015498.980133:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9e3925a/0xb1a5ef690c5023d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015498.980160:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c50237c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8acc expref: 10 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015498.980170:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c5023b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ae1 expref: 13 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015498.980179:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015498.980184:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015498.980190:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e3925a/0xb1a5ef690c5023d0 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015498.980239:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c5023b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ae1 expref: 13 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015498.980257:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c5023b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ae1 expref: 13 pid: 11384 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015498.980274:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304433920:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015498.980414:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c50237c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8acc expref: 10 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015498.980426:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c50237c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8acc expref: 10 pid: 14547 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015498.980436:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304434048:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015498.980476:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786015498.990625:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015498.990866:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304433920:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015498.990886:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304434048:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015498.990926:0:14547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c9e3925a/0xb1a5ef690c5023d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015498.991048:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280558080 00000100:00100000:0.0:1786015498.991058:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280558080 00010000:00010000:0.0:1786015498.991119:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c5023b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ae1 expref: 14 pid: 11384 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015498.991158:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 360 00000100:00100000:0.0:1786015498.991169:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+14:2353:x1872772280558080:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015498.991190:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786015498.991217:0:5782:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1786015498.991227:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c5023b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ae1 expref: 14 pid: 11384 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015498.991242:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c5023b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ae1 expref: 14 pid: 11384 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015498.991278:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c5023b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ae1 expref: 14 pid: 11384 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015498.991302:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015498.991386:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+13:2353:x1872772280558080:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 218us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015498.991395:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 360 00000100:00100000:3.0:1786015498.992033:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015498.992153:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280558208 00000100:00100000:1.0:1786015498.992160:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280558208 00010000:00010000:1.0:1786015498.992209:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c50237c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8acc expref: 11 pid: 14547 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015498.992247:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 361 00000100:00100000:1.0:1786015498.992257:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280558208:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015498.992271:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015498.992292:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c50237c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8acc expref: 11 pid: 14547 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015498.992305:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c50237c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8acc expref: 11 pid: 14547 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015498.992326:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c50237c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8acc expref: 11 pid: 14547 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015498.992342:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015498.992347:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015498.992354:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9e3925a/0xb1a5ef690c5023d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015498.992367:0:17038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e3925a/0xb1a5ef690c5023d0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015498.992403:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015498.992523:0:14547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c9e3925a/0xb1a5ef690c5023d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015498.992533:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9e3925a/0xb1a5ef690c5023d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015498.992569:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9e3925a/0xb1a5ef690c5023d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015498.992579:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e3925a/0xb1a5ef690c5023d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015498.992587:0:14547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9e3925a/0xb1a5ef690c5023d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015498.992596:0:14547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1000 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015498.992602:0:14547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9e3925a/0xb1a5ef690c5023d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015498.992615:0:14547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9e3925a/0xb1a5ef690c5023d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015498.992630:0:14547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9e3925a/0xb1a5ef690c5023d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015498.992638:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9e3925a/0xb1a5ef690c5023d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015498.992733:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+12:2353:x1872772280557952:12345-192.168.202.56@tcp:1:lfs.0 Request processed in 12678us (15364us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015498.992743:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 329 00000100:00100000:1.0:1786015498.993051:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280558208:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 795us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015498.993059:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 361 00000100:00080000:0.0:1786015498.993183:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015498.995652:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015498.995746:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280558464 00000100:00100000:3.0:1786015498.995799:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280558464 00000100:00100000:3.0:1786015498.995892:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 243 00000100:00100000:3.0:1786015498.995904:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+102:30094:x1872772280558464:12345-192.168.202.56@tcp:35:lfs.0 00000004:00010000:3.0:1786015498.995992:0:5798:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x23:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c5023c2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ae8 expref: 102 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786015498.996299:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968093 00000001:00080000:3.0:1786015498.997016:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968094 00010000:00010000:3.0:1786015498.997100:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5023d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015498.997122:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50230c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a94 expref: 50 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015498.997133:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50233d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa9 expref: 105 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015498.997143:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5023d7 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015498.997193:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50233d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa9 expref: 105 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015498.997212:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50233d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa9 expref: 105 pid: 5795 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015498.997228:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304434176:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015498.997344:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50230c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a94 expref: 50 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015498.997354:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50230c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a94 expref: 50 pid: 5794 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015498.997363:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304434304:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015498.997386:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786015499.001695:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015499.001863:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304434176:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015499.001880:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304434304:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015499.001920:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5023d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015499.002022:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280558592 00000100:00100000:1.0:1786015499.002031:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280558592 00010000:00010000:1.0:1786015499.002081:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50233d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa9 expref: 106 pid: 5795 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015499.002125:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 362 00000100:00100000:1.0:1786015499.002137:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+106:2353:x1872772280558592:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015499.002157:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015499.002166:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50233d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa9 expref: 106 pid: 5795 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.002179:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50233d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa9 expref: 106 pid: 5795 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.002208:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50233d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aa9 expref: 106 pid: 5795 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.002230:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:1.0:1786015499.002236:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5023d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.002245:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5023d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.002252:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015499.002314:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+105:2353:x1872772280558592:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 178us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015499.002323:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 362 00000100:00100000:1.0:1786015499.003068:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015499.004810:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280558720 00000100:00100000:3.0:1786015499.004831:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280558720 00010000:00010000:2.0:1786015499.005021:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50230c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a94 expref: 51 pid: 5794 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786015499.005025:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015499.005099:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 363 00000100:00100000:2.0:1786015499.005113:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b024e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+51:2353:x1872772280558720:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015499.005133:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015499.005141:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50230c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a94 expref: 51 pid: 5794 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.005163:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50230c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a94 expref: 51 pid: 5794 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.005193:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c50230c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a94 expref: 51 pid: 5794 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.005214:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:2.0:1786015499.005220:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5023d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.005231:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5023d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.005239:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5023d7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.005274:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015499.005358:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b024e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+50:2353:x1872772280558720:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 248us (2293us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015499.005366:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 363 00010000:00010000:3.0:1786015499.005484:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5023d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.005493:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5023d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786015499.005701:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968095 00000001:00080000:3.0:1786015499.005993:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968096 00000001:00080000:3.0:1786015499.006060:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968097 00000100:00100000:3.0:1786015499.006173:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304434432:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786015499.006248:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015499.006305:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748628ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015499.007860:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304434432 00000100:00100000:0.0:1786015499.007877:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304434432 00000100:00100000:0.0:1786015499.007981:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786015499.007993:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5798:x1872772304434432:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786015499.008145:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5798:x1872772304434432:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 154us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015499.008154:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786015499.008220:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304434432:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1786015499.008743:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968098 00000100:00100000:0.0:1786015499.008883:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee59500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304434560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786015499.008935:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015499.008975:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304434560 00000100:00100000:0.0:1786015499.008980:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304434560 00000100:00100000:0.0:1786015499.009012:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1786015499.009020:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5798:x1872772304434560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786015499.009257:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5798:x1872772304434560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 236us (319us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1786015499.009263:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1786015499.009291:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015499.009316:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee59500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304434560:0@lo:1000:mdt_rdpg00_001.0 00010000:00010000:0.0:1786015499.009343:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5023d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.009356:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5023d7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.009365:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5023d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.009373:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015499.009378:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5023d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.009387:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5023d7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.009408:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:0.0:1786015499.009411:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1786015499.009417:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5023d7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.009424:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5023d7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786015499.009659:0:5798:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x49:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1786015499.009824:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].18, 64 off9440 00000004:00080000:0.0:1786015499.009839:0:5798:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 734261076301ns, next at 735261073747ns, rc = 0 00000001:00080000:0.0:1786015499.009848:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968099 00010000:00010000:0.0:1786015499.009888:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:0.0:1786015499.009891:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786015499.009899:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c5023c2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ae8 expref: 109 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015499.010043:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+108:30094:x1872772280558464:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 14140us (14415us total) trans 4294968100 rc 0/0 00000100:00100000:0.0:1786015499.010052:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 243 00000020:00080000:0.0:1786015499.010056:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00080000:3.0:1786015499.010241:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015499.066034:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015499.066157:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280558976 00000100:00100000:0.0:1786015499.066171:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280558976 00000100:00100000:0.0:1786015499.066249:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1213 00000100:00100000:0.0:1786015499.066262:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+108:30100:x1872772280558976:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1786015499.066297:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015499.066327:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5023de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8aef expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.066429:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5023e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.066455:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5023e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.066470:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5023e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.066487:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5023ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.066495:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5023ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.066502:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5023ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.066701:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5023f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.066710:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5023f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.066717:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5023f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015499.066729:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:0.0:1786015499.067090:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5023e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.067099:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5023e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.067106:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5023e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.067113:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015499.067118:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5023e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.067126:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5023e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.067141:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:0.0:1786015499.067144:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015499.067149:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5023e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.067159:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5023e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.067176:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5023ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.067183:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5023ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.067188:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5023ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.067193:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015499.067196:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5023ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.067201:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5023ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.067208:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8b748f24a100) 00010000:00010000:0.0:1786015499.067210:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015499.067213:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5023ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.067218:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5023ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.067274:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5023de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aef expref: 111 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.067294:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5023f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aef expref: 110 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.067302:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015499.067304:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015499.067307:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc600, rc 0) 00000100:00100000:0.0:1786015499.067540:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+110:30100:x1872772280558976:12345-192.168.202.56@tcp:101:cat.0 Request processed in 1270us (1511us total) trans 4294968101 rc 0/0 00000100:00100000:0.0:1786015499.067551:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1213 00000100:00100000:0.0:1786015499.073978:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015499.074191:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280559232 00000100:00100000:3.0:1786015499.074205:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280559232 00000100:00100000:3.0:1786015499.074333:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:3.0:1786015499.074346:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+110:30100:x1872772280559232:12345-192.168.202.56@tcp:103:cat.0 00010000:00010000:3.0:1786015499.074367:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015499.074399:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5023f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8aef expref: 110 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.074424:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:3.0:1786015499.074441:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015499.074540:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+109:30100:x1872772280559232:12345-192.168.202.56@tcp:103:cat.0 Request processed in 189us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015499.074548:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:0.0:1786015499.077377:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015499.077496:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280559360 00000100:00100000:2.0:1786015499.077510:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280559360 00000100:00100000:2.0:1786015499.077977:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1214 00000100:00100000:2.0:1786015499.077989:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+109:30100:x1872772280559360:12345-192.168.202.56@tcp:58:cat.0 00010000:00010000:2.0:1786015499.078133:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502401 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.078157:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502401 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.078171:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502401 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786015499.078403:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].35, 136 off12952 00000100:00100000:2.0:1786015499.078585:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+109:30100:x1872772280559360:12345-192.168.202.56@tcp:58:cat.0 Request processed in 596us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015499.078594:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1214 00000100:00100000:3.0:1786015499.081142:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015499.081262:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280559488 00000100:00100000:0.0:1786015499.081275:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280559488 00000100:00100000:0.0:1786015499.081348:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1215 00000100:00100000:0.0:1786015499.081359:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+109:30100:x1872772280559488:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1786015499.081388:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015499.081419:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502408 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8af6 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.081508:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502401 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.081521:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502408 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8af6 expref: 110 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.081557:0:12526:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502401 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.081575:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502408 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8af6 expref: 110 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.081594:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7487f06f00) 00010000:00010000:0.0:1786015499.081597:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015499.081601:0:12526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502408 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8af6 expref: 110 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.081610:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afce00, rc 0) 00000100:00100000:0.0:1786015499.081706:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+110:30100:x1872772280559488:12345-192.168.202.56@tcp:101:cat.0 Request processed in 347us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015499.081715:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1215 00010000:00010000:1.0:1786015499.120028:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015499.330062:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015499.330124:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015499.330215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015499.330279:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280559744 00000100:00100000:3.0:1786015499.330294:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280559744 00000100:00100000:2.0:1786015499.330377:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280560256 00000100:00100000:2.0:1786015499.330382:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280560256 00000100:00100000:3.0:1786015499.330387:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 486 00000100:00100000:3.0:1786015499.330399:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280559744:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015499.330428:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 487 00000100:00100000:2.0:1786015499.330435:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280560256:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015499.330518:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280560256:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 83us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015499.330525:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 487 00000100:00100000:0.0:1786015499.330744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00080000:2.0:1786015499.330948:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015499.331373:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280560000 00000100:00100000:1.0:1786015499.331381:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280560000 00000100:00100000:1.0:1786015499.331748:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 495 00000100:00100000:1.0:1786015499.331778:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+50:2354:x1872772280560000:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015499.334963:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280559744:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 4546us (4898us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015499.334983:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 486 00000100:00100000:3.0:1786015499.335080:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280559616 00000100:00100000:3.0:1786015499.335092:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280559616 00000100:00100000:3.0:1786015499.335153:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 601 00000100:00100000:3.0:1786015499.335163:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280559616:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015499.335223:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280559616:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 61us (4958us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015499.335230:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 601 00000100:00100000:2.0:1786015499.336172:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015499.336232:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015499.336385:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280559872 00000100:00100000:0.0:1786015499.336397:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280559872 00000100:00100000:0.0:1786015499.336468:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280560128 00000100:00100000:0.0:1786015499.336471:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280560128 00000100:00100000:0.0:1786015499.336505:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 488 00000100:00100000:0.0:1786015499.336514:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280559872:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015499.336702:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+12:2354:x1872772280559872:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 188us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015499.336710:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 488 00000100:00100000:0.0:1786015499.336727:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 489 00000100:00100000:0.0:1786015499.336735:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280560128:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015499.336784:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280560128:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 49us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015499.336790:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 489 00000100:00080000:2.0:1786015499.337054:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015499.337495:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+50:2354:x1872772280560000:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 5732us (7365us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015499.337508:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 495 00000100:00100000:2.0:1786015499.437058:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304434688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015499.440538:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015499.446713:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304434688 00000100:00100000:0.0:1786015499.446742:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304434688 00000100:00100000:0.0:1786015499.446880:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1786015499.446895:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304434688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015499.446963:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015499.447403:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304434688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 511us (6876us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015499.447413:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:2.0:1786015499.447702:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015499.448776:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304434688:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1786015499.629969:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015499.629984:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015499.630039:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 36 count 3 00000040:00080000:0.0:1786015499.630047:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015499.630233:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b748825b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304434816:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786015499.630358:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb4540 going to sleep for 11 seconds 00000100:00100000:1.0:1786015499.634899:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b748825b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304434816:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786015499.634928:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015499.635013:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280560384 00000100:00100000:2.0:1786015499.635023:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280560384 00000100:00100000:2.0:1786015499.635106:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1216 00000100:00100000:2.0:1786015499.635117:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+50:30101:x1872772280560384:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015499.635162:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x23:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015499.635293:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+50:30101:x1872772280560384:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 176us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015499.635301:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1216 00000100:00100000:2.0:1786015499.648917:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015499.649328:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280560512 00000100:00100000:3.0:1786015499.649342:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280560512 00000100:00100000:3.0:1786015499.649426:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1217 00000100:00100000:3.0:1786015499.649445:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+50:30101:x1872772280560512:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1786015499.649552:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50240f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649583:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50240f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649599:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50240f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649619:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502416 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649627:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502416 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649634:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502416 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649663:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50241d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649672:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50241d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649679:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50241d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015499.649736:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00000004:00200000:3.0:1786015499.649741:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015499.649758:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50241d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649824:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50240f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649832:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50240f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649839:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50240f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649845:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015499.649850:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50240f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649857:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50240f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649871:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:3.0:1786015499.649874:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015499.649878:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50240f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649885:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50240f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649898:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502416 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649909:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502416 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649915:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502416 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649920:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015499.649922:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502416 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649928:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502416 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649933:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x92f5931a (ffff8b74a04b5b00) 00010000:00010000:3.0:1786015499.649936:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015499.649938:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502416 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649943:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502416 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649956:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50241d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649961:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50241d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649966:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50241d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649971:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015499.649975:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50241d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649981:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50241d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649988:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7487f06f00) 00010000:00010000:3.0:1786015499.649990:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015499.649992:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50241d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.649997:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50241d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015499.650085:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+50:30101:x1872772280560512:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 648us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015499.650102:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1217 00000100:00100000:0.0:1786015499.657947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015499.658387:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280560768 00000100:00100000:1.0:1786015499.658401:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280560768 00000100:00100000:1.0:1786015499.658525:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1218 00000100:00100000:1.0:1786015499.658538:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+50:30101:x1872772280560768:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015499.658704:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015499.658738:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502424 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8afd expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.661999:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50242b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.662031:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50242b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.662047:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50242b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015499.662061:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:1.0:1786015499.662949:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50242b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.662964:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50242b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.662971:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50242b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.662980:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015499.662986:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50242b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.662995:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50242b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.663012:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7487f06f00) 00010000:00010000:1.0:1786015499.663015:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015499.663021:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50242b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.663028:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50242b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.663092:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502424 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8afd expref: 52 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.663716:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:1.0:1786015499.663719:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786015499.663727:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502424 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8afd expref: 52 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.663741:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921600, rc 0) 00000100:00100000:1.0:1786015499.664329:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+51:30101:x1872772280560768:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 5788us (6395us total) trans 4294968102 rc 301/301 00000100:00100000:1.0:1786015499.664342:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1218 00000100:00100000:0.0:1786015499.668048:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015499.668181:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280560896 00000100:00100000:3.0:1786015499.668195:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280560896 00000100:00100000:3.0:1786015499.668272:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1219 00000100:00100000:3.0:1786015499.668284:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:30101:x1872772280560896:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015499.668344:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x23:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015499.668500:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:30101:x1872772280560896:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 218us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015499.668509:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1219 00000100:00100000:2.0:1786015499.676286:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015499.676912:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280561152 00000100:00100000:1.0:1786015499.676929:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280561152 00000100:00100000:1.0:1786015499.677030:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1220 00000100:00100000:1.0:1786015499.677042:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+51:30101:x1872772280561152:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015499.677077:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015499.677113:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502439 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b04 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.677948:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502440 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.677967:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.677980:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015499.677993:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 0 00010000:00010000:1.0:1786015499.678056:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502439 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b04 expref: 54 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.678078:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502440 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b04 expref: 53 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.678088:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8b7483ee6900) 00010000:00010000:1.0:1786015499.678091:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015499.678095:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920a00, rc 0) 00000100:00100000:1.0:1786015499.678176:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+53:30101:x1872772280561152:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1135us (1906us total) trans 4294968103 rc 0/0 00000100:00100000:1.0:1786015499.678186:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1220 00000100:00100000:0.0:1786015499.682210:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015499.682317:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280561408 00000100:00100000:2.0:1786015499.682330:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280561408 00000100:00100000:2.0:1786015499.682389:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1221 00000100:00100000:2.0:1786015499.682397:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+53:30101:x1872772280561408:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786015499.682486:0:12526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015499.682520:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502440 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b04 expref: 53 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.682549:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8b7483ee6900) 00010000:00010000:2.0:1786015499.682562:0:12526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015499.682596:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50244e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.682609:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502352 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ab7 expref: 109 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.682615:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50244e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.682963:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ab7 expref: 109 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.682977:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502352 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ab7 expref: 109 pid: 12526 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015499.682992:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304434944:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015499.683087:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d2240 going to sleep for 11 seconds 00000100:00100000:2.0:1786015499.686786:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304434944:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015499.686832:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50244e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015499.687730:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015499.688202:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280561536 00000100:00100000:1.0:1786015499.688213:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280561536 00010000:00010000:1.0:1786015499.688259:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502352 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ab7 expref: 110 pid: 12526 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015499.688295:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 364 00000100:00100000:1.0:1786015499.688302:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+110:2353:x1872772280561536:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015499.688318:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015499.688324:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502352 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ab7 expref: 110 pid: 12526 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.688336:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ab7 expref: 110 pid: 12526 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.688361:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502352 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ab7 expref: 110 pid: 12526 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.688376:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:1.0:1786015499.688381:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50244e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.688390:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50244e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.688396:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50244e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.688420:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015499.688494:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+109:2353:x1872772280561536:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 191us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015499.688501:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 364 00010000:00010000:0.0:1786015499.689830:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50244e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.689851:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50244e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.689896:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502455 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0xc197c139 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.689909:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502455 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xc197c139 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.689919:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502455 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xc197c139 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.690026:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50244e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.690032:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50244e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.690037:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50244e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.690042:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015499.690046:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50244e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.690052:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50244e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.690062:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:0.0:1786015499.690064:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015499.690067:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50244e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.690071:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50244e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.690083:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502455 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xc197c139 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.690088:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502455 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xc197c139 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.690091:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502455 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xc197c139 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.690094:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015499.690096:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502455 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xc197c139 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.690099:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502455 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xc197c139 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.690102:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xc197c139 (ffff8b748f24a100) 00010000:00010000:0.0:1786015499.690103:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015499.690105:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502455 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0xc197c139 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.690108:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502455 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0xc197c139 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015499.690210:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+52:30101:x1872772280561408:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 7809us (8009us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786015499.690217:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1221 00000100:00100000:0.0:1786015499.700659:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015499.700986:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280561664 00000100:00100000:2.0:1786015499.701001:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280561664 00000100:00100000:2.0:1786015499.701079:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1222 00000100:00100000:2.0:1786015499.701091:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+52:30101:x1872772280561664:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015499.701126:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015499.701159:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c50245c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b0b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.701210:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c502463 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.701228:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c502463 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.701243:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c502463 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.701379:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c50245c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b0b expref: 54 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.701403:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c502463 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b0b expref: 53 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.701413:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:2.0:1786015499.701417:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015499.701422:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6600, rc 0) 00000100:00100000:2.0:1786015499.701513:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:30101:x1872772280561664:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 423us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015499.701521:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1222 00000100:00100000:0.0:1786015499.704466:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015499.704580:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280561920 00000100:00100000:2.0:1786015499.704594:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280561920 00000100:00100000:2.0:1786015499.704670:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1223 00000100:00100000:2.0:1786015499.704682:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:30101:x1872772280561920:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786015499.704842:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50246a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.704863:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50246a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.704877:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50246a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015499.705162:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007d4058fa reply state 000000007dbb216f transno 4294968104 ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50246a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015499.705174:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786015499.705297:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+55:30101:x1872772280561920:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 616us (845us total) trans 4294968104 rc 0/0 00000100:00100000:2.0:1786015499.705307:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1223 00000100:00100000:0.0:1786015499.708835:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015499.709061:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280562048 00000100:00100000:1.0:1786015499.709075:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280562048 00000100:00100000:1.0:1786015499.709161:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1224 00000100:00100000:1.0:1786015499.709174:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+55:30101:x1872772280562048:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015499.709210:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015499.709242:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502471 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b12 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.709331:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502471 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b12 expref: 56 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.709349:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502471 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b12 expref: 56 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.709361:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:1.0:1786015499.709364:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015499.709368:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920800, rc 0) 00000100:00100000:1.0:1786015499.709457:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+56:30101:x1872772280562048:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 285us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015499.709466:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1224 00010000:00010000:2.0:1786015499.709914:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50246a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.709925:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50246a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.709934:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50246a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.709940:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386b200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015499.709945:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50246a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.709954:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50246a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.709968:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:2.0:1786015499.709971:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786015499.709975:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50246a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.709981:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50246a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015499.713972:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015499.714168:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280562176 00000100:00100000:2.0:1786015499.714183:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280562176 00000100:00100000:2.0:1786015499.714313:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 244 00000100:00100000:2.0:1786015499.714327:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+55:30101:x1872772280562176:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1786015499.714536:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+55:30101:x1872772280562176:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 Request processed in 212us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015499.714545:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 244 00000100:00100000:0.0:1786015499.718460:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015499.718562:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280562432 00000100:00100000:1.0:1786015499.718585:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280562432 00000100:00100000:1.0:1786015499.718681:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 245 00000100:00100000:1.0:1786015499.718693:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916acc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+55:30101:x1872772280562432:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015499.719048:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916acc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+56:30101:x1872772280562432:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 356us (610us total) trans 4294968105 rc 0/0 00000100:00100000:1.0:1786015499.719059:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 245 00000100:00100000:1.0:1786015499.722420:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015499.723396:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280562688 00000100:00100000:2.0:1786015499.723414:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280562688 00000100:00100000:3.0:1786015499.723913:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1225 00000100:00100000:3.0:1786015499.723927:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+56:30101:x1872772280562688:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786015499.724092:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+56:30101:x1872772280562688:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 167us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015499.724603:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1225 00000100:00100000:0.0:1786015499.729581:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015499.729826:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280562944 00000100:00100000:1.0:1786015499.729842:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280562944 00000100:00100000:1.0:1786015499.729928:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1226 00000100:00100000:1.0:1786015499.729941:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+56:30101:x1872772280562944:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015499.729975:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015499.730004:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502478 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b19 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.730154:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50247f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.730172:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502471 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b12 expref: 57 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.730181:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50247f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.730228:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502471 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b12 expref: 57 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.730246:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502471 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b12 expref: 57 pid: 12526 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015499.730265:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1222d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304435072:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015499.730386:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015499.734936:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015499.735221:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1222d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304435072:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015499.735261:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50247f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015499.735355:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280563072 00000100:00100000:2.0:1786015499.735365:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280563072 00010000:00010000:2.0:1786015499.735414:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502471 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b12 expref: 58 pid: 12526 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015499.735467:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 365 00000100:00100000:2.0:1786015499.735478:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+58:2354:x1872772280563072:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015499.735496:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015499.735504:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502471 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b12 expref: 58 pid: 12526 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.735518:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502471 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b12 expref: 58 pid: 12526 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.735548:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c502471 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b12 expref: 58 pid: 12526 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.735578:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:2.0:1786015499.735585:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50247f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.735595:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50247f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.735605:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50247f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.735648:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015499.735907:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+57:2354:x1872772280563072:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 429us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015499.735916:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 365 00010000:00010000:0.0:1786015499.735990:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50247f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.735998:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50247f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015499.736022:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 0 00000004:00080000:0.0:1786015499.736269:0:7673:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x18:0x0], index 0: 0 00010000:00010000:0.0:1786015499.736487:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50247f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.736496:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50247f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.736503:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50247f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.736509:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015499.736514:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50247f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.736522:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50247f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.736534:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:0.0:1786015499.736538:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015499.736543:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50247f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.736549:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50247f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.738223:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502478 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b19 expref: 57 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.738252:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:0.0:1786015499.738256:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015499.738262:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502478 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b19 expref: 57 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.738286:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921600, rc 0) 00000100:00100000:0.0:1786015499.738392:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+56:30101:x1872772280562944:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 8452us (8824us total) trans 4294968106 rc 301/301 00000100:00100000:0.0:1786015499.738404:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1226 00000100:00100000:2.0:1786015499.743859:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015499.743963:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280563328 00000100:00100000:1.0:1786015499.743975:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280563328 00000100:00100000:1.0:1786015499.744100:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 246 00000100:00100000:1.0:1786015499.744113:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+56:30101:x1872772280563328:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015499.744861:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+57:30101:x1872772280563328:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 745us (1100us total) trans 4294968107 rc 0/0 00000100:00100000:1.0:1786015499.744873:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 246 00000100:00100000:0.0:1786015499.749852:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015499.750185:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280563456 00000100:00100000:3.0:1786015499.750198:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280563456 00000100:00100000:3.0:1786015499.750277:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1227 00000100:00100000:3.0:1786015499.750289:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+57:30101:x1872772280563456:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015499.750324:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015499.750354:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50248d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b20 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.750467:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502494 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.750485:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.750499:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015499.750560:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 0 00000004:00200000:3.0:1786015499.750749:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015499.750826:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.750861:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50248d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b20 expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.750884:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502494 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b20 expref: 58 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.750901:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:3.0:1786015499.750904:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786015499.750908:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd200, rc 0) 00000100:00100000:3.0:1786015499.751033:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+58:30101:x1872772280563456:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 745us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015499.751041:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1227 00000100:00100000:0.0:1786015499.760200:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015499.760689:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280563584 00000100:00100000:3.0:1786015499.760702:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280563584 00000100:00100000:3.0:1786015499.760865:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 330 00000100:00100000:3.0:1786015499.760877:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280563584:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015499.760904:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015499.760932:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5849b9/0xb1a5ef690c50249b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b27 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015499.760966:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786015499.760994:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=735s v=(0 0) 00010000:00010000:3.0:1786015499.761000:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015499.761013:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5849b9/0xb1a5ef690c50249b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b27 expref: 9 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.761036:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c5849b9/0xb1a5ef690c50249b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b27 expref: 9 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.761052:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbcc00, rc 0) 00000100:00100000:3.0:1786015499.761147:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280563584:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 272us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015499.761155:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 330 00000100:00100000:2.0:1786015499.765618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015499.765728:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280563840 00000100:00100000:0.0:1786015499.765741:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280563840 00000100:00100000:0.0:1786015499.765840:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1228 00000100:00100000:0.0:1786015499.765853:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+58:30101:x1872772280563840:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015499.766002:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+58:30101:x1872772280563840:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 151us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015499.766010:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1228 00000100:00100000:1.0:1786015499.769831:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015499.769943:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280563968 00000100:00100000:2.0:1786015499.769957:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280563968 00000100:00100000:2.0:1786015499.770027:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 331 00000100:00100000:2.0:1786015499.770039:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:30101:x1872772280563968:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015499.770066:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015499.770091:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b760c3c/0xb1a5ef690c5024a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b2e expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.770134:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007c5849b9/0xb1a5ef690c50249b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b27 expref: 10 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.770144:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015499.770149:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015499.770155:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b760c3c/0xb1a5ef690c5024a2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b2e expref: 10 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.770199:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007c5849b9/0xb1a5ef690c50249b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b27 expref: 10 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.770220:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007c5849b9/0xb1a5ef690c50249b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b27 expref: 10 pid: 6592 timeout: 835 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015499.770238:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304435200:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015499.770352:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d2240 going to sleep for 11 seconds 00000100:00100000:2.0:1786015499.775589:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015499.775836:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304435200:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015499.775885:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b760c3c/0xb1a5ef690c5024a2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b2e expref: 10 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.775915:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386b000, rc 0) 00000100:00100000:1.0:1786015499.776007:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:30101:x1872772280563968:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 5968us (6192us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015499.776018:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 331 00000100:00100000:3.0:1786015499.776145:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280564096 00000100:00100000:3.0:1786015499.776156:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280564096 00010000:00010000:3.0:1786015499.776203:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007c5849b9/0xb1a5ef690c50249b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b27 expref: 10 pid: 6592 timeout: 835 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015499.776243:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 366 00000100:00100000:3.0:1786015499.776255:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280564096:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015499.776273:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015499.776306:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007c5849b9/0xb1a5ef690c50249b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b27 expref: 10 pid: 6592 timeout: 835 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.776321:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007c5849b9/0xb1a5ef690c50249b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b27 expref: 10 pid: 6592 timeout: 835 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.776350:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5849b9/0xb1a5ef690c50249b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b27 expref: 10 pid: 6592 timeout: 835 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.776367:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015499.776373:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015499.776382:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b760c3c/0xb1a5ef690c5024a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b2e expref: 9 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.776392:0:17038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b760c3c/0xb1a5ef690c5024a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b2e expref: 9 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.776442:0:17038:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009b760c3c/0xb1a5ef690c5024a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b2e expref: 9 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015499.776461:0:17038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:17038:1872772304435328:192.168.202.56@tcp:105: 00000100:00100000:3.0:1786015499.776528:0:17038:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7484fff6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015499.783471:0:17038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:17038:1872772304435328:192.168.202.56@tcp:105: 00010000:00010000:3.0:1786015499.783510:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015499.783599:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280564096:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 7345us (8034us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015499.783611:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 366 00000100:00100000:2.0:1786015499.789973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015499.790091:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280564224 00000100:00100000:3.0:1786015499.790119:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280564224 00002000:00100000:3.0:1786015499.790193:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x18:0x0] (0->157) req@ffff8b74c11a8000 x1872772280564224/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:345/0 lens 648/0 e 0 to 0 dl 1786015510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015499.790207:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c11a8000 with x1872772280564224 ext(0->157) 00002000:00010000:3.0:1786015499.790215:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74c11a8000 00000100:00100000:3.0:1786015499.790262:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 107 00000100:00100000:3.0:1786015499.790275:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280564224:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1786015499.791113:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280564224:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 835us (1149us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1786015499.791124:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 107 00002000:00100000:3.0:1786015499.791133:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x18:0x0] (0->157) req@ffff8b74c11a8000 x1872772280564224/t4294967360(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:345/0 lens 648/448 e 0 to 0 dl 1786015510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015499.791149:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c11a8000 with x1872772280564224 ext(0->157) 00002000:00010000:3.0:1786015499.791155:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74c11a8000 00000100:00100000:2.0:1786015499.795221:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015499.795446:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280564352 00000100:00100000:3.0:1786015499.795462:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280564352 00000100:00100000:3.0:1786015499.795551:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1229 00000100:00100000:3.0:1786015499.795871:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+58:30101:x1872772280564352:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1786015499.848807:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968106 is committed 00000001:00080000:2.0:1786015499.848832:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968101 is committed 00000004:00080000:2.0:1786015499.848840:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 23 committed 00000020:00080000:2.0:1786015499.848866:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b7382cb4cc0 refcount 2 committed 0 result 0 batchid 25 00000020:00080000:2.0:1786015499.848873:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b73813bb100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b7382cb4c00 00000020:00080000:2.0:1786015499.848877:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b73813bb900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74aec54400 00000001:00080000:2.0:1786015499.848912:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968107 is committed 00000020:00080000:3.0:1786015499.849054:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25 committed batchid 24 00000020:00080000:3.0:1786015499.849333:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 24 00000100:00100000:3.0:1786015499.849807:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304435456:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786015499.849919:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015499.850012:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304435456 00000100:00100000:3.0:1786015499.850025:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304435456 00000100:00100000:3.0:1786015499.850091:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1786015499.850115:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304435456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1786015499.850156:0:14547:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:26 count 1 00002000:00010000:3.0:1786015499.850204:0:14547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 158, mtime: 0x6a746f07, atime: 0x0, ctime: 0x6a746f07, blocks: 0xb 00010000:00010000:3.0:1786015499.850213:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5024a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.850235:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=735s v=(0 0) 00010000:00010000:3.0:1786015499.850241:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015499.850250:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5024a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.850271:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5024a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.850286:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5024a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.850296:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5024a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.850322:0:14547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786015499.852347:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3313:x1872772304435456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2223us (2417us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1786015499.852365:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00010000:3.0:1786015499.852415:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786015499.852426:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5024a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.852461:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbcc00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015499.852467:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5024a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.852479:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5024a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.852507:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5024a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.852515:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c5849b9/0xb1a5ef690c5024a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786015499.852825:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b74c103c380/2, rc 0, transno 4294967372 00000100:00100000:2.0:1786015499.852836:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304435456:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1786015499.853062:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015499.853065:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015499.853067:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015499.853378:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:30101:x1872772280564352:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 57812us (58167us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015499.853391:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1229 00000100:00100000:2.0:1786015499.856944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015499.857049:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280564480 00000100:00100000:3.0:1786015499.857062:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280564480 00000100:00100000:3.0:1786015499.857151:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 333 00000100:00100000:3.0:1786015499.857164:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280564480:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1786015499.890690:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967360 is committed 00000100:00100000:3.0:1786015499.890910:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280564480:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 33741us (33971us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015499.890922:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 333 00000100:00100000:2.0:1786015499.895507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015499.895886:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280564736 00000100:00100000:3.0:1786015499.895901:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280564736 00000100:00100000:3.0:1786015499.896034:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1230 00000100:00100000:3.0:1786015499.896047:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+47:30101:x1872772280564736:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786015499.896140:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015499.896178:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502494 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b20 expref: 47 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.896202:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:3.0:1786015499.896209:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015499.896253:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5024b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.896271:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5024b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.896288:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5024b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015499.896941:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002d424dd3 reply state 00000000833e2ed8 transno 4294968108 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5024b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015499.896956:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015499.897115:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+48:30101:x1872772280564736:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 1068us (1622us total) trans 4294968108 rc 0/0 00000100:00100000:3.0:1786015499.897125:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1230 00010000:00010000:1.0:1786015499.900790:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5024b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.900819:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5024b0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.900829:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5024b0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.900836:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015499.900842:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5024b0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.900850:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5024b0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.900873:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:1.0:1786015499.900876:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015499.900882:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5024b0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.900888:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5024b0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015499.901027:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015499.901631:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280564864 00000100:00100000:1.0:1786015499.901648:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280564864 00000100:00100000:1.0:1786015499.901731:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1231 00000100:00100000:1.0:1786015499.901743:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+47:30101:x1872772280564864:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015499.901797:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015499.901825:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5024b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b35 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.901911:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5024b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b35 expref: 48 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.901932:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5024b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b35 expref: 48 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.901955:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:1.0:1786015499.901957:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015499.901961:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921c00, rc 0) 00000100:00100000:1.0:1786015499.902539:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+48:30101:x1872772280564864:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 793us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015499.902551:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1231 00000100:00100000:2.0:1786015499.908155:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015499.908326:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280564992 00000100:00100000:1.0:1786015499.908341:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280564992 00000100:00100000:1.0:1786015499.908419:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 334 00000100:00100000:1.0:1786015499.908431:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280564992:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1786015499.908865:0:6591:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1786015499.908869:0:6591:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb mtime from disk: 0 -> 1786015495 00002000:00010000:1.0:1786015499.908872:0:6591:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb atime from disk: 0 -> 1786015499 00002000:00010000:1.0:1786015499.908874:0:6591:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb ctime from disk: 0 -> 1786015495 00002000:00010000:1.0:1786015499.908876:0:6591:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1786015499.908955:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280564992:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 525us (815us total) trans 4294967361 rc 0/0 00000100:00100000:1.0:1786015499.908964:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 334 00000100:00100000:2.0:1786015499.912088:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015499.912246:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280565248 00000100:00100000:1.0:1786015499.912262:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280565248 00000100:00100000:1.0:1786015499.912345:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1232 00000100:00100000:1.0:1786015499.912357:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:30101:x1872772280565248:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1786015499.912470:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5024be lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.912491:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c502463 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b0b expref: 48 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.912501:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5024be lrc: 4/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.912560:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c502463 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b0b expref: 48 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.912576:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c502463 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b0b expref: 48 pid: 5796 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015499.912593:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1222300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304435584:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015499.912730:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015499.916334:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015499.916474:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1222300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304435584:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015499.916515:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5024be lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015499.916667:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280565376 00000100:00100000:2.0:1786015499.916677:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280565376 00010000:00010000:2.0:1786015499.916894:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c502463 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b0b expref: 49 pid: 5796 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015499.916937:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 367 00000100:00100000:2.0:1786015499.916947:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:2353:x1872772280565376:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015499.916966:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015499.916974:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c502463 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b0b expref: 49 pid: 5796 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.916987:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c502463 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b0b expref: 49 pid: 5796 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.917015:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c502463 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b0b expref: 49 pid: 5796 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.917032:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:2.0:1786015499.917037:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5024be lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.917047:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5024be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.917055:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5024be lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.917082:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015499.918998:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5024be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.919018:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5024be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.919167:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5024be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.919177:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5024be lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.919184:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5024be lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.919191:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015499.919196:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5024be lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.919205:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5024be lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.919227:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:0.0:1786015499.919230:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1786015499.919235:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5024be lrc: 2/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.919242:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5024be lrc: 0/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015499.919392:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:30101:x1872772280565248:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 7031us (7312us total) trans 0 rc -22/-22 00000100:00100000:0.0:1786015499.919408:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1232 00000100:00100000:2.0:1786015499.920074:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2353:x1872772280565376:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 3124us (3753us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015499.920084:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 367 00000100:00100000:0.0:1786015499.924454:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015499.924567:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280565504 00000100:00100000:3.0:1786015499.924581:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280565504 00000100:00100000:3.0:1786015499.924667:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 335 00000100:00100000:3.0:1786015499.924680:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280565504:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015499.924750:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1e36d31/0xb1a5ef690c5024c5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.925008:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b760c3c/0xb1a5ef690c5024a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b2e expref: 10 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.925019:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015499.925024:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015499.925029:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1e36d31/0xb1a5ef690c5024c5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.925082:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009b760c3c/0xb1a5ef690c5024a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b2e expref: 10 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.925196:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009b760c3c/0xb1a5ef690c5024a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b2e expref: 10 pid: 6591 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015499.925216:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304435712:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015499.925321:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74853d0540 going to sleep for 11 seconds 00000100:00100000:0.0:1786015499.930968:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015499.931154:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280565632 00000100:00100000:1.0:1786015499.931167:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280565632 00010000:00010000:1.0:1786015499.931224:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009b760c3c/0xb1a5ef690c5024a2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b2e expref: 11 pid: 6591 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015499.931283:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 368 00000100:00100000:1.0:1786015499.931295:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280565632:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015499.931315:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015499.931347:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009b760c3c/0xb1a5ef690c5024a2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b2e expref: 11 pid: 6591 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.931363:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009b760c3c/0xb1a5ef690c5024a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b2e expref: 11 pid: 6591 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.931396:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015499.931402:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015499.931409:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1e36d31/0xb1a5ef690c5024c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.931421:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1e36d31/0xb1a5ef690c5024c5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015499.931462:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015499.931550:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280565632:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 256us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015499.931558:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 368 00010000:00010000:3.0:1786015499.931966:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b760c3c/0xb1a5ef690c5024a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b2e expref: 10 pid: 6591 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015499.931986:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304435712:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015499.932020:0:14547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1e36d31/0xb1a5ef690c5024c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.932033:0:14547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1e36d31/0xb1a5ef690c5024c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.932041:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1e36d31/0xb1a5ef690c5024c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.932074:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1e36d31/0xb1a5ef690c5024c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.932083:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1e36d31/0xb1a5ef690c5024c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.932097:0:14547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1e36d31/0xb1a5ef690c5024c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.932107:0:14547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015499.932112:0:14547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1e36d31/0xb1a5ef690c5024c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.932122:0:14547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1e36d31/0xb1a5ef690c5024c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.932136:0:14547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1e36d31/0xb1a5ef690c5024c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.932145:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1e36d31/0xb1a5ef690c5024c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015499.932206:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280565504:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 7529us (7776us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015499.932216:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 335 00000100:00100000:1.0:1786015499.935731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015499.935899:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280565888 00000100:00100000:3.0:1786015499.935912:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280565888 00000100:00100000:3.0:1786015499.935980:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1233 00000100:00100000:3.0:1786015499.935993:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+47:30101:x1872772280565888:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786015499.936132:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5024cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.936158:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5024cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.936174:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5024cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.936487:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5024d3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.936500:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5024b7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b35 expref: 48 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.936510:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5024d3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.936555:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5024b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b35 expref: 48 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.936574:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5024b7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b35 expref: 48 pid: 7673 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015499.936594:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304435840:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015499.936710:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74853d0540 going to sleep for 11 seconds 00000100:00100000:3.0:1786015499.939667:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304435840:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015499.939717:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5024d3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015499.940511:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015499.941942:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280566016 00000100:00100000:3.0:1786015499.941962:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280566016 00010000:00010000:2.0:1786015499.942214:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5024b7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b35 expref: 49 pid: 7673 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015499.942312:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 369 00000100:00100000:2.0:1786015499.942328:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b024f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+49:2354:x1872772280566016:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015499.942350:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015499.942358:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5024b7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b35 expref: 49 pid: 7673 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.942373:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5024b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b35 expref: 49 pid: 7673 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.942403:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5024b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b35 expref: 49 pid: 7673 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.942426:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:2.0:1786015499.942433:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5024d3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.942457:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5024d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.942466:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5024d3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015499.942506:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015499.942692:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5024d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.942701:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5024d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786015499.942994:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968109 00000001:00080000:3.0:1786015499.943201:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968110 00000001:00080000:3.0:1786015499.943255:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968111 00000100:00100000:3.0:1786015499.943368:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304435968:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1786015499.943466:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015499.943524:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74853d00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015499.943560:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304435968 00000100:00100000:3.0:1786015499.943567:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304435968 00000100:00100000:3.0:1786015499.943613:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1786015499.943622:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5796:x1872772304435968:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1786015499.943714:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5796:x1872772304435968:12345-0@lo:1000:mdt00_002.0 Request processed in 93us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015499.943722:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1786015499.943825:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304435968:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1786015499.944286:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968112 00000100:00100000:3.0:1786015499.944356:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304436096:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1786015499.944392:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015499.944429:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304436096 00000100:00100000:3.0:1786015499.944445:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304436096 00000100:00100000:3.0:1786015499.944475:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1786015499.944482:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5796:x1872772304436096:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1786015499.944655:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5796:x1872772304436096:12345-0@lo:1000:mdt00_002.0 Request processed in 173us (262us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1786015499.944663:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1786015499.944699:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015499.944721:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304436096:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1786015499.944837:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968113 00010000:00010000:3.0:1786015499.944869:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5024d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.944880:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5024d3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.944889:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5024d3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.944896:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015499.944901:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5024d3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.944910:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5024d3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.944929:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:3.0:1786015499.944933:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015499.944938:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5024d3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.944945:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5024d3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.944983:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502401 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.944995:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502401 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.945002:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502401 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.945007:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015499.945010:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502401 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.945016:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502401 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.945025:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7487f06f00) 00010000:00010000:3.0:1786015499.945027:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015499.945036:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502408 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8af6 expref: 95 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.945050:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502408 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8af6 expref: 95 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.945061:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502408 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8af6 expref: 95 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.945095:0:5796:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502408 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8af6 expref: 95 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015499.945109:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304436224:192.168.202.56@tcp:105: 00000100:00100000:2.0:1786015499.945239:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b024f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2354:x1872772280566016:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 2912us (4732us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015499.945250:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 369 00000100:00100000:3.0:1786015499.945966:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74853d0540 going to sleep for 11 seconds 00000100:00100000:2.0:1786015499.952556:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015499.952957:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280566144 00000100:00100000:0.0:1786015499.952972:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280566144 00000100:00100000:0.0:1786015499.953064:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 247 00000100:00100000:0.0:1786015499.953078:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+96:30100:x1872772280566144:12345-192.168.202.56@tcp:49:cat.0 00000100:00100000:0.0:1786015499.953290:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+96:30100:x1872772280566144:12345-192.168.202.56@tcp:49:cat.0 Request processed in 214us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015499.953297:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 247 00000100:00100000:3.0:1786015499.953815:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304436224:192.168.202.56@tcp:105: 00010000:00010000:3.0:1786015499.953861:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502401 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.953874:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502401 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.953926:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5024da lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.953947:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5024da lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.953963:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5024da lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.953974:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5024da lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.953980:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5024da lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.953988:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5024da lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.953994:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015499.953998:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5024da lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.954005:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5024da lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.954022:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7487f06f00) 00010000:00010000:3.0:1786015499.954026:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015499.954031:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5024da lrc: 2/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.954036:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5024da lrc: 0/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.954046:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5024cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.954052:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5024cc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.954057:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5024cc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.954062:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015499.954065:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5024cc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.954071:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5024cc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.954079:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7487f06f00) 00010000:00010000:3.0:1786015499.954082:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786015499.954084:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5024cc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.954089:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5024cc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015499.954397:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+52:30101:x1872772280565888:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 18404us (18678us total) trans 4294968114 rc 0/0 00000100:00100000:3.0:1786015499.954407:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1233 00000020:00080000:3.0:1786015499.954412:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:0.0:1786015499.954943:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015499.954949:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015499.955429:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1786015499.955450:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015499.964158:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015499.964247:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280566272 00000100:00100000:3.0:1786015499.964263:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280566272 00000100:00100000:3.0:1786015499.964340:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 336 00000100:00100000:3.0:1786015499.964353:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:30100:x1872772280566272:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:3.0:1786015499.964379:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015499.964408:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c5024e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b3c expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015499.964456:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 158, mtime: 0x6a746f07, atime: 0x6a746f0b, ctime: 0x6a746f07, blocks: 0xb 00010000:00010000:3.0:1786015499.964488:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=735s v=(0 0) 00010000:00010000:3.0:1786015499.964494:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015499.964507:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c5024e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b3c expref: 17 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.964539:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c5024e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b3c expref: 17 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.964555:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbde00, rc 0) 00000100:00100000:3.0:1786015499.964638:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:30100:x1872772280566272:12345-192.168.202.56@tcp:101:cat.0 Request processed in 287us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015499.964646:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 336 00000100:00100000:2.0:1786015499.970188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015499.970335:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280566400 00000100:00100000:3.0:1786015499.970349:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280566400 00002000:00100000:3.0:1786015499.970425:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8b7488258e00 x1872772280566400/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:345/0 lens 488/0 e 0 to 0 dl 1786015510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015499.970449:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7488258e00 with x1872772280566400 ext(0->4095) 00002000:00010000:3.0:1786015499.970459:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7488258e00 00000100:00100000:3.0:1786015499.970508:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 108 00000100:00100000:3.0:1786015499.970520:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280566400:12345-192.168.202.56@tcp:3:cat.0 00000100:00100000:3.0:1786015499.970895:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280566400:12345-192.168.202.56@tcp:3:cat.0 Request processed in 375us (726us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786015499.970905:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 108 00002000:00100000:3.0:1786015499.970913:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8b7488258e00 x1872772280566400/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:345/0 lens 488/4536 e 0 to 0 dl 1786015510 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015499.970923:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7488258e00 with x1872772280566400 ext(0->4095) 00002000:00010000:3.0:1786015499.970927:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7488258e00 00000100:00100000:2.0:1786015499.973333:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015499.976458:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015499.977457:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280566656 00000100:00100000:0.0:1786015499.977473:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280566656 00000100:00100000:0.0:1786015499.977563:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280566912 00000100:00100000:0.0:1786015499.977566:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280566912 00000100:00100000:0.0:1786015499.977588:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 248 00000100:00100000:0.0:1786015499.977600:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+52:30101:x1872772280566656:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1786015499.978884:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x24:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1786015499.979024:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968115 00010000:00010000:0.0:1786015499.980279:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5024e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.980311:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5024e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.980331:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5024e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.980345:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5024e8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.980352:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5024e8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.980358:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5024e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015499.980490:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786015499.980740:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+54:30101:x1872772280566656:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 3135us (7413us total) trans 4294968116 rc 0/0 00000100:00100000:0.0:1786015499.980755:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 248 00000020:00080000:0.0:1786015499.980781:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786015499.980829:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 249 00000100:00100000:0.0:1786015499.980846:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+96:30100:x1872772280566912:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:0.0:1786015499.981073:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+97:30100:x1872772280566912:12345-192.168.202.56@tcp:35:cat.0 Request processed in 234us (4643us total) trans 4294968117 rc 0/0 00000100:00100000:0.0:1786015499.981080:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 249 00010000:00010000:3.0:1786015499.981758:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786015499.981788:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5024e8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.981798:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc600 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015499.981803:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5024e8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.981812:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5024e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.981831:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8b748f24ab00) 00010000:00010000:3.0:1786015499.981835:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786015499.981840:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5024e8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.981846:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c5024e8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015499.981870:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015499.981872:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015499.981873:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015500.002081:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015500.003605:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280567040 00000100:00100000:1.0:1786015500.003637:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280567040 00000100:00100000:0.0:1786015500.003906:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1234 00000100:00100000:0.0:1786015500.003923:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+97:30102:x1872772280567040:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015500.003958:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015500.003989:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c5024ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b43 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004087:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5024f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004116:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5024f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004131:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5024f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004147:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5024fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004153:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5024fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004159:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5024fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004572:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502504 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004582:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004589:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015500.004635:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00000004:00200000:0.0:1786015500.004641:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015500.004663:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004682:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004691:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5024f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004697:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5024f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004703:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5024f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004710:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015500.004715:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5024f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004723:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5024f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004736:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:0.0:1786015500.004740:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015500.004744:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5024f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004750:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5024f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004804:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5024fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004810:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5024fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004816:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5024fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004821:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015500.004824:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5024fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004829:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5024fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004836:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8b748f24a100) 00010000:00010000:0.0:1786015500.004838:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015500.004840:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5024fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004846:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5024fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004882:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c5024ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b43 expref: 99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004898:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502504 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b43 expref: 98 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.004905:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7487f06f00) 00010000:00010000:0.0:1786015500.004908:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015500.004910:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afca00, rc 0) 00000100:00100000:0.0:1786015500.005088:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+98:30102:x1872772280567040:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1169us (3022us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015500.005101:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1234 00000100:00080000:2.0:1786015500.005568:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015500.011334:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015500.011450:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280567168 00000100:00100000:0.0:1786015500.011464:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280567168 00000100:00100000:0.0:1786015500.011641:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1235 00000100:00100000:0.0:1786015500.011655:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+98:30102:x1872772280567168:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015500.011697:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015500.011728:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c50250b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b4a expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.011857:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502512 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.011875:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.011888:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015500.012181:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 7680 00000004:00200000:0.0:1786015500.012186:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015500.012264:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.012301:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c50250b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b4a expref: 100 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.012322:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502512 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b4a expref: 99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.012339:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:0.0:1786015500.012342:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015500.012347:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afcc00, rc 0) 00000100:00100000:0.0:1786015500.012442:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+99:30102:x1872772280567168:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 781us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015500.012451:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1235 00000100:00100000:1.0:1786015500.020932:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015500.022159:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280567424 00000100:00100000:2.0:1786015500.022178:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280567424 00000100:00100000:0.0:1786015500.022271:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1236 00000100:00100000:0.0:1786015500.022284:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+99:30102:x1872772280567424:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015500.022315:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015500.022348:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502519 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b51 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.022513:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502520 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.022546:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502520 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.022561:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502520 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015500.022581:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:0.0:1786015500.022951:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502519 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b51 expref: 102 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.022972:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502520 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b51 expref: 101 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.022987:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7487f06f00) 00010000:00010000:0.0:1786015500.022990:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786015500.022994:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc200, rc 0) 00000100:00100000:0.0:1786015500.023079:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+101:30102:x1872772280567424:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 797us (2163us total) trans 4294968118 rc 0/0 00000100:00100000:0.0:1786015500.023087:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1236 00000100:00100000:1.0:1786015500.026370:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015500.027140:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280567552 00000100:00100000:2.0:1786015500.027156:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280567552 00000100:00100000:2.0:1786015500.027233:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 337 00000100:00100000:2.0:1786015500.027244:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280567552:12345-192.168.202.56@tcp:1:lfs.0 00010000:00010000:2.0:1786015500.027314:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cba8d8a/0xb1a5ef690c50252e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015500.027342:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c5024e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b3c expref: 17 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015500.027352:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015500.027357:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015500.027362:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cba8d8a/0xb1a5ef690c50252e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015500.027409:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c5024e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b3c expref: 17 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015500.027427:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c5024e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b3c expref: 17 pid: 6592 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015500.027457:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304436352:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015500.028023:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7483ea6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786015500.032320:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015500.032886:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304436352:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015500.032925:0:11384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cba8d8a/0xb1a5ef690c50252e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015500.033020:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280567680 00000100:00100000:1.0:1786015500.033029:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280567680 00010000:00010000:1.0:1786015500.033077:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c5024e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b3c expref: 18 pid: 6592 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015500.033229:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 370 00000100:00100000:1.0:1786015500.033241:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280567680:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015500.033261:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015500.033295:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c5024e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b3c expref: 18 pid: 6592 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.033310:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c5024e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b3c expref: 18 pid: 6592 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.033341:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c5024e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b3c expref: 18 pid: 6592 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.033362:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015500.033367:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015500.033374:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cba8d8a/0xb1a5ef690c50252e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.033385:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cba8d8a/0xb1a5ef690c50252e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.033418:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015500.033501:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280567680:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 262us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015500.033510:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 370 00010000:00010000:0.0:1786015500.035536:0:11384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cba8d8a/0xb1a5ef690c50252e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.035567:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cba8d8a/0xb1a5ef690c50252e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.035956:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cba8d8a/0xb1a5ef690c50252e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.035970:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cba8d8a/0xb1a5ef690c50252e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.035980:0:11384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cba8d8a/0xb1a5ef690c50252e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.035993:0:11384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386a200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015500.035998:0:11384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cba8d8a/0xb1a5ef690c50252e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.036009:0:11384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cba8d8a/0xb1a5ef690c50252e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.036036:0:11384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cba8d8a/0xb1a5ef690c50252e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.036044:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cba8d8a/0xb1a5ef690c50252e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015500.036201:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280567552:12345-192.168.202.56@tcp:1:lfs.0 Request processed in 8951us (9837us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015500.036214:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 337 00000100:00100000:2.0:1786015500.040862:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015500.040982:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280567936 00000100:00100000:0.0:1786015500.040996:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280567936 00000100:00100000:0.0:1786015500.041090:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 250 00000100:00100000:0.0:1786015500.041102:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916ac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+101:30102:x1872772280567936:12345-192.168.202.56@tcp:35:lfs.0 00000004:00010000:0.0:1786015500.041190:0:5797:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x23:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502520 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b51 expref: 101 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786015500.041525:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968119 00000001:00080000:0.0:1786015500.042245:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968120 00010000:00010000:0.0:1786015500.042320:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502535 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.042342:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502408 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8af6 expref: 104 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.042353:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502504 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b43 expref: 104 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.042362:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502535 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.042413:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502504 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b43 expref: 104 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.042445:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502504 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b43 expref: 104 pid: 12526 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015500.042463:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304436480:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015500.042599:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502408 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8af6 expref: 104 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.042610:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502408 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8af6 expref: 104 pid: 12526 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015500.042619:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304436608:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015500.042650:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb4900 going to sleep for 11 seconds 00000100:00100000:0.0:1786015500.047034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015500.047150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015500.047595:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280568192 00000100:00100000:1.0:1786015500.047609:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280568192 00010000:00010000:1.0:1786015500.047675:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502408 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8af6 expref: 105 pid: 12526 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015500.047735:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280568064 00000100:00100000:1.0:1786015500.047738:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280568064 00010000:00010000:1.0:1786015500.047752:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502504 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b43 expref: 106 pid: 12526 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015500.047814:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 371 00000100:00100000:1.0:1786015500.047826:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+106:2354:x1872772280568192:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015500.047848:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015500.047857:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502408 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8af6 expref: 106 pid: 12526 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.047869:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502408 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8af6 expref: 106 pid: 12526 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.047900:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7487f06f00) 00010000:00010000:1.0:1786015500.047906:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502535 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.047917:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502535 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.047924:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015500.047995:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+106:2354:x1872772280568192:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 172us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015500.048007:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 371 00000100:00100000:1.0:1786015500.048028:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 372 00000100:00100000:1.0:1786015500.048035:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+105:2354:x1872772280568064:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015500.048042:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015500.048048:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502504 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b43 expref: 105 pid: 12526 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.048059:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502504 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b43 expref: 105 pid: 12526 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.048071:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7487f06f00) 00010000:00010000:1.0:1786015500.048075:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502535 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.048085:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502535 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.048094:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502535 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.048117:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015500.048143:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+105:2354:x1872772280568064:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 107us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015500.048149:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 372 00010000:00010000:2.0:1786015500.050593:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c502504 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b43 expref: 104 pid: 12526 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015500.050639:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304436480:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015500.050658:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c502408 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8af6 expref: 103 pid: 12526 timeout: 835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015500.050667:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304436608:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015500.050717:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502535 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015500.050728:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502535 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015500.050734:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502535 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786015500.050951:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968121 00000001:00080000:2.0:1786015500.051898:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968122 00000001:00080000:2.0:1786015500.051984:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968123 00000100:00100000:2.0:1786015500.053183:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304436736:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1786015500.053305:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015500.053410:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7483ea6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786015500.053693:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304436736 00000100:00100000:3.0:1786015500.053705:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304436736 00000100:00100000:2.0:1786015500.053994:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1786015500.054008:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5797:x1872772304436736:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1786015500.054157:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5797:x1872772304436736:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 153us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015500.054166:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1786015500.054339:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304436736:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1786015500.054940:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968124 00000100:00100000:3.0:1786015500.055042:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304436864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1786015500.055112:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015500.055536:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74853d0000 going to sleep for 11 seconds 00000100:00100000:0.0:1786015500.055667:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304436864 00000100:00100000:0.0:1786015500.055677:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304436864 00000100:00100000:0.0:1786015500.055732:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1786015500.055744:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5797:x1872772304436864:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1786015500.056088:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5797:x1872772304436864:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 346us (975us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1786015500.056107:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1786015500.056283:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304436864:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:3.0:1786015500.056322:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502535 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015500.056335:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502535 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015500.056342:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502535 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015500.056349:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015500.056355:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502535 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015500.056370:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502535 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015500.056392:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7487f06f00) 00010000:00010000:3.0:1786015500.056395:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1786015500.056402:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502535 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015500.056409:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502535 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786015500.057361:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x4a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1786015500.057517:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].10, 64 off8856 00000004:00080000:2.0:1786015500.057605:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 735308842664ns, next at 736308838054ns, rc = 0 00000001:00080000:2.0:1786015500.057677:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968125 00010000:00010000:2.0:1786015500.057747:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7487f06f00) 00010000:00010000:2.0:1786015500.057752:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786015500.057942:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502520 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b51 expref: 107 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015500.058194:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916ac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+106:30102:x1872772280567936:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 17092us (17347us total) trans 4294968126 rc 0/0 00000100:00100000:2.0:1786015500.058206:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 250 00000020:00080000:2.0:1786015500.058213:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:0.0:1786015500.138934:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015500.139026:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280568448 00000100:00100000:1.0:1786015500.139041:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280568448 00000100:00100000:1.0:1786015500.139120:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1237 00000100:00100000:1.0:1786015500.139132:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+106:30108:x1872772280568448:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:1.0:1786015500.139168:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015500.139197:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50253c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b58 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.139306:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502543 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.139326:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502543 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.139340:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502543 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.139358:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c50254a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.139365:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c50254a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.139372:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c50254a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.139861:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502551 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.139871:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.139878:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015500.139890:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:1.0:1786015500.140016:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502543 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.140024:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502543 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.140030:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502543 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.140037:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015500.140042:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502543 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.140050:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502543 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.140064:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:1.0:1786015500.140067:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015500.140073:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502543 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.140080:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502543 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.140095:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c50254a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.140102:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c50254a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.140108:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c50254a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.140117:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015500.140120:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c50254a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.140126:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c50254a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.140133:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8b7483ee6500) 00010000:00010000:1.0:1786015500.140136:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015500.140138:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c50254a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.140144:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c50254a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.140202:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50253c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b58 expref: 109 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.140219:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502551 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b58 expref: 108 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.140227:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7483ee6900) 00010000:00010000:1.0:1786015500.140230:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015500.140232:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921400, rc 0) 00000100:00100000:1.0:1786015500.140332:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+108:30108:x1872772280568448:12345-192.168.202.56@tcp:101:cat.0 Request processed in 1201us (1412us total) trans 4294968127 rc 0/0 00000100:00100000:1.0:1786015500.140342:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1237 00010000:00010000:0.0:1786015500.140605:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015500.163592:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015500.164527:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280568704 00000100:00100000:1.0:1786015500.164546:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280568704 00000100:00100000:1.0:1786015500.164648:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:1.0:1786015500.164662:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+108:30108:x1872772280568704:12345-192.168.202.56@tcp:103:cat.0 00010000:00010000:1.0:1786015500.164689:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015500.164726:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502551 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b58 expref: 108 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.164750:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7483ee6900) 00010000:00010000:1.0:1786015500.164811:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015500.164889:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+107:30108:x1872772280568704:12345-192.168.202.56@tcp:103:cat.0 Request processed in 231us (5217us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015500.164898:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:3.0:1786015500.166913:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015500.167134:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280568832 00000100:00100000:1.0:1786015500.167147:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280568832 00000100:00100000:1.0:1786015500.167222:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1238 00000100:00100000:1.0:1786015500.167232:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+107:30108:x1872772280568832:12345-192.168.202.56@tcp:58:cat.0 00010000:00010000:1.0:1786015500.167375:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50255f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.167396:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50255f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015500.167418:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50255f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786015500.167852:0:12526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].36, 136 off13088 00000100:00100000:0.0:1786015500.167983:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+107:30108:x1872772280568832:12345-192.168.202.56@tcp:58:cat.0 Request processed in 749us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015500.167993:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1238 00000100:00100000:2.0:1786015500.170133:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015500.170243:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280568960 00000100:00100000:0.0:1786015500.170256:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280568960 00000100:00100000:0.0:1786015500.170332:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1239 00000100:00100000:0.0:1786015500.170343:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+107:30108:x1872772280568960:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1786015500.170373:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015500.170411:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502566 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b5f expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.170501:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50255f lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.170515:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502566 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b5f expref: 108 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.170547:0:5795:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50255f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.170563:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502566 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b5f expref: 108 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.170581:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7483ee6500) 00010000:00010000:0.0:1786015500.170584:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015500.170588:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502566 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b5f expref: 108 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015500.170596:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd600, rc 0) 00000100:00100000:0.0:1786015500.170676:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+108:30108:x1872772280568960:12345-192.168.202.56@tcp:101:cat.0 Request processed in 335us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015500.170684:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1239 00000100:00100000:2.0:1786015500.976959:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304437376:0@lo:400:kworker.0 00000100:00100000:2.0:1786015500.977081:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015500.977193:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786015500.977200:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304437248:0@lo:400:kworker.0 00000100:00100000:2.0:1786015500.977232:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015500.977302:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304437248 00000100:00100000:2.0:1786015500.977312:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304437248 00000100:00100000:2.0:1786015500.977387:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:2.0:1786015500.977397:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304437248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015500.977482:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304437248:12345-0@lo:400:kworker.0 Request processed in 85us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015500.977491:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00080000:2.0:1786015500.977518:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015500.977560:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304437248:0@lo:400:kworker.0 00000100:00100000:3.0:1786015500.977669:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304436992:0@lo:400:kworker.0 00000100:00100000:3.0:1786015500.977714:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015500.977758:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304437504:0@lo:400:kworker.0 00000100:00100000:3.0:1786015500.977810:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015500.977815:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304437376 00000100:00100000:0.0:1786015500.977819:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304437376 00000100:00100000:3.0:1786015500.977831:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786015500.977837:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304437120:0@lo:400:kworker.0 00000100:00100000:0.0:1786015500.977853:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:3.0:1786015500.977859:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015500.977861:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3313:x1872772304437376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015500.977889:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304437632:0@lo:400:kworker.0 00000100:00100000:0.0:1786015500.977905:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3313:x1872772304437376:12345-0@lo:400:kworker.0 Request processed in 46us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015500.977912:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015500.977912:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1786015500.977924:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304437632 00000100:00100000:0.0:1786015500.977928:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304437632 00000100:00100000:0.0:1786015500.977949:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1786015500.977954:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3314:x1872772304437632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015500.977983:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304436992 00000100:00100000:2.0:1786015500.977987:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304436992 00000100:00100000:0.0:1786015500.977993:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3314:x1872772304437632:12345-0@lo:400:kworker.0 Request processed in 40us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015500.978001:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:2.0:1786015500.978017:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1786015500.978023:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304436992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015500.978057:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304436992:12345-0@lo:400:kworker.0 Request processed in 34us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015500.978063:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000040:00080000:1.0:1786015500.980051:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015500.980067:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015500.980136:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 37 count 4 00000040:00080000:1.0:1786015500.980147:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015500.980317:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1220700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304437760:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015500.980449:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872780 going to sleep for 11 seconds 00000100:00100000:1.0:1786015500.980523:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304437504 00000100:00100000:1.0:1786015500.980532:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304437504 00000100:00100000:1.0:1786015500.980597:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304437120 00000100:00100000:1.0:1786015500.980602:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304437120 00000100:00100000:3.0:1786015500.980643:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304437632:0@lo:400:kworker.0 00000100:00100000:3.0:1786015500.980661:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304436992:0@lo:400:kworker.0 00000100:00100000:3.0:1786015500.981127:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:3.0:1786015500.981142:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304437504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015500.981245:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304437504:12345-0@lo:400:kworker.0 Request processed in 108us (3433us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015500.981253:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:3.0:1786015500.981294:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304437504:0@lo:400:kworker.0 00000100:00080000:3.0:1786015500.981345:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015500.981383:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304437376:0@lo:400:kworker.0 00000100:00100000:1.0:1786015500.984390:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1786015500.984407:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304437120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015500.986654:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1220700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304437760:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015500.989787:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304437120:12345-0@lo:400:kworker.0 Request processed in 5346us (11888us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015500.989808:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:3.0:1786015500.990846:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304437120:0@lo:400:kworker.0 00000100:00100000:2.0:1786015500.993998:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015500.998066:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280569088 00000100:00100000:0.0:1786015500.998703:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280569088 00000100:00100000:0.0:1786015500.998902:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1240 00000100:00100000:0.0:1786015500.998916:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+54:30109:x1872772280569088:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015500.998987:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x23:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015500.999174:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+54:30109:x1872772280569088:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 259us (5190us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015500.999183:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1240 00000100:00100000:3.0:1786015501.006040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015501.006153:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280569216 00000100:00100000:0.0:1786015501.006167:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280569216 00000100:00100000:0.0:1786015501.006256:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1241 00000100:00100000:0.0:1786015501.006266:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+54:30109:x1872772280569216:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1786015501.006355:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50256d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006373:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50256d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006386:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50256d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006400:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c502574 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006408:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c502574 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006415:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c502574 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006452:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50257b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006461:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50257b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006468:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50257b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015501.006515:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00000004:00200000:0.0:1786015501.006520:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015501.006538:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50257b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006551:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50256d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006557:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50256d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006565:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50256d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006571:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015501.006575:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50256d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006584:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50256d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006599:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:0.0:1786015501.006602:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015501.006608:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50256d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006626:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c50256d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006643:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c502574 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006650:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c502574 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006656:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c502574 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006662:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015501.006665:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c502574 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006671:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c502574 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006950:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x92f5931a (ffff8b748f24a100) 00010000:00010000:0.0:1786015501.006953:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015501.006956:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c502574 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006961:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c502574 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006979:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50257b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006983:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50257b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006987:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50257b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006990:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015501.006991:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50257b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006995:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50257b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.006999:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7483ee6500) 00010000:00010000:0.0:1786015501.007001:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015501.007003:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50257b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.007005:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50257b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015501.007084:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+54:30109:x1872772280569216:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 818us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015501.007090:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1241 00000100:00080000:3.0:1786015501.007301:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015501.018473:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015501.023810:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280569472 00000100:00100000:1.0:1786015501.024030:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280569472 00000100:00100000:2.0:1786015501.024201:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1242 00000100:00100000:2.0:1786015501.024214:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+54:30109:x1872772280569472:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015501.024245:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015501.024276:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502582 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b66 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.024453:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c502589 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.024475:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c502589 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.024491:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c502589 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015501.024508:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:2.0:1786015501.024954:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c502589 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.024965:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c502589 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.024972:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c502589 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.024980:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386a200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015501.024985:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c502589 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.024994:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c502589 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.025011:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7483ee6500) 00010000:00010000:2.0:1786015501.025014:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015501.025021:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c502589 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.025027:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c502589 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.025089:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502582 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b66 expref: 56 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.025103:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:2.0:1786015501.025106:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786015501.025110:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502582 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b66 expref: 56 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.025127:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386b000, rc 0) 00000100:00100000:2.0:1786015501.025235:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+55:30109:x1872772280569472:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1022us (6781us total) trans 4294968128 rc 301/301 00000100:00100000:2.0:1786015501.025244:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1242 00000100:00100000:0.0:1786015501.030484:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015501.030594:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280569600 00000100:00100000:3.0:1786015501.030617:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280569600 00000100:00100000:3.0:1786015501.031009:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1243 00000100:00100000:3.0:1786015501.031026:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+55:30109:x1872772280569600:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015501.031087:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x23:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015501.031236:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+55:30109:x1872772280569600:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 214us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015501.031245:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1243 00000100:00100000:3.0:1786015501.033896:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015501.034017:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280569856 00000100:00100000:2.0:1786015501.034033:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280569856 00000100:00100000:2.0:1786015501.034113:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1244 00000100:00100000:2.0:1786015501.034125:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+55:30109:x1872772280569856:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015501.034155:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015501.034189:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502597 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b6d expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.036939:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50259e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.036967:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50259e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.036981:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50259e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015501.036999:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x25:0x0]: returning size 0 00010000:00010000:2.0:1786015501.037099:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502597 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b6d expref: 58 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.037124:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50259e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b6d expref: 57 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.037141:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8b7487f06f00) 00010000:00010000:2.0:1786015501.037144:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015501.037150:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386a200, rc 0) 00000100:00100000:2.0:1786015501.037436:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+57:30109:x1872772280569856:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 3302us (3545us total) trans 4294968129 rc 0/0 00000100:00100000:2.0:1786015501.037448:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1244 00000100:00100000:1.0:1786015501.048968:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015501.049661:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280570112 00000100:00100000:0.0:1786015501.049677:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280570112 00000100:00100000:0.0:1786015501.049988:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1245 00000100:00100000:0.0:1786015501.050002:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+57:30109:x1872772280570112:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786015501.050089:0:12526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015501.050138:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50259e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b6d expref: 57 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.050162:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8b7487f06f00) 00010000:00010000:0.0:1786015501.050176:0:12526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015501.050205:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5025ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.050222:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502512 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b4a expref: 107 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.050230:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5025ac lrc: 4/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.050277:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502512 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b4a expref: 107 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.050293:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502512 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b4a expref: 107 pid: 5795 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015501.050310:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304437888:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015501.050439:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015501.055694:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304437888:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015501.055740:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5025ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015501.056123:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015501.057878:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280570240 00000100:00100000:2.0:1786015501.057897:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280570240 00010000:00010000:3.0:1786015501.061402:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502512 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b4a expref: 108 pid: 5795 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015501.061509:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 373 00000100:00100000:3.0:1786015501.061667:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+108:2354:x1872772280570240:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015501.061701:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015501.061714:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502512 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b4a expref: 108 pid: 5795 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.061732:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502512 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b4a expref: 108 pid: 5795 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.061779:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502512 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b4a expref: 108 pid: 5795 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.061801:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:3.0:1786015501.061807:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5025ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.061820:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5025ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.061829:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5025ac lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.061944:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015501.062054:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+107:2354:x1872772280570240:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 460us (5931us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015501.062062:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 373 00010000:00010000:2.0:1786015501.063470:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5025ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.063488:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5025ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.063601:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0xb77756dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.063676:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xb77756dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.063690:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xb77756dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.064232:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5025ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.064244:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5025ac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.064253:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5025ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.064261:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015501.064267:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5025ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.064275:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5025ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.064291:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:2.0:1786015501.064294:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015501.064299:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5025ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.064305:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5025ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.064319:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xb77756dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.064325:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xb77756dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.064330:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xb77756dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.064336:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386b400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015501.064339:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xb77756dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.064345:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xb77756dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.064355:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb77756dc (ffff8b7487f06b00) 00010000:00010000:2.0:1786015501.064358:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015501.064360:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0xb77756dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.064367:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0xb77756dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015501.064582:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+56:30109:x1872772280570112:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 14576us (15622us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786015501.064592:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1245 00000100:00100000:0.0:1786015501.070072:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015501.070237:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280570368 00000100:00100000:3.0:1786015501.070251:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280570368 00000100:00100000:3.0:1786015501.070327:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1246 00000100:00100000:3.0:1786015501.070339:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+56:30109:x1872772280570368:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015501.070372:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015501.070405:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5025ba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b74 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.070465:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5025c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.070484:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5025c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.070498:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5025c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.070937:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c5025ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b74 expref: 58 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.070960:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5025c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b74 expref: 57 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.070970:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:3.0:1786015501.070973:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786015501.070978:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbdc00, rc 0) 00000100:00100000:3.0:1786015501.071195:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+57:30109:x1872772280570368:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 857us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015501.071204:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1246 00000100:00100000:3.0:1786015501.075068:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015501.075442:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280570624 00000100:00100000:2.0:1786015501.075457:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280570624 00000100:00100000:2.0:1786015501.075539:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1247 00000100:00100000:2.0:1786015501.075550:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+57:30109:x1872772280570624:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786015501.075683:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5025c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.075706:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5025c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.075720:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5025c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015501.076014:0:7673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a2630af3 reply state 000000005f61e47b transno 4294968130 ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5025c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015501.076026:0:7673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786015501.080330:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+59:30109:x1872772280570624:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 4757us (5253us total) trans 4294968130 rc 0/0 00000100:00100000:2.0:1786015501.080353:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1247 00010000:00010000:2.0:1786015501.088746:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5025c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.088803:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5025c8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.088812:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5025c8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.088819:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386be00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015501.088825:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5025c8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.088835:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5025c8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.088861:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:2.0:1786015501.088865:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786015501.088871:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5025c8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.088878:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5025c8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015501.090656:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015501.090948:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280570752 00000100:00100000:2.0:1786015501.090961:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280570752 00000100:00100000:2.0:1786015501.091024:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1248 00000100:00100000:2.0:1786015501.091036:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+58:30109:x1872772280570752:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015501.091068:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015501.091097:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b7b expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.091182:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b7b expref: 59 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.091200:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b7b expref: 59 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.091213:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:2.0:1786015501.091217:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015501.091222:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386b400, rc 0) 00000100:00100000:2.0:1786015501.091303:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+59:30109:x1872772280570752:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 269us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015501.091311:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1248 00000100:00100000:1.0:1786015501.095571:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015501.095743:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280570880 00000100:00100000:0.0:1786015501.095758:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280570880 00000100:00100000:0.0:1786015501.095889:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 251 00000100:00100000:0.0:1786015501.095902:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+59:30109:x1872772280570880:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 00000100:00100000:0.0:1786015501.096105:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+59:30109:x1872772280570880:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 Request processed in 196us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015501.096114:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 251 00000100:00100000:1.0:1786015501.099526:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015501.100020:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280571136 00000100:00100000:0.0:1786015501.100036:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280571136 00000100:00100000:0.0:1786015501.100129:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 252 00000100:00100000:0.0:1786015501.100143:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+59:30109:x1872772280571136:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786015501.101362:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+60:30109:x1872772280571136:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1209us (1848us total) trans 4294968131 rc 0/0 00000100:00100000:0.0:1786015501.101380:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 252 00000100:00100000:3.0:1786015501.108839:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015501.109110:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280571392 00000100:00100000:0.0:1786015501.109125:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280571392 00000100:00100000:0.0:1786015501.109211:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1249 00000100:00100000:0.0:1786015501.109225:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+60:30109:x1872772280571392:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015501.109401:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+60:30109:x1872772280571392:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 178us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015501.109410:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1249 00000100:00100000:1.0:1786015501.113288:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015501.114301:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280571648 00000100:00100000:2.0:1786015501.114321:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280571648 00000100:00100000:2.0:1786015501.114401:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1250 00000100:00100000:2.0:1786015501.114413:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+60:30109:x1872772280571648:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015501.114452:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015501.114484:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5025d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b82 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.114886:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5025dd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.114906:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025cf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b7b expref: 61 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.114923:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5025dd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.114974:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b7b expref: 61 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.114991:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b7b expref: 61 pid: 12526 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015501.115007:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304438016:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015501.115226:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359000 going to sleep for 11 seconds 00000100:00100000:2.0:1786015501.119233:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304438016:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015501.119277:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5025dd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015501.121982:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015501.122291:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280571776 00000100:00100000:0.0:1786015501.122306:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280571776 00010000:00010000:0.0:1786015501.122365:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b7b expref: 62 pid: 12526 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015501.122408:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 374 00000100:00100000:0.0:1786015501.122419:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+62:2354:x1872772280571776:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015501.122451:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015501.122461:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b7b expref: 62 pid: 12526 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.122476:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b7b expref: 62 pid: 12526 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.122507:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5025cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b7b expref: 62 pid: 12526 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.122528:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:0.0:1786015501.122534:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5025dd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.122545:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5025dd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.122554:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5025dd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.122593:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015501.122681:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+61:2354:x1872772280571776:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 263us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015501.122689:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 374 00010000:00010000:2.0:1786015501.123484:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5025dd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.123501:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5025dd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015501.123546:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x25:0x0]: returning size 0 00000004:00080000:2.0:1786015501.124565:0:7673:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b:0x0], index 1: 0 00010000:00010000:2.0:1786015501.124873:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5025dd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.124884:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5025dd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.124896:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5025dd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.124903:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386ae00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015501.124908:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5025dd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.124916:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5025dd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.124936:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:2.0:1786015501.124940:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015501.124945:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5025dd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.124952:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5025dd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.125035:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5025d6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b82 expref: 61 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.125047:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8b749232d400) 00010000:00010000:2.0:1786015501.125050:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786015501.125054:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5025d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b82 expref: 61 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.125065:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386be00, rc 0) 00000100:00100000:2.0:1786015501.125983:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+60:30109:x1872772280571648:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 11565us (12703us total) trans 4294968132 rc 301/301 00000100:00100000:2.0:1786015501.126001:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1250 00000100:00100000:1.0:1786015501.133073:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015501.133193:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280572032 00000100:00100000:2.0:1786015501.133207:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280572032 00000100:00100000:2.0:1786015501.133307:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 253 00000100:00100000:2.0:1786015501.133321:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+60:30109:x1872772280572032:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015501.133847:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+61:30109:x1872772280572032:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 527us (783us total) trans 4294968133 rc 0/0 00000100:00100000:2.0:1786015501.133857:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 253 00000100:00100000:1.0:1786015501.135689:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015501.135808:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280572160 00000100:00100000:0.0:1786015501.135819:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280572160 00000100:00100000:0.0:1786015501.135893:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1251 00000100:00100000:0.0:1786015501.135902:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+61:30109:x1872772280572160:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015501.135929:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015501.135954:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5025eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b89 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.136035:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5025f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.136048:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5025f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.136058:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5025f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015501.136104:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x25:0x0]: returning size 0 00000004:00200000:0.0:1786015501.136109:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015501.136135:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5025f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.136164:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5025eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b89 expref: 63 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.136186:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5025f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b89 expref: 62 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.136196:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:0.0:1786015501.136200:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786015501.136205:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd000, rc 0) 00000100:00100000:0.0:1786015501.136267:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+62:30109:x1872772280572160:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 366us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015501.136273:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1251 00000100:00100000:3.0:1786015501.138864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015501.139009:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280572288 00000100:00100000:0.0:1786015501.139020:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280572288 00000100:00100000:0.0:1786015501.139085:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 338 00000100:00080000:3.0:1786015501.139158:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015501.139183:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280572288:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015501.139205:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015501.139232:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5025f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b90 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015501.139267:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786015501.139292:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=736s v=(0 0) 00010000:00010000:0.0:1786015501.139296:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015501.139307:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5025f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b90 expref: 11 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.139325:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5025f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b90 expref: 11 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.139342:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd800, rc 0) 00000100:00100000:0.0:1786015501.139431:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280572288:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 328us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015501.139440:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 338 00000100:00100000:1.0:1786015501.143158:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015501.144749:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280572544 00000100:00100000:3.0:1786015501.144786:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280572544 00000100:00100000:3.0:1786015501.144954:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1252 00000100:00100000:3.0:1786015501.144968:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+62:30109:x1872772280572544:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786015501.145172:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+62:30109:x1872772280572544:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 206us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015501.145181:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1252 00000100:00100000:2.0:1786015501.154453:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015501.154568:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280572672 00000100:00100000:0.0:1786015501.154587:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280572672 00000100:00100000:0.0:1786015501.154666:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 339 00000100:00100000:0.0:1786015501.154679:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:30109:x1872772280572672:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015501.154709:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015501.154740:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c502600 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b97 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.154829:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5025f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b90 expref: 12 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.154841:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015501.154847:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015501.154853:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c502600 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b97 expref: 12 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.154907:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5025f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b90 expref: 12 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.154927:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5025f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b90 expref: 12 pid: 11384 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015501.154948:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304438144:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015501.155064:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015501.161911:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304438144:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015501.161973:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c502600 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b97 expref: 12 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.162012:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afda00, rc 0) 00000100:00100000:0.0:1786015501.162122:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:30109:x1872772280572672:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 7442us (7694us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015501.162134:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 339 00000100:00100000:1.0:1786015501.162554:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015501.163878:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280572800 00000100:00100000:0.0:1786015501.163898:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280572800 00010000:00010000:0.0:1786015501.163960:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5025f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b90 expref: 12 pid: 11384 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015501.164004:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 375 00000100:00100000:0.0:1786015501.164015:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0069450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280572800:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015501.164035:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015501.164072:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5025f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b90 expref: 12 pid: 11384 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.164090:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5025f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b90 expref: 12 pid: 11384 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.164130:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5025f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b90 expref: 12 pid: 11384 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.164158:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015501.164163:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015501.164175:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c502600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b97 expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.164188:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c502600 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b97 expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.164240:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c502600 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b97 expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015501.164258:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5782:1872772304438272:192.168.202.56@tcp:105: 00010000:00010000:2.0:1786015501.167322:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015501.168185:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015501.175841:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5782:1872772304438272:192.168.202.56@tcp:105: 00010000:00010000:0.0:1786015501.175880:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015501.175950:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0069450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280572800:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 11936us (13396us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015501.175963:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 375 00000100:00100000:1.0:1786015501.177248:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015501.177480:0:17969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280572928 00000100:00100000:0.0:1786015501.177491:0:17969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280572928 00002000:00100000:0.0:1786015501.177548:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1b:0x0] (0->157) req@ffff8b7384fdce00 x1872772280572928/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:347/0 lens 648/0 e 0 to 0 dl 1786015512 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015501.177561:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384fdce00 with x1872772280572928 ext(0->157) 00002000:00010000:0.0:1786015501.177568:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384fdce00 00000100:00100000:0.0:1786015501.177606:0:17969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 109 00000100:00100000:0.0:1786015501.177617:0:17969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280572928:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1786015501.178235:0:17969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280572928:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 616us (992us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1786015501.178247:0:17969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 109 00002000:00100000:0.0:1786015501.178255:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1b:0x0] (0->157) req@ffff8b7384fdce00 x1872772280572928/t4294967373(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:347/0 lens 648/448 e 0 to 0 dl 1786015512 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015501.178263:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384fdce00 with x1872772280572928 ext(0->157) 00002000:00010000:0.0:1786015501.178268:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384fdce00 00000100:00100000:2.0:1786015501.181324:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015501.181440:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280573056 00000100:00100000:3.0:1786015501.181453:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280573056 00000100:00100000:3.0:1786015501.181532:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1253 00000100:00100000:3.0:1786015501.181543:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+62:30109:x1872772280573056:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1786015501.249866:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968131 is committed 00000001:00080000:2.0:1786015501.249892:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968121 is committed 00000001:00080000:2.0:1786015501.249920:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968127 is committed 00000001:00080000:2.0:1786015501.249928:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968133 is committed 00000004:00080000:2.0:1786015501.249962:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000100:00100000:3.0:1786015501.250154:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+54:30109:x1872772280573056:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 68602us (68836us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015501.250171:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1253 00000100:00100000:3.0:1786015501.251518:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304438400:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786015501.251619:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015501.251953:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304438400 00000100:00100000:1.0:1786015501.251967:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304438400 00000100:00100000:1.0:1786015501.252051:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1786015501.252063:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304438400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786015501.252107:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:24 count 1 00002000:00010000:1.0:1786015501.252162:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 158, mtime: 0x6a746f07, atime: 0x6a746f0b, ctime: 0x6a746f07, blocks: 0xb 00010000:00010000:1.0:1786015501.252179:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502607 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.252200:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1786015501.252206:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015501.252214:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502607 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.252230:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502607 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.252241:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502607 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.252249:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502607 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.252268:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1786015501.253460:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786015501.253482:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786015501.253493:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502607 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.253507:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920000 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015501.253513:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502607 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.253528:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502607 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.253554:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502607 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.253561:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502607 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.253590:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015501.253592:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015501.253594:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015501.255535:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3312:x1872772304438400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3462us (3915us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1786015501.255552:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000004:00080000:0.0:1786015501.257912:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b7384fdd880/2, rc 0, transno 4294967364 00000100:00100000:0.0:1786015501.257936:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304438400:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1786015501.258170:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b74853d00c0 refcount 2 committed 0 result 0 batchid 27 00000020:00080000:2.0:1786015501.258177:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74b0987b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b74853d0480 00000020:00080000:2.0:1786015501.258181:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74b0987d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74aec06400 00000020:00080000:2.0:1786015501.258212:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b74b89d2300 refcount 2 committed 0 result 0 batchid 26 00000020:00080000:2.0:1786015501.258216:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74b0987400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b74b89d2480 00000020:00080000:2.0:1786015501.258219:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74b0987300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74aec24400 00000020:00080000:2.0:1786015501.258243:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 25 batchid updated 00000020:00080000:2.0:1786015501.259123:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 27 committed batchid 25 00000020:00080000:2.0:1786015501.259466:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25 00000100:00100000:3.0:1786015501.259795:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015501.260014:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280573184 00000100:00100000:0.0:1786015501.260028:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280573184 00000100:00100000:0.0:1786015501.260110:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 341 00000100:00100000:0.0:1786015501.260123:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280573184:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1786015501.315594:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967373 is committed 00000001:00080000:2.0:1786015501.315700:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967371 is committed 00000001:00080000:2.0:1786015501.315711:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967372 is committed 00000100:00100000:0.0:1786015501.315928:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280573184:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 55799us (56130us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015501.315943:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 341 00000100:00100000:0.0:1786015501.326335:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015501.326624:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280573440 00000100:00100000:3.0:1786015501.326641:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280573440 00000100:00100000:3.0:1786015501.326731:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1254 00000100:00100000:3.0:1786015501.326743:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+47:30109:x1872772280573440:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786015501.326864:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015501.326903:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5025f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b89 expref: 47 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.326932:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:3.0:1786015501.326944:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015501.326994:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c50260e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.327016:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c50260e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.327028:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c50260e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015501.327587:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a050f2ae reply state 00000000e3caa2a6 transno 4294968134 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c50260e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015501.327614:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786015501.327803:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+48:30109:x1872772280573440:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 1059us (1484us total) trans 4294968134 rc 0/0 00000100:00100000:2.0:1786015501.327813:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1254 00010000:00010000:1.0:1786015501.333035:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c50260e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.333063:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c50260e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.333074:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c50260e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.333082:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015501.333088:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c50260e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.333109:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c50260e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.333140:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:1.0:1786015501.333144:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015501.333150:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c50260e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.333156:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c50260e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015501.333625:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015501.333987:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280573568 00000100:00100000:3.0:1786015501.334002:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280573568 00000100:00100000:3.0:1786015501.334073:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1255 00000100:00100000:3.0:1786015501.334084:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:30109:x1872772280573568:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015501.334132:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015501.334161:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502615 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8b9e expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.334239:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502615 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b9e expref: 48 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.334257:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502615 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b9e expref: 48 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.334281:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:3.0:1786015501.334285:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015501.334288:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc200, rc 0) 00000100:00100000:3.0:1786015501.334375:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:30109:x1872772280573568:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 291us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015501.334384:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1255 00000100:00100000:2.0:1786015501.337390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015501.337528:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280573696 00000100:00100000:0.0:1786015501.337545:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280573696 00000100:00100000:0.0:1786015501.337634:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 342 00000100:00100000:0.0:1786015501.337647:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280573696:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1786015501.338069:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1786015501.338074:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb mtime from disk: 0 -> 1786015495 00002000:00010000:0.0:1786015501.338076:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb atime from disk: 0 -> 1786015500 00002000:00010000:0.0:1786015501.338078:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb ctime from disk: 0 -> 1786015495 00002000:00010000:0.0:1786015501.338081:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1786015501.338162:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2352:x1872772280573696:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 516us (788us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1786015501.338171:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 342 00000100:00100000:1.0:1786015501.345219:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015501.345531:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280573952 00000100:00100000:3.0:1786015501.345546:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280573952 00000100:00100000:3.0:1786015501.345636:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1256 00000100:00100000:3.0:1786015501.345648:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+48:30109:x1872772280573952:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1786015501.345745:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50261c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.345892:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5025c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b74 expref: 48 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.345905:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50261c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.345959:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5025c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b74 expref: 48 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.345978:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5025c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b74 expref: 48 pid: 5796 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015501.345998:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304438528:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015501.346254:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74853d0240 going to sleep for 11 seconds 00000100:00100000:3.0:1786015501.351085:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304438528:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015501.351147:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50261c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015501.353025:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015501.353272:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280574080 00000100:00100000:0.0:1786015501.353286:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280574080 00010000:00010000:0.0:1786015501.353345:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5025c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b74 expref: 49 pid: 5796 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015501.353406:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 376 00000100:00100000:0.0:1786015501.353418:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+49:2354:x1872772280574080:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015501.353450:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015501.353459:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5025c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b74 expref: 49 pid: 5796 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.353477:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5025c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b74 expref: 49 pid: 5796 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.353506:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5025c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b74 expref: 49 pid: 5796 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.353540:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:0.0:1786015501.353546:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50261c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.353557:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50261c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.353571:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50261c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.353612:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015501.353684:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+48:2354:x1872772280574080:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 268us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015501.353693:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 376 00010000:00010000:3.0:1786015501.355891:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50261c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.355914:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50261c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.355966:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50261c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.355974:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50261c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.355981:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50261c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.355988:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015501.355992:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50261c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.356000:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50261c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.356020:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:3.0:1786015501.356023:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1786015501.356028:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50261c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.356035:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c50261c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015501.356177:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+47:30109:x1872772280573952:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 10525us (10969us total) trans 0 rc -22/-22 00000100:00100000:3.0:1786015501.356190:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1256 00000100:00100000:1.0:1786015501.361752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015501.362091:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280574208 00000100:00100000:2.0:1786015501.362116:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280574208 00000100:00100000:2.0:1786015501.362194:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 343 00000100:00100000:2.0:1786015501.362205:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280574208:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786015501.362269:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c502623 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.362299:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c502600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b97 expref: 12 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.362310:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015501.362315:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786015501.362320:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c502623 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.362370:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c502600 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b97 expref: 12 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.362389:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c502600 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b97 expref: 12 pid: 6592 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015501.362410:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304438656:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015501.362529:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359180 going to sleep for 11 seconds 00000100:00100000:2.0:1786015501.367564:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304438656:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015501.367615:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c502623 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015501.367855:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015501.368198:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280574336 00000100:00100000:2.0:1786015501.368207:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280574336 00010000:00010000:2.0:1786015501.368252:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c502600 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b97 expref: 13 pid: 6592 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015501.368338:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 377 00000100:00100000:2.0:1786015501.368350:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280574336:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015501.368370:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015501.368413:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c502600 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b97 expref: 13 pid: 6592 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.368434:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c502600 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b97 expref: 13 pid: 6592 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.368469:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dca504a0/0xb1a5ef690c502600 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b97 expref: 13 pid: 6592 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.368491:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786015501.368495:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786015501.368501:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c502623 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.368512:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c502623 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.368612:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015501.368788:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c502623 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.368799:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c502623 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.368841:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c502623 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.368851:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c502623 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.368859:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c502623 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.368868:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386be00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015501.368874:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c502623 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.368883:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c502623 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.368897:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c502623 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.368905:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c502623 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015501.369020:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280574336:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 671us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015501.369029:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 377 00000100:00100000:1.0:1786015501.369953:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280574208:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 7743us (8210us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015501.369968:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 343 00000100:00100000:1.0:1786015501.379563:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015501.379733:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280574592 00000100:00100000:2.0:1786015501.379749:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280574592 00000100:00100000:2.0:1786015501.380185:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1257 00000100:00100000:2.0:1786015501.380198:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+47:30109:x1872772280574592:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1786015501.380312:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50262a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.380336:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50262a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.380351:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50262a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.380666:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502631 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.380696:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502615 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b9e expref: 48 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.380706:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502631 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.380792:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502615 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b9e expref: 48 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.380809:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502615 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b9e expref: 48 pid: 5795 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015501.381034:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304438784:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015501.381204:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359180 going to sleep for 11 seconds 00000100:00100000:1.0:1786015501.388166:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015501.388273:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280574720 00000100:00100000:0.0:1786015501.388285:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280574720 00010000:00010000:0.0:1786015501.388341:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502615 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b9e expref: 49 pid: 5795 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015501.388406:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 378 00000100:00100000:0.0:1786015501.388416:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+49:2353:x1872772280574720:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015501.388443:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015501.388451:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502615 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b9e expref: 49 pid: 5795 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.388467:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502615 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b9e expref: 49 pid: 5795 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.388499:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:0.0:1786015501.388505:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502631 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.388517:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502631 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.388530:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502631 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015501.388554:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015501.388640:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+49:2353:x1872772280574720:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 225us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015501.388648:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 378 00010000:00010000:2.0:1786015501.397082:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502615 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b9e expref: 48 pid: 5795 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015501.397132:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304438784:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015501.397170:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502631 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.397184:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502631 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.397190:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502631 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786015501.397540:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968135 00000001:00080000:2.0:1786015501.398525:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968136 00000001:00080000:2.0:1786015501.398586:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968137 00000100:00100000:2.0:1786015501.398804:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304438912:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786015501.398978:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015501.399945:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359240 going to sleep for 11 seconds 00000100:00100000:0.0:1786015501.400173:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304438912 00000100:00100000:0.0:1786015501.400186:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304438912 00000100:00100000:0.0:1786015501.400293:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1786015501.400305:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5796:x1872772304438912:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1786015501.400452:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5796:x1872772304438912:12345-0@lo:1000:mdt00_002.0 Request processed in 148us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015501.400461:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1786015501.401450:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015501.401515:0:5796:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967372 gen 2 00000004:00080000:2.0:1786015501.401526:0:5796:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967371 committed transno 4294967372 00000004:00080000:2.0:1786015501.401560:0:5796:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b74c103c380, transno 4294967372 00000100:00100000:2.0:1786015501.401577:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304438912:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1786015501.402523:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968138 00000100:00100000:2.0:1786015501.402708:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304439040:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786015501.406638:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015501.406705:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359180 going to sleep for 11 seconds 00000100:00100000:0.0:1786015501.406977:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304439040 00000100:00100000:0.0:1786015501.406990:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304439040 00000100:00100000:0.0:1786015501.407061:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1786015501.407072:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5796:x1872772304439040:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1786015501.407474:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5796:x1872772304439040:12345-0@lo:1000:mdt00_002.0 Request processed in 403us (880us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1786015501.407483:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1786015501.407667:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304439040:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1786015501.408006:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968139 00010000:00010000:2.0:1786015501.408065:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502631 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.408077:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502631 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.408085:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502631 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.408092:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386b000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015501.408099:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502631 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.408109:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502631 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.408134:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8b7499c59e00) 00010000:00010000:2.0:1786015501.408137:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015501.408144:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502631 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.408151:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502631 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.408195:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50255f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.408202:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50255f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.408207:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50255f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.408212:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015501.408215:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50255f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.408221:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50255f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.408228:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7483ee6500) 00010000:00010000:2.0:1786015501.408230:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015501.408239:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502566 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b5f expref: 95 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.408252:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502566 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b5f expref: 95 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.408263:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502566 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b5f expref: 95 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.408309:0:5796:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd600/0xb1a5ef690c502566 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8b5f expref: 95 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015501.408329:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8978000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304439168:192.168.202.56@tcp:105: 00000100:00100000:2.0:1786015501.408441:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359180 going to sleep for 11 seconds 00000100:00100000:2.0:1786015501.411265:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8978000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304439168:192.168.202.56@tcp:105: 00010000:00010000:2.0:1786015501.411298:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50255f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.411308:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50255f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.411343:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502638 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.411356:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502638 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.411366:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502638 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.411375:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502638 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.411379:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502638 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.411385:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502638 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.411392:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386b200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015501.411397:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502638 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.411405:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502638 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.411418:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7483ee6500) 00010000:00010000:2.0:1786015501.411431:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015501.411435:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502638 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.411442:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502638 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.411453:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50262a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.411459:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50262a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.411463:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50262a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.411467:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386a200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015501.411468:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50262a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.411475:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50262a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.411480:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8b7483ee6500) 00010000:00010000:2.0:1786015501.411482:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015501.411483:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50262a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.411487:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a200/0xb1a5ef690c50262a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015501.411849:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+52:30109:x1872772280574592:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 31653us (32300us total) trans 4294968140 rc 0/0 00000100:00100000:2.0:1786015501.411859:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1257 00000020:00080000:2.0:1786015501.411865:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:3.0:1786015501.415588:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015501.415674:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015501.416395:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1786015501.416412:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015501.427109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015501.427223:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280574848 00000100:00100000:2.0:1786015501.427237:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280574848 00000100:00100000:2.0:1786015501.427329:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 254 00000100:00100000:2.0:1786015501.427341:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+96:30108:x1872772280574848:12345-192.168.202.56@tcp:49:cat.0 00000100:00100000:2.0:1786015501.427562:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+96:30108:x1872772280574848:12345-192.168.202.56@tcp:49:cat.0 Request processed in 221us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015501.427571:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 254 00000100:00100000:0.0:1786015501.431817:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015501.432018:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280575104 00000100:00100000:2.0:1786015501.432033:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280575104 00000100:00100000:2.0:1786015501.432129:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 255 00000100:00100000:2.0:1786015501.432142:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916ae050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+52:30109:x1872772280575104:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1786015501.434694:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x25:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:0.0:1786015501.435081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015501.435207:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280575232 00000100:00100000:2.0:1786015501.435220:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280575232 00000100:00100000:2.0:1786015501.435313:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 344 00000100:00100000:2.0:1786015501.435325:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+12:30108:x1872772280575232:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1786015501.435349:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015501.435381:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cba8d8a/0xb1a5ef690c50263f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ba5 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015501.435416:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 158, mtime: 0x6a746f07, atime: 0x6a746f0c, ctime: 0x6a746f07, blocks: 0xb 00010000:00010000:2.0:1786015501.435458:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=736s v=(0 0) 00010000:00010000:2.0:1786015501.435465:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015501.435478:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cba8d8a/0xb1a5ef690c50263f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ba5 expref: 13 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.435498:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000cba8d8a/0xb1a5ef690c50263f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ba5 expref: 13 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015501.435514:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386a200, rc 0) 00000100:00100000:2.0:1786015501.435588:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+13:30108:x1872772280575232:12345-192.168.202.56@tcp:101:cat.0 Request processed in 266us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015501.435596:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 344 00000100:00080000:3.0:1786015501.435834:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1786015501.437569:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968141 00010000:00010000:1.0:1786015501.437688:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502646 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.437713:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502646 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.437729:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502646 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.437739:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502646 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.437747:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502646 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.437755:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502646 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015501.437806:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786015501.438220:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786015501.438230:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502646 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.438239:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920400 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015501.438244:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502646 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.438254:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502646 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.438272:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8b74938ba400) 00010000:00010000:3.0:1786015501.438275:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786015501.438281:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502646 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.438287:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502646 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015501.438314:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015501.438316:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015501.438318:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015501.439104:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916ae050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+54:30109:x1872772280575104:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 6945us (7333us total) trans 4294968142 rc 0/0 00000100:00100000:1.0:1786015501.439120:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 255 00000020:00080000:1.0:1786015501.439128:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786015501.445282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015501.445383:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280575360 00000100:00100000:3.0:1786015501.445404:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280575360 00002000:00100000:3.0:1786015501.445486:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1b:0x0] (0->4095) req@ffff8b74c103ca80 x1872772280575360/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:347/0 lens 488/0 e 0 to 0 dl 1786015512 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015501.445500:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c103ca80 with x1872772280575360 ext(0->4095) 00002000:00010000:3.0:1786015501.445507:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74c103ca80 00000100:00100000:3.0:1786015501.445555:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 110 00000100:00100000:3.0:1786015501.445565:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41677fca-39fb-471c-b582-96bce6540a36+13:2354:x1872772280575360:12345-192.168.202.56@tcp:3:cat.0 00000100:00100000:3.0:1786015501.445955:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41677fca-39fb-471c-b582-96bce6540a36+13:2354:x1872772280575360:12345-192.168.202.56@tcp:3:cat.0 Request processed in 390us (683us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786015501.445965:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 110 00002000:00100000:3.0:1786015501.445972:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1b:0x0] (0->4095) req@ffff8b74c103ca80 x1872772280575360/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:347/0 lens 488/4536 e 0 to 0 dl 1786015512 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015501.445980:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c103ca80 with x1872772280575360 ext(0->4095) 00002000:00010000:3.0:1786015501.445984:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74c103ca80 00000100:00100000:0.0:1786015501.470954:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015501.472270:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280575616 00000100:00100000:1.0:1786015501.472284:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280575616 00000100:00100000:1.0:1786015501.472373:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 256 00000100:00100000:1.0:1786015501.472384:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+96:30108:x1872772280575616:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:1.0:1786015501.474002:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+97:30108:x1872772280575616:12345-192.168.202.56@tcp:35:cat.0 Request processed in 1612us (3050us total) trans 4294968143 rc 0/0 00000100:00100000:1.0:1786015501.474014:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 256 00000100:00100000:3.0:1786015501.484382:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786015501.484414:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304439296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015501.484519:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015501.484618:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304439296 00000100:00100000:2.0:1786015501.484629:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304439296 00000100:00100000:2.0:1786015501.484695:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1786015501.484727:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304439296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015501.484795:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 0 free 3857711104 avail 3854565376 00000100:00100000:2.0:1786015501.484847:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304439296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015501.484855:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1786015501.484955:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304439296:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786015502.188103:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015503.213635:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015504.236910:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015504.462564:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015504.462668:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015504.462705:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015504.462743:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015504.462816:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015504.462838:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015504.462861:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015504.462886:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280576256 00000100:00100000:0.0:1786015504.462896:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280576256 00000100:00100000:0.0:1786015504.462955:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280575872 00000100:00100000:0.0:1786015504.462958:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280575872 00000100:00100000:0.0:1786015504.462980:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 499 00000100:00100000:0.0:1786015504.462990:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+54:2353:x1872772280576256:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015504.463101:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+54:2353:x1872772280576256:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 110us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015504.463111:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 499 00000100:00100000:0.0:1786015504.463133:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 500 00000100:00100000:0.0:1786015504.463139:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+97:2353:x1872772280575872:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015504.463170:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+97:2353:x1872772280575872:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015504.463176:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 500 00000100:00100000:2.0:1786015504.464843:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280576000 00000100:00100000:2.0:1786015504.464863:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280576000 00000100:00100000:2.0:1786015504.464936:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280576512 00000100:00100000:2.0:1786015504.464940:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280576512 00000100:00100000:2.0:1786015504.464956:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280576128 00000100:00100000:2.0:1786015504.464959:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280576128 00000100:00100000:2.0:1786015504.464975:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280576384 00000100:00100000:2.0:1786015504.464978:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280576384 00000100:00100000:2.0:1786015504.465002:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 492 00000100:00100000:2.0:1786015504.465011:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280576000:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015504.465083:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280576000:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 72us (2414us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015504.465090:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 492 00000100:00100000:2.0:1786015504.465108:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 493 00000100:00100000:2.0:1786015504.465115:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280576512:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015504.465143:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280576512:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (2399us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015504.465149:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 493 00000100:00100000:2.0:1786015504.465160:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 494 00000100:00100000:2.0:1786015504.465165:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+13:2353:x1872772280576128:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015504.465188:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+13:2353:x1872772280576128:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (2349us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015504.465194:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 494 00000100:00100000:2.0:1786015504.465205:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 495 00000100:00100000:2.0:1786015504.465212:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280576384:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015504.465233:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280576384:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (2371us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015504.465239:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 495 00000100:00080000:1.0:1786015504.466336:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015504.466343:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015504.466346:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015504.466997:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280575744 00000100:00100000:3.0:1786015504.467008:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280575744 00000100:00100000:3.0:1786015504.467111:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 603 00000100:00100000:3.0:1786015504.467120:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280575744:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015504.467184:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280575744:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 65us (4629us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015504.467191:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 603 00000100:00100000:3.0:1786015504.562588:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786015504.562611:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304439424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015504.562686:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015504.562786:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304439424 00000100:00100000:3.0:1786015504.562794:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304439424 00000100:00100000:3.0:1786015504.562874:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1786015504.562884:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3315:x1872772304439424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015504.562923:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86704128 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015504.562968:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3315:x1872772304439424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015504.562976:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00080000:3.0:1786015504.563000:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015504.563038:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304439424:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1786015505.143643:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967363 is committed 00000001:00080000:2.0:1786015505.143660:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967364 is committed 00000001:00080000:2.0:1786015505.143667:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967361 is committed 00010000:00010000:3.0:1786015505.273745:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015506.092181:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304439680:0@lo:400:kworker.0 00000100:00100000:2.0:1786015506.092260:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015506.092470:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304439552:0@lo:400:kworker.0 00000100:00100000:0.0:1786015506.092524:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015506.092572:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304439808:0@lo:400:kworker.0 00000100:00100000:0.0:1786015506.092599:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015506.092629:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304439680 00000100:00100000:0.0:1786015506.092638:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304439680 00000100:00100000:0.0:1786015506.092692:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304439808 00000100:00100000:0.0:1786015506.092695:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304439808 00000100:00100000:0.0:1786015506.092727:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1786015506.092735:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304439680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015506.092858:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1786015506.092867:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304439808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015506.092916:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304439808:12345-0@lo:400:kworker.0 Request processed in 50us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015506.092923:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1786015506.092966:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304439808:0@lo:400:kworker.0 00000100:00080000:1.0:1786015506.093000:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015506.097946:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304439936:0@lo:400:kworker.0 00000100:00100000:1.0:1786015506.098022:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015506.098067:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015506.098073:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304440064:0@lo:400:kworker.0 00000100:00100000:1.0:1786015506.098100:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015506.098145:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304440064 00000100:00100000:1.0:1786015506.098227:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304440064 00000100:00100000:1.0:1786015506.098289:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:1.0:1786015506.098298:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304440064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015506.098352:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304440064:12345-0@lo:400:kworker.0 Request processed in 55us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015506.098361:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00080000:1.0:1786015506.098393:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015506.098480:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786015506.098489:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304440192:0@lo:400:kworker.0 00000100:00100000:1.0:1786015506.099298:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015506.099341:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304439936 00000100:00100000:1.0:1786015506.099347:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304439936 00000100:00100000:1.0:1786015506.099398:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304440192 00000100:00100000:1.0:1786015506.099401:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304440192 00000100:00100000:1.0:1786015506.099603:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1786015506.099612:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304439936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015506.099660:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304439936:12345-0@lo:400:kworker.0 Request processed in 51us (1639us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015506.099741:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1786015506.099758:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1786015506.103035:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304440192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015506.103268:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304439680:12345-0@lo:400:kworker.0 Request processed in 10531us (11005us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015506.103279:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00080000:0.0:1786015506.103352:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015506.103358:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015506.103419:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304440064:0@lo:400:kworker.0 00000100:00100000:0.0:1786015506.103433:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967364 gen 2 00000004:00080000:0.0:1786015506.103438:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967362 committed transno 4294967364 00000004:00080000:0.0:1786015506.103461:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967363 committed transno 4294967364 00000004:00080000:0.0:1786015506.103469:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b7384fdd880, transno 4294967364 00000100:00100000:0.0:1786015506.103483:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304439936:0@lo:400:kworker.0 00000100:00100000:0.0:1786015506.104064:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304440192:0@lo:400:kworker.0 00000100:00100000:0.0:1786015506.104101:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304439552 00000100:00100000:0.0:1786015506.104108:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304439552 00000100:00100000:0.0:1786015506.104167:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:0.0:1786015506.104175:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304439552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015506.104230:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304439552:12345-0@lo:400:kworker.0 Request processed in 57us (11705us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015506.104237:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:0.0:1786015506.104285:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304439552:0@lo:400:kworker.0 00000100:00100000:1.0:1786015506.105918:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304440192:12345-0@lo:400:kworker.0 Request processed in 140us (3853us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015506.105931:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:2.0:1786015506.110505:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304439680:0@lo:400:kworker.0 00010000:00010000:0.0:1786015506.285203:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015506.542590:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015506.542600:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015506.542648:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 37 count 4 00000040:00080000:3.0:1786015506.542659:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015506.604313:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304440320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015506.604426:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015506.604567:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304440320 00000100:00100000:1.0:1786015506.604578:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304440320 00000100:00100000:1.0:1786015506.604652:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1786015506.604664:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304440320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015506.604713:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015506.604820:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304440320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015506.604830:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1786015506.604895:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304440320:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1786015506.679938:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968143 is committed 00000001:00080000:2.0:1786015506.679958:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968142 is committed 00000020:00080000:2.0:1786015506.679981:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b74b8e29300 refcount 2 committed 0 result 0 batchid 28 00000020:00080000:2.0:1786015506.679988:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74c0cc3800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b74b8e29b40 00000020:00080000:2.0:1786015506.679992:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74c0cc3400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74af0b2400 00000020:00080000:2.0:1786015506.680030:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 27 batchid updated 00000020:00080000:1.0:1786015506.680109:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 28 committed batchid 27 00000020:00080000:1.0:1786015506.680362:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 27 00000001:00080000:2.0:1786015506.685670:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967375 is committed 00000001:00080000:2.0:1786015506.685693:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967374 is committed 00000100:00100000:3.0:1786015506.956148:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015506.958332:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280576640 00000100:00100000:0.0:1786015506.958357:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280576640 00000100:00100000:0.0:1786015506.958491:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1258 00000100:00100000:0.0:1786015506.958503:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+45:30060:x1872772280576640:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1786015506.958543:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015506.960469:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+45:30060:x1872772280576640:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 1949us (4315us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015506.960488:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1258 00010000:00010000:1.0:1786015507.312831:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015508.341944:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786015508.575203:0:21168:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12q: file attributes are refreshed after restore ========================================================== 07:25:07 (1786015507) 00000100:00100000:1.0:1786015508.935303:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015508.935954:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280576768 00000100:00100000:3.0:1786015508.935976:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280576768 00000100:00100000:3.0:1786015508.936074:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 605 00000100:00100000:3.0:1786015508.936086:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:30704:x1872772280576768:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:3.0:1786015508.936114:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015508.936147:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7384bbc600/0xb1a5ef690c50264d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8bac expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015508.936190:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7384bbc600/0xb1a5ef690c50264d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8bac expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015508.936204:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7384bbc600/0xb1a5ef690c50264d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8bac expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015508.936217:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc600, rc 0) 00000100:00100000:3.0:1786015508.936307:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+14:30704:x1872772280576768:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 223us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015508.936315:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 605 00000100:00100000:2.0:1786015508.955194:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015508.957387:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280576896 00000100:00100000:0.0:1786015508.957406:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280576896 00000100:00100000:0.0:1786015508.957748:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 606 00000100:00100000:0.0:1786015508.957789:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+14:30704:x1872772280576896:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:0.0:1786015508.960402:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+14:30704:x1872772280576896:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 2631us (5209us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015508.960545:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 606 00000100:00100000:1.0:1786015508.965722:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015508.965851:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280577024 00000100:00100000:2.0:1786015508.965868:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280577024 00000100:00100000:2.0:1786015508.966005:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 607 00000100:00100000:2.0:1786015508.966017:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+14:30704:x1872772280577024:12345-192.168.202.56@tcp:503:mount.lustre.0 00000100:00100000:2.0:1786015508.966669:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+14:30704:x1872772280577024:12345-192.168.202.56@tcp:503:mount.lustre.0 Request processed in 649us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015508.966679:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 607 00000100:00100000:3.0:1786015508.970639:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015508.970926:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280577152 00000100:00100000:0.0:1786015508.970941:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280577152 00000100:00100000:0.0:1786015508.971056:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 608 00000100:00100000:0.0:1786015508.971069:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+14:30708:x1872772280577152:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786015508.971588:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+14:30708:x1872772280577152:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 518us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015508.971598:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 608 00000100:00100000:0.0:1786015508.996586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015508.996661:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280577280 00000100:00100000:2.0:1786015508.996675:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280577280 00000100:00100000:2.0:1786015508.996789:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 609 00000100:00100000:2.0:1786015508.996802:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+14:30708:x1872772280577280:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786015508.997205:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+14:30708:x1872772280577280:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 404us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015508.997215:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 609 00000100:00100000:1.0:1786015508.999630:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015509.000308:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280577408 00000100:00100000:0.0:1786015509.000324:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280577408 00000100:00100000:2.0:1786015509.007384:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 610 00000100:00100000:2.0:1786015509.007405:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+14:30708:x1872772280577408:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786015509.007799:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+14:30708:x1872772280577408:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 400us (8183us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015509.007807:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 610 00000100:00100000:1.0:1786015509.011931:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015509.021046:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280577536 00000100:00100000:0.0:1786015509.021084:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280577536 00000100:00100000:0.0:1786015509.021332:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 611 00000100:00100000:0.0:1786015509.021356:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+14:30704:x1872772280577536:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1786015509.021384:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015509.021417:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7384afca00/0xb1a5ef690c502654 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8bd6 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.021460:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7384afca00/0xb1a5ef690c502654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8bd6 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.021477:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7384afca00/0xb1a5ef690c502654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8bd6 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.021491:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afca00, rc 0) 00000100:00100000:0.0:1786015509.021598:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+15:30704:x1872772280577536:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 256us (9682us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015509.021607:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 611 00000100:00100000:3.0:1786015509.025850:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015509.026152:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280577664 00000100:00100000:2.0:1786015509.026168:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280577664 00000100:00100000:2.0:1786015509.026276:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 612 00000100:00100000:2.0:1786015509.026288:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+15:30704:x1872772280577664:12345-192.168.202.56@tcp:256:mount.lustre.0 20000000:01000000:2.0:1786015509.026328:0:5789:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1786015509.026378:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1786015509.026383:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1786015509.026386:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1786015509.026389:0:5789:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1786015509.029000:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+15:30704:x1872772280577664:12345-192.168.202.56@tcp:256:mount.lustre.0 Request processed in 2697us (3150us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015509.029020:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 612 00000100:00100000:1.0:1786015509.031623:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015509.034549:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280577792 00000100:00100000:0.0:1786015509.034576:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280577792 00000100:00100000:0.0:1786015509.034677:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 613 00000100:00100000:0.0:1786015509.034704:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+15:30704:x1872772280577792:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1786015509.034730:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015509.034805:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b7384afce00/0xb1a5ef690c50265b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8bdd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.034848:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b7384afce00/0xb1a5ef690c50265b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8bdd expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.034862:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b7384afce00/0xb1a5ef690c50265b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8bdd expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.034876:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afce00, rc 0) 00000100:00100000:2.0:1786015509.035023:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+16:30704:x1872772280577792:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 320us (3410us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015509.035031:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 613 00000100:00100000:3.0:1786015509.037131:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015509.037257:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280577920 00000100:00100000:2.0:1786015509.037272:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280577920 00000100:00100000:2.0:1786015509.037390:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 614 00000100:00100000:2.0:1786015509.037402:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+16:30704:x1872772280577920:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:2.0:1786015509.037904:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+16:30704:x1872772280577920:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 502us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015509.037914:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 614 00000100:00100000:1.0:1786015509.039975:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015509.040066:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280578048 00000100:00100000:2.0:1786015509.040081:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280578048 00000100:00100000:2.0:1786015509.040145:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 615 00000100:00100000:2.0:1786015509.040157:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+16:30704:x1872772280578048:12345-192.168.202.56@tcp:503:mount.lustre.0 00000100:00100000:2.0:1786015509.041069:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+16:30704:x1872772280578048:12345-192.168.202.56@tcp:503:mount.lustre.0 Request processed in 909us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015509.041082:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 615 00000100:00100000:1.0:1786015509.044736:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015509.044949:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280578176 00000100:00100000:2.0:1786015509.044964:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280578176 00000100:00100000:2.0:1786015509.045092:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 616 00000100:00100000:2.0:1786015509.045106:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+16:30713:x1872772280578176:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786015509.045594:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+16:30713:x1872772280578176:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 489us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015509.045608:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 616 00000100:00100000:0.0:1786015509.057151:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015509.061238:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280578304 00000100:00100000:1.0:1786015509.061262:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280578304 00000100:00100000:1.0:1786015509.061356:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 617 00000100:00100000:1.0:1786015509.061371:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+16:30713:x1872772280578304:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786015509.061809:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+16:30713:x1872772280578304:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 440us (4670us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015509.061818:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 617 00000100:00100000:1.0:1786015509.083970:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015509.084030:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015509.084051:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015509.084187:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015509.084214:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015509.084282:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280578944 00000100:00100000:3.0:1786015509.084298:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280578944 00000100:00100000:3.0:1786015509.084393:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280579072 00000100:00100000:3.0:1786015509.084397:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280579072 00000100:00100000:3.0:1786015509.084424:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 498 00000100:00100000:3.0:1786015509.084442:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280578944:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015509.084547:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280578944:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 114us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015509.084557:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 498 00000100:00100000:3.0:1786015509.084579:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 499 00000100:00100000:3.0:1786015509.084586:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+13:2353:x1872772280579072:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015509.084613:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+13:2353:x1872772280579072:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015509.084620:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 499 00000100:00080000:3.0:1786015509.084640:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015509.084645:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015509.086659:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015509.086701:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015509.086729:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280579456 00000100:00100000:1.0:1786015509.086741:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280579456 00000100:00100000:1.0:1786015509.086825:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280579328 00000100:00100000:1.0:1786015509.086829:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280579328 00000100:00100000:1.0:1786015509.086856:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 500 00000100:00100000:1.0:1786015509.086866:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280579456:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015509.086959:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280579456:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 94us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015509.086968:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 500 00000100:00100000:1.0:1786015509.086986:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 501 00000100:00100000:1.0:1786015509.086994:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280579328:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015509.087020:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280579328:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015509.087027:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 501 00000100:00080000:1.0:1786015509.087057:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015509.087061:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015509.088002:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280578432 00000100:00100000:0.0:1786015509.088015:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280578432 00000100:00100000:1.0:1786015509.088213:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280578816 00000100:00100000:1.0:1786015509.088218:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280578816 00000100:00100000:1.0:1786015509.088256:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280579200 00000100:00100000:1.0:1786015509.088260:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280579200 00000100:00100000:1.0:1786015509.088283:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 504 00000100:00100000:1.0:1786015509.088291:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+96:2353:x1872772280578816:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015509.088963:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+96:2353:x1872772280578816:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 668us (4905us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015509.088974:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 504 00000100:00100000:1.0:1786015509.088999:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 505 00000100:00100000:1.0:1786015509.089008:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:2354:x1872772280579200:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015509.089038:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:2354:x1872772280579200:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (4824us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015509.089044:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 505 00000100:00100000:1.0:1786015509.089057:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1259 00000100:00100000:1.0:1786015509.089062:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2350:x1872772280578432:12345-192.168.202.56@tcp:38:mount.lustre.0 00010000:00080000:1.0:1786015509.089096:0:12526:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 15271907-a1cf-47fa-aa4f-97fea3c6cdd8@192.168.202.56@tcp t0 exp 0000000000000000 cur 744 last 0 00000020:00000080:1.0:1786015509.089147:0:12526:0:(genops.c:1406:class_connect()) connect: client 15271907-a1cf-47fa-aa4f-97fea3c6cdd8, cookie 0xb1a5ef690c502662 00000004:00100000:1.0:1786015509.089193:0:12526:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1786015509.089693:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015509.089948:0:12526:0:(import.c:65:import_set_state_nolock()) ffff8b74bf41b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786015509.090004:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:2350:x1872772280578432:12345-192.168.202.56@tcp:38:mount.lustre.0 Request processed in 938us (6049us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015509.090014:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1259 00000100:00100000:1.0:1786015509.095509:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015509.096041:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015509.100001:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280578688 00000100:00100000:0.0:1786015509.100001:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280578560 00000100:00100000:2.0:1786015509.100022:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280578688 00000100:00100000:0.0:1786015509.100022:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280578560 00000100:00080000:1.0:1786015509.100407:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015509.100625:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1260 00000100:00100000:0.0:1786015509.100638:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+7:0:x1872772280578560:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:0.0:1786015509.100716:0:5795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 18087936 pending 0 free 2259681280 avail 2257584128 00000100:00100000:0.0:1786015509.100849:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+7:0:x1872772280578560:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 213us (5352us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015509.100857:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1260 00000100:00100000:3.0:1786015509.102194:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1261 00000100:00100000:3.0:1786015509.102213:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:30704:x1872772280578688:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:3.0:1786015509.102257:0:7673:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 18087936 pending 0 free 2259681280 avail 2257584128 00000100:00100000:3.0:1786015509.102610:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:30704:x1872772280578688:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 403us (6568us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015509.102619:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1261 00000100:00100000:1.0:1786015509.104738:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015509.105207:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280579584 00000100:00100000:0.0:1786015509.105221:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280579584 00000100:00100000:1.0:1786015509.105825:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1262 00000100:00100000:1.0:1786015509.105840:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:30704:x1872772280579584:12345-192.168.202.56@tcp:40:mount.lustre.0 00000100:00100000:1.0:1786015509.105970:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:30704:x1872772280579584:12345-192.168.202.56@tcp:40:mount.lustre.0 Request processed in 134us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015509.105979:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1262 00000100:00100000:3.0:1786015509.110174:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015509.110234:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015509.110628:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280579968 00000100:00100000:1.0:1786015509.110647:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280579968 00000100:00100000:3.0:1786015509.111074:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015509.111211:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015509.111252:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280579712 00000100:00100000:3.0:1786015509.111258:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280579712 00000100:00100000:3.0:1786015509.111300:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280579840 00000100:00100000:3.0:1786015509.111303:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280579840 00000100:00100000:3.0:1786015509.111327:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 345 00000100:00100000:3.0:1786015509.111337:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1872772280579712:12345-192.168.202.56@tcp:8:mount.lustre.0 00010000:00080000:3.0:1786015509.111404:0:6591:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 15271907-a1cf-47fa-aa4f-97fea3c6cdd8@192.168.202.56@tcp t0 exp 0000000000000000 cur 744 last 0 00000020:00000080:3.0:1786015509.111469:0:6591:0:(genops.c:1406:class_connect()) connect: client 15271907-a1cf-47fa-aa4f-97fea3c6cdd8, cookie 0xb1a5ef690c502669 00002000:00100000:3.0:1786015509.111490:0:6591:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 15271907-a1cf-47fa-aa4f-97fea3c6cdd8/ffff8b74b8e25800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1786015509.111529:0:6591:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1786015509.111687:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 346 00000100:00100000:0.0:1786015509.111695:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1872772280579840:12345-192.168.202.56@tcp:8:mount.lustre.0 00010000:00080000:0.0:1786015509.111714:0:6592:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 15271907-a1cf-47fa-aa4f-97fea3c6cdd8@192.168.202.56@tcp t0 exp 0000000000000000 cur 744 last 0 00000020:00000080:0.0:1786015509.111748:0:6592:0:(genops.c:1406:class_connect()) connect: client 15271907-a1cf-47fa-aa4f-97fea3c6cdd8, cookie 0xb1a5ef690c502670 00002000:00080000:3.0:1786015509.111753:0:6591:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00100000:0.0:1786015509.111753:0:6592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 15271907-a1cf-47fa-aa4f-97fea3c6cdd8/ffff8b74bf862000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786015509.111793:0:6592:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1786015509.111896:0:6592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1786015509.111938:0:6592:0:(import.c:65:import_set_state_nolock()) ffff8b74bf860800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1786015509.112031:0:6591:0:(import.c:65:import_set_state_nolock()) ffff8b74b8e25000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786015509.112044:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:2350:x1872772280579840:12345-192.168.202.56@tcp:8:mount.lustre.0 Request processed in 347us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015509.112054:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 346 00000100:00100000:3.0:1786015509.112056:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:2350:x1872772280579712:12345-192.168.202.56@tcp:8:mount.lustre.0 Request processed in 721us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015509.112062:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 345 00000100:00100000:2.0:1786015509.113163:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280580096 00000100:00100000:2.0:1786015509.113178:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280580096 00000100:00100000:2.0:1786015509.113276:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 618 00000100:00100000:2.0:1786015509.113287:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+16:2352:x1872772280580096:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015509.113384:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+16:2352:x1872772280580096:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 99us (3150us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015509.113392:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 618 00000100:00100000:1.0:1786015509.114705:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 257 00000100:00100000:1.0:1786015509.114725:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:30704:x1872772280579968:12345-192.168.202.56@tcp:33:mount.lustre.0 00000004:00200000:1.0:1786015509.115051:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000100:00100000:1.0:1786015509.115188:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:30704:x1872772280579968:12345-192.168.202.56@tcp:33:mount.lustre.0 Request processed in 470us (5027us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015509.115196:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 257 00010000:00010000:3.0:1786015509.356025:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015509.472619:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015509.472749:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280580224 00000100:00100000:2.0:1786015509.472791:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280580224 00000100:00100000:2.0:1786015509.472869:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1263 00000100:00100000:2.0:1786015509.472880:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:30754:x1872772280580224:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015509.472909:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015509.472939:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502677 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c07 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.473027:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50267e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.473044:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50267e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.473060:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50267e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015509.473528:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1786015509.473535:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 30 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015509.473636:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50267e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.473674:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502677 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c07 expref: 8 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.473694:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50267e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c07 expref: 7 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.473703:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:2.0:1786015509.473707:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015509.473711:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386b200, rc 0) 00000100:00100000:2.0:1786015509.473854:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+7:30754:x1872772280580224:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 976us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015509.473864:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1263 00000100:00100000:3.0:1786015509.480825:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015509.480923:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280580352 00000100:00100000:0.0:1786015509.480936:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280580352 00000100:00100000:0.0:1786015509.481011:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1264 00000100:00100000:0.0:1786015509.481021:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+7:30755:x1872772280580352:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015509.481049:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015509.481090:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502685 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c0e expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.481182:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50268c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.481200:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50268c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.481214:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50268c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.481232:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c502693 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.481240:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c502693 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.481247:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c502693 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.481871:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50269a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.481886:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50269a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.481895:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50269a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015509.481990:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1786015509.481995:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015509.482081:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50269a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.482095:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50268c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.482103:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50268c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.482111:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50268c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.482118:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015509.482123:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50268c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.482130:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50268c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.482145:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:0.0:1786015509.482148:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015509.482154:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50268c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.482164:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c50268c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.482179:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c502693 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.482185:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c502693 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.482191:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c502693 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.482197:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015509.482200:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c502693 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.482207:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c502693 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.482214:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8b748f24ac00) 00010000:00010000:0.0:1786015509.482216:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015509.482220:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c502693 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.482225:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c502693 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.482263:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502685 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c0e expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.482278:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50269a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c0e expref: 8 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.482286:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b749802e100) 00010000:00010000:0.0:1786015509.482288:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015509.482291:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd400, rc 0) 00000100:00100000:0.0:1786015509.482391:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+8:30755:x1872772280580352:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1369us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015509.482400:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1264 00000100:00100000:0.0:1786015509.493417:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015509.493530:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280580608 00000100:00100000:2.0:1786015509.493544:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280580608 00000100:00100000:2.0:1786015509.493613:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1265 00000100:00100000:2.0:1786015509.493624:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+8:30755:x1872772280580608:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015509.493655:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015509.493684:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5026a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c15 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.493831:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5026a8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.493849:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5026a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.493869:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5026a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.493887:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026af lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.493894:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.493901:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.494558:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5026b6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.494574:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5026b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.494583:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5026b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015509.494596:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1786015509.494836:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5026a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.494844:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5026a8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.494853:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5026a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.494860:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386be00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015509.494865:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5026a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.494874:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5026a8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.494887:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b749802e100) 00010000:00010000:2.0:1786015509.494890:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015509.494894:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5026a8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.494901:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5026a8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.494914:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.494920:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026af lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.494926:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.494931:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386b400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015509.494934:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.494939:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026af lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.494946:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8b7487f06600) 00010000:00010000:2.0:1786015509.494949:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015509.494952:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026af lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.494958:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026af lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.495507:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5026a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c15 expref: 11 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.495526:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5026b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c15 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.495534:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:2.0:1786015509.495537:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015509.495540:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386ae00, rc 0) 00000100:00100000:2.0:1786015509.495633:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30755:x1872772280580608:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 2009us (2231us total) trans 4294968144 rc 0/0 00000100:00100000:2.0:1786015509.495643:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1265 00000100:00100000:1.0:1786015509.505470:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015509.505621:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280580736 00000100:00100000:2.0:1786015509.505635:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280580736 00000100:00100000:2.0:1786015509.505711:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1266 00000100:00100000:2.0:1786015509.505722:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30755:x1872772280580736:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1786015509.505900:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30755:x1872772280580736:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 180us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015509.505908:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1266 00000100:00100000:3.0:1786015509.511539:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015509.511736:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280580864 00000100:00100000:0.0:1786015509.511752:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280580864 00000100:00100000:0.0:1786015509.511854:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1267 00000100:00100000:0.0:1786015509.511867:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+96:30756:x1872772280580864:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015509.511897:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015509.511928:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5026c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c1c expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512019:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512037:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512050:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512066:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5026d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512074:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5026d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512081:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5026d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512413:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512422:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512442:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512449:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015509.512454:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512463:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512477:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:0.0:1786015509.512480:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015509.512485:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512492:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512504:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5026d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512511:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5026d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512519:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5026d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512524:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015509.512527:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5026d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512534:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5026d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512540:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28683846 (ffff8b748f24ac00) 00010000:00010000:0.0:1786015509.512542:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015509.512545:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5026d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512550:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5026d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512587:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5026c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c1c expref: 97 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512598:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:0.0:1786015509.512600:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015509.512603:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5026c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c1c expref: 97 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.512612:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd000, rc 0) 00000100:00100000:0.0:1786015509.512697:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+96:30756:x1872772280580864:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 833us (1174us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015509.512709:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1267 00000100:00100000:3.0:1786015509.519231:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015509.519351:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280581120 00000100:00100000:2.0:1786015509.519366:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280581120 00000100:00100000:2.0:1786015509.519458:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1268 00000100:00100000:2.0:1786015509.519471:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+96:30756:x1872772280581120:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:2.0:1786015509.519565:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015509.519608:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c502241 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a55 expref: 96 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.519634:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:2.0:1786015509.519640:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015509.520090:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026d9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.520108:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502280 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a6a expref: 44 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.520118:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50267e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c07 expref: 9 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.520127:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026d9 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.520171:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50267e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c07 expref: 9 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.520189:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50267e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c07 expref: 9 pid: 12526 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015509.520209:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304440448:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015509.520363:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502280 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a6a expref: 44 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.520378:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502280 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a6a expref: 44 pid: 5794 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015509.520389:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304440576:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015509.520418:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486543180 going to sleep for 11 seconds 00000100:00100000:2.0:1786015509.523951:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015509.523994:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015509.524267:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280581248 00000100:00100000:0.0:1786015509.524280:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280581248 00010000:00010000:0.0:1786015509.524332:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50267e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c07 expref: 10 pid: 12526 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015509.524386:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280581376 00000100:00100000:0.0:1786015509.524389:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280581376 00010000:00010000:0.0:1786015509.524403:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502280 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a6a expref: 45 pid: 5794 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015509.524424:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 379 00000100:00100000:0.0:1786015509.524440:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:2353:x1872772280581248:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015509.524460:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015509.524468:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50267e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c07 expref: 10 pid: 12526 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.524483:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50267e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c07 expref: 10 pid: 12526 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.524512:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:0.0:1786015509.524518:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026d9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015509.524656:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 380 00000100:00100000:1.0:1786015509.524668:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:2353:x1872772280581376:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015509.524734:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015509.524741:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502280 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a6a expref: 45 pid: 5794 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.524877:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50267e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c07 expref: 10 pid: 12526 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015509.524898:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304440448:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015509.524912:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304440576:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015509.525001:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015509.525079:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+9:2353:x1872772280581248:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 635us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015509.525092:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 379 00010000:00010000:1.0:1786015509.525184:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502280 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a6a expref: 45 pid: 5794 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015509.525202:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c502280 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8a6a expref: 45 pid: 5794 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015509.525215:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:1.0:1786015509.525220:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026d9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015509.525228:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015509.525237:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026d9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015509.525258:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015509.525280:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+44:2353:x1872772280581376:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 615us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015509.525287:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 380 00010000:00010000:3.0:1786015509.525686:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.525700:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.525706:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.525740:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5026e0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.525750:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5026e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.525758:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5026e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015509.527285:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 512 00010000:00010000:3.0:1786015509.527309:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.527320:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026d9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.527341:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.527357:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386b400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015509.527364:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.527372:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026d9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.527389:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7483ee6a00) 00010000:00010000:3.0:1786015509.527392:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015509.527398:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026d9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.527404:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5026d9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015509.527428:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000281f40f4 reply state 00000000be018b77 transno 4294968145 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5026e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015509.527439:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015509.527575:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+97:30756:x1872772280581120:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 8102us (8355us total) trans 4294968145 rc 0/0 00000100:00100000:3.0:1786015509.527586:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1268 00010000:00010000:1.0:1786015509.530898:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5026e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015509.530928:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5026e0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015509.530937:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5026e0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015509.530943:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015509.530949:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5026e0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015509.530959:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5026e0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015509.530983:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28683846 (ffff8b74a04b5b00) 00010000:00010000:1.0:1786015509.530986:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015509.530992:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5026e0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015509.530999:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c5026e0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015509.557236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015509.557329:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280581504 00000100:00100000:0.0:1786015509.557354:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280581504 00000100:00100000:0.0:1786015509.557451:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1269 00000100:00100000:0.0:1786015509.557464:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+44:30760:x1872772280581504:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:0.0:1786015509.557496:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015509.557530:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5026e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c23 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.557634:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5026ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.557653:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5026ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.557668:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5026ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015509.557816:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1786015509.557821:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 31 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015509.557855:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5026ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.557886:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5026e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c23 expref: 46 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.557910:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5026ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c23 expref: 45 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.557924:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ac00) 00010000:00010000:0.0:1786015509.557927:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015509.557930:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd800, rc 0) 00000100:00100000:0.0:1786015509.558282:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:30760:x1872772280581504:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 820us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015509.558291:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1269 00000100:00100000:2.0:1786015509.563318:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015509.563391:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280581632 00000100:00100000:1.0:1786015509.563406:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280581632 00000100:00100000:1.0:1786015509.563491:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1270 00000100:00100000:1.0:1786015509.563504:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+45:2353:x1872772280581632:12345-192.168.202.56@tcp:41:mkdir.0 00000004:00000024:1.0:1786015509.563560:0:5796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 18087936 pending 0 free 2259681280 avail 2257584128 00000100:00100000:1.0:1786015509.563656:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+45:2353:x1872772280581632:12345-192.168.202.56@tcp:41:mkdir.0 Request processed in 155us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015509.563668:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1270 00000100:00100000:1.0:1786015509.565648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015509.565858:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280581888 00000100:00100000:3.0:1786015509.565870:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280581888 00000100:00100000:3.0:1786015509.565937:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1271 00000100:00100000:3.0:1786015509.565947:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+45:30760:x1872772280581888:12345-192.168.202.56@tcp:36:mkdir.0 00010000:00010000:3.0:1786015509.566024:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015509.566061:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5026ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c23 expref: 45 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.566085:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ac00) 00010000:00010000:3.0:1786015509.566099:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015509.566309:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+44:30760:x1872772280581888:12345-192.168.202.56@tcp:36:mkdir.0 Request processed in 362us (671us total) trans 0 rc -17/-17 00000100:00100000:3.0:1786015509.566317:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1271 00000100:00100000:3.0:1786015509.568681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015509.568815:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280582016 00000100:00100000:0.0:1786015509.568830:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280582016 00000100:00100000:0.0:1786015509.568897:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1272 00000100:00100000:0.0:1786015509.568909:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+44:30760:x1872772280582016:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:0.0:1786015509.568937:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015509.568970:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5026f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c2a expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.569050:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.569064:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.569085:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015509.569154:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1786015509.569157:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 31 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015509.569179:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.569203:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5026f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c2a expref: 46 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.569220:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c2a expref: 45 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.569227:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015509.569229:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015509.569232:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afda00, rc 0) 00000100:00100000:0.0:1786015509.569296:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+45:30760:x1872772280582016:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 391us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015509.569303:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1272 00000100:00100000:2.0:1786015509.572274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015509.572351:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280582144 00000100:00100000:1.0:1786015509.572365:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280582144 00000100:00100000:1.0:1786015509.572453:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1273 00000100:00100000:1.0:1786015509.572465:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+45:30760:x1872772280582144:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:1.0:1786015509.572494:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015509.572531:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502703 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c31 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.572662:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c50270a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.572681:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c50270a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.572695:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c50270a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.572715:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502711 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.572723:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.572730:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.572911:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c502718 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.572931:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c502718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.572940:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c502718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015509.572987:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 512 00000004:00200000:3.0:1786015509.572991:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015509.573014:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c502718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.573027:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c50270a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.573034:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c50270a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.573040:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c50270a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.573046:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015509.573050:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c50270a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.573057:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c50270a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.573081:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:3.0:1786015509.573084:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015509.573089:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c50270a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.573099:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c50270a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.573113:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.573118:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502711 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.573123:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502711 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.573128:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015509.573131:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502711 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.573136:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502711 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.573141:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28683846 (ffff8b74a04b5400) 00010000:00010000:3.0:1786015509.573143:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015509.573145:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502711 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.573150:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502711 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.573181:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502703 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c31 expref: 47 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.573200:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c502718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c31 expref: 46 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.573207:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b74a04b5900) 00010000:00010000:3.0:1786015509.573209:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015509.573211:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc800, rc 0) 00000100:00100000:3.0:1786015509.573438:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+46:30760:x1872772280582144:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 974us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015509.573448:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1273 00000100:00100000:2.0:1786015509.582017:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015509.582113:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280582272 00000100:00100000:0.0:1786015509.582127:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280582272 00000100:00100000:0.0:1786015509.582190:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1274 00000100:00100000:0.0:1786015509.582203:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+46:30761:x1872772280582272:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:0.0:1786015509.582232:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015509.582257:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c50271f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c38 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582332:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502726 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582359:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502726 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582376:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502726 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582394:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50272d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582401:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50272d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582407:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50272d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582500:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502726 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582508:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502726 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582514:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502726 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582521:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015509.582526:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502726 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582535:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502726 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582549:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b74a04b5900) 00010000:00010000:0.0:1786015509.582553:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015509.582558:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502726 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582564:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502726 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582580:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50272d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582587:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50272d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582598:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50272d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582603:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015509.582606:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50272d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582613:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50272d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582621:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff8b748f24a300) 00010000:00010000:0.0:1786015509.582623:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015509.582626:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50272d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582632:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50272d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582677:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c50271f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c38 expref: 47 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582689:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b74a04b5900) 00010000:00010000:0.0:1786015509.582692:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015509.582696:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c50271f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c38 expref: 47 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.582708:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd000, rc 0) 00000100:00100000:0.0:1786015509.582935:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+46:30761:x1872772280582272:12345-192.168.202.56@tcp:101:rm.0 Request processed in 734us (933us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015509.582945:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1274 00000100:00100000:1.0:1786015509.593411:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015509.594110:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280582528 00000100:00100000:0.0:1786015509.594129:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280582528 00000100:00100000:0.0:1786015509.594276:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1275 00000100:00100000:0.0:1786015509.594289:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+46:30762:x1872772280582528:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:0.0:1786015509.594318:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015509.594322:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786015509.594371:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c502718 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c31 expref: 46 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.594398:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b74a04b5900) 00010000:00010000:0.0:1786015509.594411:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015509.594440:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502734 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c3f expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.595232:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50273b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.595254:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50273b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.595267:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50273b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.595286:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502742 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.595293:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.595300:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786015509.597231:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x19:0x0], index 0: 0 00010000:00010000:2.0:1786015509.600654:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502749 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.600928:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502749 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.600948:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502749 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.601043:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50273b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.601050:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50273b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.601058:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50273b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.601065:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386b400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015509.601070:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50273b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.601079:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50273b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.601095:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b748f24a300) 00010000:00010000:2.0:1786015509.601098:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015509.601104:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50273b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.601111:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50273b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015509.601135:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c66b47e9 reply state 000000005718d3b2 transno 4294968146 ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015509.601145:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786015509.601209:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502734 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c3f expref: 48 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.601237:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502749 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c3f expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.601245:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b7487f06d00) 00010000:00010000:2.0:1786015509.601247:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015509.601249:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386b000, rc 0) 00000100:00100000:2.0:1786015509.601368:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:30762:x1872772280582528:12345-192.168.202.56@tcp:101:dd.0 Request processed in 7080us (7969us total) trans 4294968146 rc 0/0 00000100:00100000:2.0:1786015509.601379:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1275 00010000:00010000:1.0:1786015509.605005:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015509.605028:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502742 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015509.605037:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502742 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015509.605045:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386b200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015509.605051:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502742 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015509.605061:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502742 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015509.605085:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff8b7487f06600) 00010000:00010000:1.0:1786015509.605089:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015509.605095:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502742 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015509.605101:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502742 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786015509.612069:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015509.612087:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015509.612708:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1786015509.612720:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015509.626054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015509.626362:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280582656 00000100:00100000:3.0:1786015509.626376:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280582656 00000100:00100000:3.0:1786015509.626459:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 347 00000100:00100000:3.0:1786015509.626471:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:30762:x1872772280582656:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:3.0:1786015509.626495:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015509.626532:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c502757 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c46 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015509.626566:0:14547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786015509.626594:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=744s v=(0 0) 00010000:00010000:3.0:1786015509.626599:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015509.626612:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c502757 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c46 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.626632:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c502757 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c46 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.626650:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbde00, rc 0) 00000100:00100000:3.0:1786015509.626733:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:30762:x1872772280582656:12345-192.168.202.56@tcp:101:dd.0 Request processed in 264us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015509.626740:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 347 00000100:00100000:3.0:1786015509.642517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015509.642647:0:17969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280582784 00000100:00100000:0.0:1786015509.642662:0:17969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280582784 00002000:00100000:0.0:1786015509.642735:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x19:0x0] (0->1048575) req@ffff8b74af05dc00 x1872772280582784/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:355/0 lens 488/0 e 0 to 0 dl 1786015520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015509.642747:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74af05dc00 with x1872772280582784 ext(0->1048575) 00002000:00010000:0.0:1786015509.642755:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74af05dc00 00000100:00100000:0.0:1786015509.642873:0:17969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 111 00000100:00100000:0.0:1786015509.642885:0:17969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280582784:12345-192.168.202.56@tcp:4:dd.0 00000100:00100000:0.0:1786015509.661934:0:17969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280582784:12345-192.168.202.56@tcp:4:dd.0 Request processed in 19031us (19413us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1786015509.661953:0:17969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 111 00002000:00100000:0.0:1786015509.661974:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x19:0x0] (0->1048575) req@ffff8b74af05dc00 x1872772280582784/t4294967365(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:355/0 lens 488/448 e 0 to 0 dl 1786015520 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015509.661985:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74af05dc00 with x1872772280582784 ext(0->1048575) 00002000:00010000:0.0:1786015509.661994:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74af05dc00 00000100:00100000:0.0:1786015509.665099:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015509.665187:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280582912 00000100:00100000:3.0:1786015509.665202:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280582912 00000100:00100000:3.0:1786015509.665283:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1276 00000100:00100000:3.0:1786015509.665296:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+47:30762:x1872772280582912:12345-192.168.202.56@tcp:44:dd.0 00000100:00100000:3.0:1786015509.678112:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786015509.678147:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304440704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015509.678248:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015509.678360:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304440704 00000100:00100000:3.0:1786015509.678370:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304440704 00000100:00100000:3.0:1786015509.678442:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1786015509.678452:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304440704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015509.678486:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 93519872 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015509.678555:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304440704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015509.678563:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1786015509.678619:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304440704:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786015509.678797:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1786015509.709324:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 15271907-a1cf-47fa-aa4f-97fea3c6cdd8 00000020:00080000:3.0:1786015509.709364:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 28 batchid updated 00000001:00080000:3.0:1786015509.709386:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968146 is committed 00000001:00080000:3.0:1786015509.709395:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968144 is committed 00000001:00080000:3.0:1786015509.709402:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968145 is committed 00000020:00080000:1.0:1786015509.709563:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 28 00000020:00080000:1.0:1786015509.709579:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 28 00000100:00100000:2.0:1786015509.709882:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+46:30762:x1872772280582912:12345-192.168.202.56@tcp:44:dd.0 Request processed in 44580us (44789us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015509.709896:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1276 00000100:00100000:2.0:1786015509.713612:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015509.714011:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280583040 00000100:00100000:3.0:1786015509.714026:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280583040 00000100:00100000:3.0:1786015509.714146:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 348 00000100:00100000:3.0:1786015509.714160:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280583040:12345-192.168.202.56@tcp:16:dd.0 00000100:00100000:3.0:1786015509.762129:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280583040:12345-192.168.202.56@tcp:16:dd.0 Request processed in 47951us (48512us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015509.762149:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 348 00000001:00080000:1.0:1786015509.764504:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967365 is committed 00000001:00100000:1.0:1786015509.764549:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 15271907-a1cf-47fa-aa4f-97fea3c6cdd8 00000100:00100000:1.0:1786015509.766375:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015509.766654:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280583296 00000100:00100000:0.0:1786015509.766669:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280583296 00000100:00100000:0.0:1786015509.766808:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 258 00000100:00100000:0.0:1786015509.766821:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+46:30762:x1872772280583296:12345-192.168.202.56@tcp:35:dd.0 00000100:00100000:3.0:1786015509.767621:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:30762:x1872772280583296:12345-192.168.202.56@tcp:35:dd.0 Request processed in 800us (1255us total) trans 4294968147 rc 0/0 00000100:00100000:3.0:1786015509.767630:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 258 00000100:00100000:2.0:1786015509.785959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015509.786094:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280583424 00000100:00100000:0.0:1786015509.786107:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280583424 00000100:00100000:0.0:1786015509.786196:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1277 00000100:00100000:0.0:1786015509.786210:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+47:30763:x1872772280583424:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015509.786249:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015509.786282:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50275e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c4d expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.786391:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502765 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.786408:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502765 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.786426:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502765 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.786671:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50276c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.786839:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50276c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.786850:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50276c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.787635:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502773 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.787647:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.787656:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015509.788375:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 7680 00000004:00200000:2.0:1786015509.788384:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015509.788647:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.788670:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502765 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.789096:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502765 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.789108:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502765 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.789116:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015509.789122:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502765 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.789132:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502765 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.789153:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:2.0:1786015509.789157:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015509.789164:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502765 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.789171:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c502765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.789189:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50276c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.789196:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50276c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.789202:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50276c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.789207:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015509.789211:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50276c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.789217:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50276c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.789224:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28683846 (ffff8b748f24a600) 00010000:00010000:2.0:1786015509.789227:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015509.789230:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50276c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.789236:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50276c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.789290:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50275e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c4d expref: 49 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.789305:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc600/0xb1a5ef690c502773 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c4d expref: 48 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.789313:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:2.0:1786015509.789315:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786015509.789318:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc600, rc 0) 00000100:00100000:2.0:1786015509.789620:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+48:30763:x1872772280583424:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3409us (3940us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015509.789631:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1277 00000100:00100000:2.0:1786015509.809936:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015509.810145:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280583552 00000100:00100000:1.0:1786015509.810159:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280583552 00000100:00100000:1.0:1786015509.810236:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1278 00000100:00100000:1.0:1786015509.810248:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+95:30765:x1872772280583552:12345-192.168.202.56@tcp:101:stat.0 00010000:00010000:1.0:1786015509.810283:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015509.810314:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c50277a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c54 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.811487:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c502781 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.811520:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c502781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.811603:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c502781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015509.812188:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1786015509.812197:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 31 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015509.812356:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c502781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.812408:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c50277a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c54 expref: 97 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.812518:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c502781 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c54 expref: 96 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.812598:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:2.0:1786015509.812602:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015509.812606:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386be00, rc 0) 00000100:00100000:2.0:1786015509.813261:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+96:30765:x1872772280583552:12345-192.168.202.56@tcp:101:stat.0 Request processed in 3009us (3337us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015509.813275:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1278 00000100:00100000:1.0:1786015509.817051:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015509.817202:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280583680 00000100:00100000:2.0:1786015509.817216:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280583680 00000100:00100000:2.0:1786015509.817302:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1279 00000100:00100000:2.0:1786015509.817314:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+96:30765:x1872772280583680:12345-192.168.202.56@tcp:101:stat.0 00010000:00010000:2.0:1786015509.817363:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015509.817397:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502788 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c5b expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.817499:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50278f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.817516:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50278f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.817540:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50278f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.817560:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502796 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.817568:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502796 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.817574:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502796 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818139:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50279d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818152:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50279d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818160:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50279d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015509.818257:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 7680 00000004:00200000:2.0:1786015509.818263:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015509.818365:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50279d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818384:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50278f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818391:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50278f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818398:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50278f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818405:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386b400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015509.818410:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50278f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818419:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50278f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818433:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:2.0:1786015509.818437:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015509.818442:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50278f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818449:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50278f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818463:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502796 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818470:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502796 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818477:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502796 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818484:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015509.818487:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502796 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818493:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502796 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818501:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28683846 (ffff8b7487f06300) 00010000:00010000:2.0:1786015509.818503:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015509.818506:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502796 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818513:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c502796 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818554:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c502788 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c5b expref: 98 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818568:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6600/0xb1a5ef690c50279d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c5b expref: 97 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.818577:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:2.0:1786015509.818579:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786015509.818582:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6600, rc 0) 00000100:00100000:2.0:1786015509.818679:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+97:30765:x1872772280583680:12345-192.168.202.56@tcp:101:stat.0 Request processed in 1365us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015509.818690:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1279 00000100:00100000:3.0:1786015509.822965:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015509.823091:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280583808 00000100:00100000:2.0:1786015509.823105:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280583808 00000100:00100000:2.0:1786015509.823190:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1280 00000100:00100000:2.0:1786015509.823204:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+97:30765:x1872772280583808:12345-192.168.202.56@tcp:101:stat.0 00010000:00010000:2.0:1786015509.823244:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015509.823283:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5027a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c62 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.823399:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c5027ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.823417:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c5027ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.823432:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c5027ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.823461:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5027b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.823469:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5027b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.823476:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5027b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824060:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c5027b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824074:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c5027b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824083:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c5027b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015509.824138:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00000004:00200000:2.0:1786015509.824144:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015509.824173:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c5027b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824189:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c5027b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824199:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c5027ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824206:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c5027ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824214:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c5027ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824221:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf3b4e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015509.824226:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c5027ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824236:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c5027ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824254:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:2.0:1786015509.824257:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015509.824264:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c5027ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824270:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c5027ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824292:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5027b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824298:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5027b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824304:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5027b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824310:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf3b5600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015509.824313:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5027b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824320:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5027b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824329:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff8b7487f06700) 00010000:00010000:2.0:1786015509.824331:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015509.824334:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5027b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824351:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5027b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824397:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5027a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c62 expref: 99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824412:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c5027b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c62 expref: 98 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015509.824426:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b7487f06d00) 00010000:00010000:2.0:1786015509.824428:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015509.824431:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf3b5000, rc 0) 00000100:00100000:2.0:1786015509.824535:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+98:30765:x1872772280583808:12345-192.168.202.56@tcp:101:stat.0 Request processed in 1333us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015509.824545:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1280 00000100:00100000:0.0:1786015509.828270:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015509.828400:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280583936 00000100:00100000:3.0:1786015509.828412:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280583936 00000100:00100000:3.0:1786015509.828488:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 349 00000100:00100000:3.0:1786015509.828499:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2351:x1872772280583936:12345-192.168.202.56@tcp:101:stat.0 00010000:00010000:3.0:1786015509.828537:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015509.828565:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5849b9/0xb1a5ef690c5027c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c69 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015509.828665:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304440832:192.168.202.56@tcp:106: 00000100:00100000:3.0:1786015509.828856:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486540cc0 going to sleep for 11 seconds 00002000:00010000:3.0:1786015509.831721:0:6590:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:3.0:1786015509.831734:0:6590:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb mtime: 0 -> 1786015509 00002000:00010000:3.0:1786015509.831737:0:6590:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb atime: 0 -> 1786015509 00002000:00010000:3.0:1786015509.831740:0:6590:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb ctime: 0 -> 1786015509 00002000:00010000:3.0:1786015509.831743:0:6590:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb blocks: 1 -> 2051 00000100:00100000:3.0:1786015509.831815:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304440832:192.168.202.56@tcp:106: 00010000:00010000:3.0:1786015509.831868:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c5849b9/0xb1a5ef690c5027c0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c69 expref: 17 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.831902:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5849b9/0xb1a5ef690c5027c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c69 expref: 17 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.831922:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbcc00, rc 0) 00000100:00100000:3.0:1786015509.832005:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2351:x1872772280583936:12345-192.168.202.56@tcp:101:stat.0 Request processed in 3507us (3752us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015509.832016:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 349 00000100:00100000:2.0:1786015509.847405:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015509.847535:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280584064 00000100:00100000:0.0:1786015509.847550:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280584064 00000100:00100000:0.0:1786015509.847621:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 350 00000100:00100000:0.0:1786015509.847634:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280584064:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015509.847661:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015509.847701:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000053ed007/0xb1a5ef690c5027c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c70 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015509.847846:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1220700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304440960:192.168.202.56@tcp:106: 00000100:00100000:0.0:1786015509.847964:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7484fff240 going to sleep for 11 seconds 00000100:00100000:1.0:1786015509.856273:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1220700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304440960:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015509.856355:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000053ed007/0xb1a5ef690c5027c7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c70 expref: 17 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015509.856382:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000053ed007/0xb1a5ef690c5027c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c70 expref: 17 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015509.856405:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afcc00, rc 0) 00000100:00100000:1.0:1786015509.856506:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280584064:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 8873us (9113us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015509.856515:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 350 00000100:00100000:2.0:1786015509.862212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015509.862336:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280584192 00000100:00100000:0.0:1786015509.862362:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280584192 00000100:00100000:0.0:1786015509.862443:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1281 00000100:00100000:0.0:1786015509.862455:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+98:30766:x1872772280584192:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015509.862486:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015509.862521:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5027ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c77 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.862620:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5027d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.862638:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5027d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.862654:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5027d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015509.863415:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 7680 00000004:00200000:0.0:1786015509.863425:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015509.863531:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5027d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.863584:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5027ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c77 expref: 100 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.863609:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5027d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c77 expref: 99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015509.863623:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:0.0:1786015509.863627:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015509.863632:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd800, rc 0) 00000100:00100000:0.0:1786015509.864319:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+99:30766:x1872772280584192:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1860us (2113us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015509.864331:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1281 00000100:00100000:2.0:1786015509.868674:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015509.869838:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280584320 00000100:00100000:3.0:1786015509.869861:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280584320 00000100:00100000:3.0:1786015509.869954:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 351 00000100:00100000:3.0:1786015509.869967:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2351:x1872772280584320:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015509.869996:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015509.870035:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5849b9/0xb1a5ef690c5027dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c7e expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015509.870271:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304441088:192.168.202.56@tcp:106: 00000100:00100000:3.0:1786015509.870461:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486540cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015509.882904:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304441088:192.168.202.56@tcp:106: 00010000:00010000:3.0:1786015509.882974:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c5849b9/0xb1a5ef690c5027dc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c7e expref: 17 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.883376:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5849b9/0xb1a5ef690c5027dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c7e expref: 17 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015509.883401:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbcc00, rc 0) 00000100:00100000:3.0:1786015509.883511:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2351:x1872772280584320:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 13546us (14853us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015509.883532:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 351 00000100:00100000:2.0:1786015509.891876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015509.892398:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280584576 00000100:00100000:3.0:1786015509.892415:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280584576 00000100:00100000:3.0:1786015509.892508:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1282 00000100:00100000:3.0:1786015509.892534:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+99:30766:x1872772280584576:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:3.0:1786015509.893240:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].37, 136 off13224 00000100:00100000:3.0:1786015509.893400:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+99:30766:x1872772280584576:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 877us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015509.893412:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1282 00010000:00010000:0.0:1786015510.381246:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015510.636173:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015510.636184:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015510.636457:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 38 count 5 00000040:00080000:3.0:1786015510.636466:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015510.637032:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304441216:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015510.637141:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359180 going to sleep for 11 seconds 00000100:00100000:3.0:1786015510.663456:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015510.663500:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280584704 00000100:00100000:3.0:1786015510.663510:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280584704 00000100:00100000:3.0:1786015510.663575:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:3.0:1786015510.663586:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+8:30776:x1872772280584704:12345-192.168.202.56@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1786015510.663689:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+8:30776:x1872772280584704:12345-192.168.202.56@tcp:900:lhsmtool_posix.0 Request processed in 104us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015510.663697:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:1.0:1786015510.665221:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304441216:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015510.667432:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015510.668034:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280584832 00000100:00100000:3.0:1786015510.668044:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280584832 00000100:00100000:3.0:1786015510.668104:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1283 00000100:00100000:3.0:1786015510.668113:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+7:30776:x1872772280584832:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015510.669002:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x27:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015510.669352:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+7:30776:x1872772280584832:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 1234us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015510.669362:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1283 00000100:00100000:3.0:1786015510.683473:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015510.683838:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280585088 00000100:00100000:1.0:1786015510.683849:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280585088 00000100:00100000:1.0:1786015510.683920:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1284 00000100:00100000:1.0:1786015510.683941:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+7:30776:x1872772280585088:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015510.683968:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015510.683996:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c5027e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c85 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.684131:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5027ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.684146:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5027ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.684159:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5027ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015510.684173:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00010000:00010000:1.0:1786015510.684314:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c5027e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c85 expref: 10 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.684350:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5027ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c85 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.684360:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b7487f06d00) 00010000:00010000:1.0:1786015510.684363:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015510.684368:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920200, rc 0) 00000100:00100000:1.0:1786015510.684444:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+9:30776:x1872772280585088:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 515us (981us total) trans 4294968148 rc 0/0 00000100:00100000:1.0:1786015510.684452:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1284 00000100:00100000:0.0:1786015510.690578:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015510.690796:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280585216 00000100:00100000:1.0:1786015510.690806:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280585216 00000100:00100000:1.0:1786015510.690888:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 352 00000100:00100000:1.0:1786015510.690899:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+5:2354:x1872772280585216:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015510.690958:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027f8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.690982:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c502757 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c46 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.690992:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x19:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786015510.690997:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015510.691002:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027f8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.691041:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c502757 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c46 expref: 8 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.691057:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c502757 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c46 expref: 8 pid: 14547 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015510.691071:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304441344:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015510.691162:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7490fcd180 going to sleep for 11 seconds 00000100:00080000:0.0:1786015510.692743:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015510.696837:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304441344:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015510.696881:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027f8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015510.717461:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015510.718784:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280585344 00000100:00100000:1.0:1786015510.718801:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280585344 00010000:00010000:1.0:1786015510.718861:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c502757 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c46 expref: 9 pid: 14547 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015510.718905:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 381 00000100:00100000:1.0:1786015510.718916:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280585344:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015510.718942:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015510.718970:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c502757 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c46 expref: 9 pid: 14547 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.718984:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c502757 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c46 expref: 9 pid: 14547 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.719008:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c502757 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c46 expref: 9 pid: 14547 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.719027:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015510.719031:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015510.719037:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.719047:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027f8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.719079:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015510.719157:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280585344:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 242us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015510.719164:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 381 00010000:00010000:1.0:1786015510.719199:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.719210:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.719241:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.719250:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.719257:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.719265:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015510.719269:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.719278:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.719290:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.719297:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015510.719362:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+5:2354:x1872772280585216:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 28466us (28795us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015510.719369:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 352 00000100:00100000:1.0:1786015510.724840:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015510.725099:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280585600 00000100:00100000:0.0:1786015510.725110:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280585600 00000100:00100000:0.0:1786015510.725175:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1285 00000100:00100000:0.0:1786015510.725185:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+9:30776:x1872772280585600:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015510.725302:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+9:30776:x1872772280585600:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 118us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015510.725310:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1285 00000100:00100000:0.0:1786015510.750347:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015510.750428:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280585728 00000100:00100000:1.0:1786015510.750438:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280585728 00000100:00100000:1.0:1786015510.750529:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 353 00000100:00100000:1.0:1786015510.750540:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+5:2354:x1872772280585728:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015510.750562:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015510.750581:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c8c expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015510.750610:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 1048576, mtime: 0x6a746f15, atime: 0x0, ctime: 0x6a746f15, blocks: 0x803 00010000:00010000:1.0:1786015510.750632:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=746s v=(0 0) 00010000:00010000:1.0:1786015510.750637:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015510.750646:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c8c expref: 6 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.750664:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c8c expref: 6 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.750680:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921200, rc 0) 00000100:00100000:1.0:1786015510.750783:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:2354:x1872772280585728:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 220us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015510.750793:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 353 00000100:00100000:1.0:1786015510.757236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015510.757406:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280585984 00000100:00100000:3.0:1786015510.757419:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280585984 00000100:00100000:1.0:1786015510.757689:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1286 00000100:00100000:1.0:1786015510.757703:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+9:30776:x1872772280585984:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786015510.757831:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+9:30776:x1872772280585984:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 132us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015510.757839:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1286 00000100:00100000:1.0:1786015510.772663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015510.772856:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280586112 00000100:00100000:3.0:1786015510.772868:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280586112 00002000:00100000:3.0:1786015510.773048:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x19:0x0] (0->1048575) req@ffff8b74aa9adc00 x1872772280586112/t0(0) o3->15271907-a1cf-47fa-aa4f-97fea3c6cdd8@192.168.202.56@tcp:356/0 lens 488/0 e 0 to 0 dl 1786015521 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015510.773062:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aa9adc00 with x1872772280586112 ext(0->1048575) 00002000:00010000:3.0:1786015510.773070:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74aa9adc00 00000100:00100000:3.0:1786015510.773114:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 112 00000100:00100000:3.0:1786015510.773196:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:2351:x1872772280586112:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1786015510.815125:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:2351:x1872772280586112:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 41988us (42459us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786015510.815141:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 112 00002000:00100000:3.0:1786015510.815157:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x19:0x0] (0->1048575) req@ffff8b74aa9adc00 x1872772280586112/t0(0) o3->15271907-a1cf-47fa-aa4f-97fea3c6cdd8@192.168.202.56@tcp:356/0 lens 488/440 e 0 to 0 dl 1786015521 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015510.815169:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aa9adc00 with x1872772280586112 ext(0->1048575) 00002000:00010000:3.0:1786015510.815177:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74aa9adc00 00000100:00100000:1.0:1786015510.854553:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015510.854719:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280586240 00000100:00100000:3.0:1786015510.854735:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280586240 00000100:00100000:3.0:1786015510.854853:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1287 00000100:00100000:3.0:1786015510.854864:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+9:30776:x1872772280586240:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015510.854906:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015510.854936:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502806 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c93 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015510.854993:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50280d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015510.855012:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50280d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015510.855031:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50280d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015510.855178:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502806 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c93 expref: 11 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015510.855207:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50280d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c93 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015510.855216:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b7487f06d00) 00010000:00010000:3.0:1786015510.855220:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786015510.855224:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc200, rc 0) 00000100:00100000:3.0:1786015510.855308:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30776:x1872772280586240:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 445us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015510.855316:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1287 00000100:00100000:0.0:1786015510.872617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015510.876882:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280586368 00000100:00100000:1.0:1786015510.877063:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280586368 00000100:00100000:1.0:1786015510.877205:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1288 00000100:00100000:1.0:1786015510.877219:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30776:x1872772280586368:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786015510.877270:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x27:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786015510.877439:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30776:x1872772280586368:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 223us (4840us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015510.877452:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1288 00000100:00100000:1.0:1786015510.897547:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015510.897602:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280586496 00000100:00100000:1.0:1786015510.897615:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280586496 00000100:00100000:1.0:1786015510.897687:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 354 00000100:00100000:1.0:1786015510.897700:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:2353:x1872772280586496:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015510.897795:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502814 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.897818:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015510.897824:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015510.897831:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502814 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.897850:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502814 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.898814:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502814 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.898833:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502814 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.898843:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502814 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.898856:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920400 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015510.898862:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502814 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.898870:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502814 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.898977:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502814 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.902402:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502814 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015510.902545:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:2353:x1872772280586496:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 4840us (5005us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015510.902559:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 354 00000100:00100000:0.0:1786015510.906469:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015510.906558:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280586752 00000100:00100000:1.0:1786015510.906572:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280586752 00000100:00100000:1.0:1786015510.906650:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1289 00000100:00100000:1.0:1786015510.906662:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30776:x1872772280586752:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786015510.906875:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c50281b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.906905:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50280d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c93 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.906920:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c50281b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.906974:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50280d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c93 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.907063:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50280d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c93 expref: 10 pid: 5794 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015510.907082:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304441472:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015510.907423:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7490fcdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1786015510.946527:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015510.946596:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280586880 00000100:00100000:2.0:1786015510.946609:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280586880 00010000:00010000:2.0:1786015510.946665:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50280d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c93 expref: 11 pid: 5794 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015510.946714:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 382 00000100:00100000:2.0:1786015510.946725:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0068450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+11:2353:x1872772280586880:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015510.946745:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015510.946754:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50280d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c93 expref: 11 pid: 5794 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015510.946808:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50280d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c93 expref: 11 pid: 5794 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015510.946837:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b7487f06d00) 00010000:00010000:2.0:1786015510.946844:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c50281b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015510.946856:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c50281b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.947183:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50280d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c93 expref: 11 pid: 5794 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015510.947206:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304441472:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015510.947327:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c50281b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015510.953189:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c50281b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015510.964377:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015510.964500:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0068450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:2353:x1872772280586880:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 17766us (17977us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015510.964515:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 382 00010000:00010000:3.0:1786015510.968490:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c50281b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015510.968518:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c50281b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015510.968827:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c50281b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015510.968835:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c50281b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015510.968841:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c50281b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015510.968846:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015510.968849:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c50281b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015510.968856:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c50281b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015510.968950:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b7487f06d00) 00010000:00010000:3.0:1786015510.968953:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786015510.968958:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c50281b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015510.968963:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c50281b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015510.970568:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30776:x1872772280586752:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 63893us (64098us total) trans 4294968149 rc 0/0 00000100:00100000:3.0:1786015510.970585:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1289 00000040:00080000:3.0:1786015510.972547:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015510.972559:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015510.975552:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:3.0:1786015510.975581:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015510.982504:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015510.983385:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280587136 00000100:00100000:2.0:1786015510.983405:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280587136 00000100:00100000:2.0:1786015510.983507:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 259 00000100:00100000:2.0:1786015510.983519:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30776:x1872772280587136:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015510.983869:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+11:30776:x1872772280587136:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 351us (1715us total) trans 4294968150 rc 0/0 00000100:00100000:2.0:1786015510.983878:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 259 00000040:00080000:0.0:1786015510.984475:0:21217:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015510.984484:0:21217:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015510.984546:0:21217:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 38 count 5 00000040:00080000:0.0:1786015510.984553:0:21217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015511.073452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015511.078316:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280587264 00000100:00100000:1.0:1786015511.078350:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280587264 00000100:00100000:1.0:1786015511.078652:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 355 00000100:00100000:1.0:1786015511.079648:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2351:x1872772280587264:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015511.079683:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015511.079716:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502822 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8c9a expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.079758:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015511.079778:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015511.079790:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502822 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c9a expref: 17 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.079815:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502822 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c9a expref: 17 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.079832:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920400, rc 0) 00000100:00100000:1.0:1786015511.079950:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280587264:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1286us (6512us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015511.079960:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 355 00000100:00080000:0.0:1786015511.085273:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015511.109730:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015511.110370:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280587520 00000100:00100000:3.0:1786015511.110385:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280587520 00000100:00100000:3.0:1786015511.110753:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1290 00000100:00100000:3.0:1786015511.111412:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+99:30777:x1872772280587520:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015511.111963:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1786015511.112114:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786015511.112294:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502829 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ca1 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015511.113276:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502830 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015511.113302:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502830 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015511.113319:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502830 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015511.113351:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00010000:00010000:3.0:1786015511.115729:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502829 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ca1 expref: 102 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015511.116610:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502830 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ca1 expref: 101 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015511.116627:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b7487f06d00) 00010000:00010000:3.0:1786015511.116630:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786015511.116635:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd600, rc 0) 00000100:00100000:3.0:1786015511.116740:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+101:30777:x1872772280587520:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 5952us (7024us total) trans 4294968151 rc 0/0 00000100:00100000:3.0:1786015511.116751:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1290 00000100:00100000:2.0:1786015511.125370:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015511.125424:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280587648 00000100:00100000:2.0:1786015511.125437:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280587648 00000100:00100000:2.0:1786015511.125505:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 356 00000100:00100000:2.0:1786015511.125517:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280587648:12345-192.168.202.56@tcp:1:lfs.0 00010000:00010000:2.0:1786015511.125584:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011cc792c/0xb1a5ef690c50283e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.125611:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c8c expref: 5 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.125621:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502822 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c9a expref: 17 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.125629:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015511.125635:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015511.125640:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011cc792c/0xb1a5ef690c50283e lrc: 5/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.125686:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502822 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c9a expref: 17 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.125703:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502822 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c9a expref: 17 pid: 6590 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015511.125722:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304441600:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015511.125876:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c8c expref: 5 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.125886:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c8c expref: 5 pid: 6592 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015511.125896:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8978a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304441728:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015511.125921:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7481254300 going to sleep for 11 seconds 00000100:00100000:3.0:1786015511.138201:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015511.141150:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280587776 00000100:00100000:2.0:1786015511.141184:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280587776 00010000:00010000:2.0:1786015511.141258:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502822 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c9a expref: 18 pid: 6590 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015511.141317:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 383 00000100:00100000:2.0:1786015511.141342:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280587776:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015511.141365:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015511.141399:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502822 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c9a expref: 18 pid: 6590 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.141423:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502822 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c9a expref: 18 pid: 6590 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.141458:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015511.141547:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280587776:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 219us (3361us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015511.141559:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 383 00010000:00010000:2.0:1786015511.141633:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c502822 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c9a expref: 17 pid: 6590 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015511.141651:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304441600:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015511.141666:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8978a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304441728:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015511.141698:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011cc792c/0xb1a5ef690c50283e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015511.143836:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015511.144278:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280587904 00000100:00100000:1.0:1786015511.144292:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280587904 00010000:00010000:1.0:1786015511.144353:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c8c expref: 6 pid: 6592 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015511.144404:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 384 00000100:00100000:1.0:1786015511.144423:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:2354:x1872772280587904:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015511.144443:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015511.144472:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c8c expref: 6 pid: 6592 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.144488:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c8c expref: 6 pid: 6592 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.144532:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c5027ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c8c expref: 6 pid: 6592 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.144552:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015511.144557:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015511.144565:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011cc792c/0xb1a5ef690c50283e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.144576:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011cc792c/0xb1a5ef690c50283e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.144612:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015511.144676:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+5:2354:x1872772280587904:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 263us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015511.144685:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 384 00010000:00010000:3.0:1786015511.145130:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011cc792c/0xb1a5ef690c50283e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015511.145142:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011cc792c/0xb1a5ef690c50283e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015511.145592:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011cc792c/0xb1a5ef690c50283e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015511.145610:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011cc792c/0xb1a5ef690c50283e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015511.145618:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011cc792c/0xb1a5ef690c50283e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015511.145626:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061400 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015511.145632:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011cc792c/0xb1a5ef690c50283e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015511.145642:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011cc792c/0xb1a5ef690c50283e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015511.145658:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011cc792c/0xb1a5ef690c50283e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015511.145666:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011cc792c/0xb1a5ef690c50283e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015511.145819:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280587648:12345-192.168.202.56@tcp:1:lfs.0 Request processed in 20301us (20461us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015511.145831:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 356 00000100:00100000:3.0:1786015511.154436:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015511.154970:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280588160 00000100:00100000:1.0:1786015511.154995:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280588160 00000100:00100000:1.0:1786015511.155088:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 260 00000100:00100000:1.0:1786015511.155225:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916af450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+101:30777:x1872772280588160:12345-192.168.202.56@tcp:35:lfs.0 00000004:00010000:1.0:1786015511.155335:0:5798:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x27:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502830 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ca1 expref: 101 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786015511.155661:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968152 00000001:00080000:1.0:1786015511.156600:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968153 00010000:00010000:1.0:1786015511.156689:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502845 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.156711:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502749 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c3f expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.156720:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c5027b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c62 expref: 104 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.156729:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5027ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c85 expref: 10 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.156737:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502845 lrc: 6/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.156818:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5027ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c85 expref: 10 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.156838:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5027ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c85 expref: 10 pid: 5795 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015511.156856:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304441856:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015511.156989:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c5027b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c62 expref: 104 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.157000:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c5027b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c62 expref: 104 pid: 7673 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015511.157009:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304441984:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015511.157042:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502749 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c3f expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.157050:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502749 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c3f expref: 47 pid: 5795 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015511.157058:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304442112:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015511.157084:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7490fcdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786015511.163495:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304441856:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015511.163515:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304441984:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015511.163525:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304442112:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015511.163570:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502845 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015511.179569:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015511.179615:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015511.179639:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015511.179894:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280588288 00000100:00100000:1.0:1786015511.179909:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280588288 00000100:00100000:2.0:1786015511.180100:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280588544 00000100:00080000:3.0:1786015511.180283:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015511.180322:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280588544 00010000:00010000:2.0:1786015511.180360:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c5027b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c62 expref: 105 pid: 7673 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.180406:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5027ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c85 expref: 11 pid: 5795 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015511.180442:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280588416 00000100:00100000:2.0:1786015511.180445:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280588416 00010000:00010000:2.0:1786015511.180469:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502749 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c3f expref: 48 pid: 5795 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015511.189229:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 385 00000100:00100000:2.0:1786015511.189263:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+105:2354:x1872772280588544:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015511.189295:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015511.189311:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c5027b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c62 expref: 105 pid: 7673 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.189348:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c5027b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c62 expref: 105 pid: 7673 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.189383:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c5027b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c62 expref: 105 pid: 7673 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.189401:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b7487f06d00) 00010000:00010000:2.0:1786015511.189407:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502845 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.189416:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502845 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.189424:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015511.190645:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+104:2354:x1872772280588544:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1383us (11014us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015511.190663:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 385 00000100:00100000:2.0:1786015511.190713:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 386 00000100:00100000:2.0:1786015511.190729:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+11:2353:x1872772280588288:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015511.190751:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015511.190779:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5027ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c85 expref: 11 pid: 5795 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.190812:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5027ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c85 expref: 11 pid: 5795 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.190843:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5027ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c85 expref: 11 pid: 5795 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.190859:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b7487f06d00) 00010000:00010000:2.0:1786015511.190864:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502845 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.190873:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502845 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.190880:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015511.190938:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:2353:x1872772280588288:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 217us (11443us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015511.190945:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 386 00000100:00100000:2.0:1786015511.190963:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 387 00000100:00100000:2.0:1786015511.190971:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:2354:x1872772280588416:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015511.190987:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015511.190992:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502749 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c3f expref: 48 pid: 5795 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.191002:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502749 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c3f expref: 48 pid: 5795 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.191016:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c502749 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c3f expref: 48 pid: 5795 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.191031:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b7487f06d00) 00010000:00010000:2.0:1786015511.191278:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502845 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.191291:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502845 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.191301:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502845 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.191352:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015511.191381:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2354:x1872772280588416:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 409us (11738us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015511.191388:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 387 00000100:00080000:2.0:1786015511.191429:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786015511.199983:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502845 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.200010:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502845 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786015511.200589:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968154 00000001:00080000:1.0:1786015511.201026:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968155 00000001:00080000:1.0:1786015511.201275:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968156 00000100:00100000:1.0:1786015511.201423:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304442240:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786015511.201525:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015511.201589:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b8e29300 going to sleep for 11 seconds 00000100:00100000:2.0:1786015511.201618:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304442240 00000100:00100000:2.0:1786015511.201631:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304442240 00000100:00100000:2.0:1786015511.201715:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1786015511.201726:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5798:x1872772304442240:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786015511.201863:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5798:x1872772304442240:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 138us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015511.201873:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1786015511.201902:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015511.201981:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304442240:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1786015511.203266:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968157 00000100:00100000:0.0:1786015511.203389:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304442368:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786015511.203479:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015511.203707:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304442368 00000100:00100000:2.0:1786015511.203718:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304442368 00000100:00100000:2.0:1786015511.203931:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1786015511.203942:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5798:x1872772304442368:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786015511.204284:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5798:x1872772304442368:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 342us (802us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1786015511.204291:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1786015511.205242:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7490fcdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1786015511.205300:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304442368:0@lo:1000:mdt_rdpg00_001.0 00010000:00010000:0.0:1786015511.205351:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502845 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.205364:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502845 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.205374:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502845 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.205382:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015511.205389:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502845 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.205399:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502845 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.205422:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b7487f06d00) 00010000:00010000:0.0:1786015511.205426:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1786015511.205432:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502845 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.205439:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502845 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786015511.206073:0:5798:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x4c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1786015511.207295:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].11, 64 off8920 00000004:00080000:0.0:1786015511.207320:0:5798:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 746458558315ns, next at 747458553595ns, rc = 0 00000001:00080000:0.0:1786015511.207343:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968158 00010000:00010000:0.0:1786015511.207428:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b7487f06d00) 00010000:00010000:0.0:1786015511.207433:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786015511.207446:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502830 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ca1 expref: 108 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015511.209434:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916af450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+107:30777:x1872772280588160:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 54320us (55000us total) trans 4294968159 rc 0/0 00000100:00100000:0.0:1786015511.209454:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 260 00000020:00080000:0.0:1786015511.209464:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:1.0:1786015511.213533:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304442880:0@lo:400:kworker.0 00000100:00100000:1.0:1786015511.213637:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015511.213697:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1786015511.213704:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304442496:0@lo:400:kworker.0 00000100:00100000:1.0:1786015511.213741:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015511.213792:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304443008:0@lo:400:kworker.0 00000100:00100000:1.0:1786015511.213822:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015511.213858:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304442880 00000100:00100000:1.0:1786015511.213868:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304442880 00000100:00100000:1.0:1786015511.213936:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1786015511.213947:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304442880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015511.214093:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304442624:0@lo:400:kworker.0 00000100:00100000:0.0:1786015511.214201:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015511.214228:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786015511.214234:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304442752:0@lo:400:kworker.0 00000100:00100000:0.0:1786015511.214260:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015511.214293:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304442624 00000100:00100000:0.0:1786015511.214297:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304442624 00000100:00100000:0.0:1786015511.214324:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304442752 00000100:00100000:0.0:1786015511.214337:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304442752 00000100:00100000:0.0:1786015511.214357:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1786015511.214364:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304442624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015511.214406:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304442624:12345-0@lo:400:kworker.0 Request processed in 42us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015511.215576:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1786015511.215619:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:0.0:1786015511.215632:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304442752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015511.215708:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304442752:12345-0@lo:400:kworker.0 Request processed in 79us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015511.215714:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:0.0:1786015511.215800:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304442752:0@lo:400:kworker.0 00000100:00100000:0.0:1786015511.215814:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304442624:0@lo:400:kworker.0 00000100:00100000:1.0:1786015511.215947:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304442880:12345-0@lo:400:kworker.0 Request processed in 2000us (2309us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015511.215957:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1786015511.216070:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304442496 00000100:00100000:1.0:1786015511.216077:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304442496 00000100:00100000:1.0:1786015511.216573:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1786015511.216583:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304442496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015511.216636:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304442496:12345-0@lo:400:kworker.0 Request processed in 55us (2894us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015511.216642:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1786015511.216685:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304443008 00000100:00100000:1.0:1786015511.216691:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304443008 00000100:00100000:1.0:1786015511.216730:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1786015511.216737:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304443008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015511.216801:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304443008:12345-0@lo:400:kworker.0 Request processed in 65us (2978us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015511.216808:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00080000:1.0:1786015511.216838:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015511.216845:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015511.216940:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304442496:0@lo:400:kworker.0 00000100:00100000:0.0:1786015511.216954:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967375 gen 2 00000004:00080000:0.0:1786015511.216961:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967375 committed transno 4294967375 00000100:00100000:0.0:1786015511.216990:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304443008:0@lo:400:kworker.0 00000100:00100000:0.0:1786015511.217007:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304442880:0@lo:400:kworker.0 00000100:00100000:1.0:1786015511.266807:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015511.267069:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280588800 00000100:00100000:0.0:1786015511.267084:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280588800 00000100:00100000:0.0:1786015511.267168:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1291 00000100:00100000:0.0:1786015511.267181:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+107:30780:x1872772280588800:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015511.267217:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015511.267252:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50284c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ca8 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.267377:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502853 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.267395:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502853 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.267410:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502853 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.267429:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50285a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.267437:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50285a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.267443:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50285a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.267974:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502861 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.267984:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.267991:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015511.268004:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00010000:00010000:0.0:1786015511.268128:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502853 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.268136:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502853 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.268143:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502853 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.268149:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015511.268154:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502853 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.268165:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502853 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.268179:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:0.0:1786015511.268183:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015511.268188:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502853 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.268193:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502853 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.268208:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50285a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.268214:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50285a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.268220:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50285a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.268226:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015511.268229:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50285a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.268235:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50285a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.268243:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff8b748f24a300) 00010000:00010000:0.0:1786015511.268245:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015511.268248:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50285a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.268259:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50285a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.268315:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50284c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ca8 expref: 110 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.268342:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502861 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ca8 expref: 109 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.268350:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f24ac00) 00010000:00010000:0.0:1786015511.268353:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015511.268355:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd000, rc 0) 00000100:00100000:0.0:1786015511.268451:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+109:30780:x1872772280588800:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1271us (1702us total) trans 4294968160 rc 0/0 00000100:00100000:0.0:1786015511.268460:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1291 00000100:00100000:2.0:1786015511.274955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015511.275064:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280588928 00000100:00100000:0.0:1786015511.275078:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280588928 00000100:00100000:0.0:1786015511.275162:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1292 00000100:00100000:0.0:1786015511.275174:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+109:30780:x1872772280588928:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:0.0:1786015511.275282:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50286f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.275316:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50286f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.275340:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50286f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.275387:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50286f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.275394:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50286f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.275410:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50286f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.275419:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015511.275425:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50286f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.275433:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50286f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.275449:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f24ac00) 00010000:00010000:0.0:1786015511.275454:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015511.275460:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50286f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015511.275466:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c50286f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015511.275577:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+109:30780:x1872772280588928:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 403us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015511.275586:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1292 00000100:00100000:3.0:1786015511.283744:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015511.283874:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280589184 00000100:00100000:1.0:1786015511.283888:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280589184 00000100:00100000:1.0:1786015511.283987:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 261 00000100:00100000:1.0:1786015511.284000:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+109:30780:x1872772280589184:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:1.0:1786015511.284355:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+110:30780:x1872772280589184:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 357us (625us total) trans 4294968161 rc 0/0 00000100:00100000:1.0:1786015511.284363:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 261 00010000:00010000:1.0:1786015511.404220:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015511.478074:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015511.478175:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280589312 00000100:00100000:1.0:1786015511.478189:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280589312 00000100:00100000:1.0:1786015511.478353:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1293 00000100:00100000:1.0:1786015511.478367:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30755:x1872772280589312:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1786015511.478654:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30755:x1872772280589312:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 289us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015511.478664:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1293 00000100:00100000:1.0:1786015511.487378:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015511.487500:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280589568 00000100:00100000:2.0:1786015511.487525:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280589568 00000100:00100000:2.0:1786015511.487629:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 262 00000100:00100000:2.0:1786015511.487641:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30755:x1872772280589568:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015511.488732:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+11:30755:x1872772280589568:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1085us (1363us total) trans 4294968162 rc 0/0 00000100:00100000:2.0:1786015511.488744:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 262 00000100:00100000:1.0:1786015511.724288:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304443136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015511.724409:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015511.724808:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304443136 00000100:00100000:0.0:1786015511.724822:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304443136 00000100:00100000:0.0:1786015511.724891:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1786015511.724903:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304443136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015511.724952:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86704128 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015511.725015:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304443136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015511.725023:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1786015511.725274:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304443136:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1786015511.812270:0:7497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 15271907-a1cf-47fa-aa4f-97fea3c6cdd8 00000100:00100000:3.0:1786015511.834102:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015511.834397:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280589824 00000100:00100000:2.0:1786015511.834413:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280589824 00000100:00100000:2.0:1786015511.834497:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1294 00000100:00100000:2.0:1786015511.834520:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+110:30801:x1872772280589824:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1786015511.834556:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015511.834587:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060c00/0xb1a5ef690c502876 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8caf expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.834737:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061a00/0xb1a5ef690c50287d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.834756:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061a00/0xb1a5ef690c50287d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.834821:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061a00/0xb1a5ef690c50287d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015511.834838:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00010000:00010000:2.0:1786015511.835012:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060c00/0xb1a5ef690c502876 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8caf expref: 113 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.835035:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061a00/0xb1a5ef690c50287d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8caf expref: 112 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.835047:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f24ac00) 00010000:00010000:2.0:1786015511.835050:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015511.835055:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488061a00, rc 0) 00000100:00100000:2.0:1786015511.835129:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+112:30801:x1872772280589824:12345-192.168.202.56@tcp:101:cat.0 Request processed in 622us (1042us total) trans 4294968163 rc 0/0 00000100:00100000:2.0:1786015511.835137:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1294 00000100:00100000:1.0:1786015511.842934:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015511.843055:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280589952 00000100:00100000:2.0:1786015511.843069:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280589952 00000100:00100000:2.0:1786015511.843173:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:2.0:1786015511.843185:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+112:2351:x1872772280589952:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015511.843207:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015511.843242:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061a00/0xb1a5ef690c50287d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8caf expref: 112 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.843264:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f24ac00) 00010000:00010000:2.0:1786015511.843270:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015511.843358:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+111:2351:x1872772280589952:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 175us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015511.843366:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:1.0:1786015511.848332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015511.849124:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280590208 00000100:00100000:3.0:1786015511.849140:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280590208 00000100:00100000:3.0:1786015511.849237:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:3.0:1786015511.849250:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b006b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+111:30801:x1872772280590208:12345-192.168.202.56@tcp:103:cat.0 00010000:00010000:3.0:1786015511.849272:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015511.849305:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502861 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ca8 expref: 111 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015511.849338:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f24ac00) 00010000:00010000:3.0:1786015511.849352:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015511.849431:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b006b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+110:30801:x1872772280590208:12345-192.168.202.56@tcp:103:cat.0 Request processed in 184us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015511.849440:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:3.0:1786015511.856891:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015511.857110:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280590336 00000100:00100000:1.0:1786015511.857124:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280590336 00000100:00100000:1.0:1786015511.857202:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1295 00000100:00100000:1.0:1786015511.857214:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+110:30801:x1872772280590336:12345-192.168.202.56@tcp:58:cat.0 00010000:00010000:1.0:1786015511.857380:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50288b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.857401:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50288b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015511.857415:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50288b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786015511.857811:0:12526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].38, 136 off13360 00000100:00100000:1.0:1786015511.857929:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+110:30801:x1872772280590336:12345-192.168.202.56@tcp:58:cat.0 Request processed in 716us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015511.857939:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1295 00000100:00100000:1.0:1786015511.864899:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015511.866675:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280590464 00000100:00100000:2.0:1786015511.866697:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280590464 00000100:00100000:2.0:1786015511.866833:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1296 00000100:00100000:2.0:1786015511.866845:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+110:30801:x1872772280590464:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1786015511.866875:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015511.866905:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060c00/0xb1a5ef690c502892 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8cb6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.866986:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50288b lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.866998:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060c00/0xb1a5ef690c502892 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cb6 expref: 111 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.867022:0:5794:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50288b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.867038:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060c00/0xb1a5ef690c502892 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cb6 expref: 111 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.867055:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f194900) 00010000:00010000:2.0:1786015511.867058:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015511.867062:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060c00/0xb1a5ef690c502892 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cb6 expref: 111 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015511.867079:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488060c00, rc 0) 00000100:00100000:2.0:1786015511.867160:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+111:30801:x1872772280590464:12345-192.168.202.56@tcp:101:cat.0 Request processed in 318us (2288us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015511.867168:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1296 00000040:00080000:3.0:1786015511.980328:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015511.980344:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015511.980402:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 39 count 6 00000040:00080000:3.0:1786015511.980411:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015512.428810:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015513.451997:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015514.175058:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015514.175117:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015514.175148:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015514.175188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015514.175218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015514.175246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015514.175269:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015514.175288:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015514.175317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015514.175340:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015514.175374:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280590720 00000100:00100000:2.0:1786015514.175387:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280590720 00000100:00100000:3.0:1786015514.175394:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280590976 00000100:00100000:3.0:1786015514.175402:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280590976 00000100:00100000:3.0:1786015514.175461:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280591232 00000100:00100000:3.0:1786015514.175464:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280591232 00000100:00100000:2.0:1786015514.175466:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280591488 00000100:00100000:2.0:1786015514.175471:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280591488 00000100:00100000:3.0:1786015514.175488:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280591744 00000100:00100000:3.0:1786015514.175493:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280591744 00000100:00100000:2.0:1786015514.175512:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 509 00000100:00100000:3.0:1786015514.175514:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280590848 00000100:00100000:3.0:1786015514.175518:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280590848 00000100:00100000:2.0:1786015514.175527:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+111:2354:x1872772280590720:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015514.175536:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280591360 00000100:00100000:3.0:1786015514.175540:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280591360 00000100:00100000:3.0:1786015514.175553:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280591616 00000100:00100000:3.0:1786015514.175556:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280591616 00000100:00100000:3.0:1786015514.175576:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 503 00000100:00100000:3.0:1786015514.175585:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+13:2354:x1872772280590976:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015514.175629:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+111:2354:x1872772280590720:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 105us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015514.175630:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+13:2354:x1872772280590976:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 44us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015514.175648:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 503 00000100:00100000:2.0:1786015514.175648:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 509 00000100:00100000:3.0:1786015514.175676:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 504 00000100:00100000:2.0:1786015514.175680:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280591104 00000100:00100000:2.0:1786015514.175685:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280591104 00000100:00100000:3.0:1786015514.175686:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280591232:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015514.175709:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 510 00000100:00100000:2.0:1786015514.175719:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+11:2354:x1872772280591488:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015514.175725:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280591232:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 39us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015514.175733:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 504 00000100:00100000:3.0:1786015514.175747:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 505 00000100:00100000:3.0:1786015514.175754:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+5:2354:x1872772280591744:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015514.175807:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+11:2354:x1872772280591488:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 43us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015514.175815:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 510 00000100:00100000:3.0:1786015514.175826:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+5:2354:x1872772280591744:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 71us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015514.175833:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 511 00000100:00100000:3.0:1786015514.175839:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 505 00000100:00100000:2.0:1786015514.175845:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2354:x1872772280591104:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015514.175858:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 506 00000100:00100000:3.0:1786015514.175866:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280590848:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015514.175878:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2354:x1872772280591104:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015514.175886:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 511 00000100:00100000:3.0:1786015514.175900:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280590848:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015514.175911:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280590592 00000100:00100000:3.0:1786015514.175913:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 506 00000100:00100000:2.0:1786015514.175917:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280590592 00000100:00100000:3.0:1786015514.175931:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 507 00000100:00100000:3.0:1786015514.175939:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280591360:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015514.175951:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 620 00000100:00100000:2.0:1786015514.175961:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+16:2354:x1872772280590592:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015514.175971:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280591360:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015514.175977:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 507 00000100:00100000:2.0:1786015514.175991:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+16:2354:x1872772280590592:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015514.175995:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 508 00000100:00100000:2.0:1786015514.176005:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 620 00000100:00100000:3.0:1786015514.176010:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+5:2354:x1872772280591616:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015514.176036:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+5:2354:x1872772280591616:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015514.176042:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 508 00000100:00080000:1.0:1786015514.176230:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015514.176236:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015514.176239:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786015514.476109:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1786015514.797035:0:6699:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 750048268903ns, next at 751048265561ns, rc = 0 00000100:00100000:1.0:1786015514.797072:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786015514.797100:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304443264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015514.797212:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015514.797749:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304443264 00000100:00100000:3.0:1786015514.797797:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304443264 00000100:00100000:3.0:1786015514.797888:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1786015514.797897:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304443264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015514.797942:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1786015514.798025:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304443264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015514.798033:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:1.0:1786015514.802206:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015514.804049:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304443264:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1786015514.873305:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967366 is committed 00000001:00080000:3.0:1786015514.885638:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968160 is committed 00000004:00080000:3.0:1786015514.885665:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00000020:00080000:3.0:1786015514.885719:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b7484fffd80 refcount 2 committed 0 result 0 batchid 29 00000020:00080000:3.0:1786015514.885726:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74b0987c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b7484fff480 00000020:00080000:3.0:1786015514.885730:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74b0987000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74af0b1400 00000020:00080000:1.0:1786015514.885952:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 29 committed batchid 28 00000020:00080000:1.0:1786015514.886312:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 28 00000004:00080000:3.0:1786015514.886459:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00000100:00100000:1.0:1786015514.886890:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304443392:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786015514.886985:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015514.887258:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304443392 00000100:00100000:0.0:1786015514.887270:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304443392 00000100:00100000:0.0:1786015514.887353:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1786015514.887365:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304443392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1786015514.887405:0:6591:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:25 count 1 00002000:00010000:0.0:1786015514.887452:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 1048576, mtime: 0x6a746f15, atime: 0x0, ctime: 0x6a746f15, blocks: 0x803 00010000:00010000:0.0:1786015514.887463:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c502899 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015514.887496:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=750s v=(0 0) 00010000:00010000:0.0:1786015514.887502:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015514.887510:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c502899 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015514.887531:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c502899 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015514.887543:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c502899 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015514.887556:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c502899 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015514.887580:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786015514.888987:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304443392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1616us (1994us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1786015514.889263:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967366 gen 2 00000004:00080000:2.0:1786015514.889272:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967366 committed transno 4294967366 00000100:00100000:2.0:1786015514.889318:0:3314:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8b7381cc0a80 x1872772304443392/t4294967367(4294967367) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786015530 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1786015514.889335:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b7381cc0a80/2, rc 0, transno 4294967367 00000100:00100000:2.0:1786015514.889341:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304443392:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1786015514.889441:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786015514.889454:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c502899 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015514.889468:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf800 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015514.889482:0:6606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c502899 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015514.889497:0:6606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c502899 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015514.889525:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c502899 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015514.889533:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e244fc83/0xb1a5ef690c502899 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015514.889563:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015514.889566:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015514.889568:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015514.889652:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000001:00080000:3.0:1786015514.890216:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968161 is committed 00000001:00080000:3.0:1786015514.890244:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968148 is committed 00000001:00080000:3.0:1786015514.890260:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968163 is committed 00000001:00080000:3.0:1786015514.890266:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968162 is committed 00000001:00080000:3.0:1786015514.890289:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968147 is committed 00010000:00010000:0.0:1786015515.501627:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015516.077159:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015516.077174:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015516.077999:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 39 count 3 00000040:00080000:3.0:1786015516.078012:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015516.332253:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304443648:0@lo:400:kworker.0 00000100:00100000:0.0:1786015516.332374:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015516.332691:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304443520:0@lo:400:kworker.0 00000100:00100000:2.0:1786015516.332743:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015516.332975:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304443776:0@lo:400:kworker.0 00000100:00100000:0.0:1786015516.338079:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304443648 00000100:00100000:0.0:1786015516.338101:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304443648 00000100:00100000:0.0:1786015516.338206:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1786015516.338218:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304443648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015516.338615:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304443520 00000100:00100000:1.0:1786015516.338620:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304443520 00000100:00100000:1.0:1786015516.338657:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:1.0:1786015516.338666:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304443520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015516.338810:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015516.338890:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786015516.338904:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304444160:0@lo:400:kworker.0 00000100:00100000:3.0:1786015516.338950:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015516.338984:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304443776 00000100:00100000:3.0:1786015516.338987:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304443776 00000100:00100000:3.0:1786015516.339049:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:3.0:1786015516.339058:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304443776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015516.339106:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304443776:12345-0@lo:400:kworker.0 Request processed in 50us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015516.339114:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:3.0:1786015516.339144:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304444160 00000100:00100000:3.0:1786015516.339147:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304444160 00000100:00100000:3.0:1786015516.339180:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1786015516.339187:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304444160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015516.339223:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304444160:12345-0@lo:400:kworker.0 Request processed in 37us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015516.339230:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00080000:3.0:1786015516.339246:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015516.339252:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015516.339291:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304443904:0@lo:400:kworker.0 00000100:00100000:3.0:1786015516.339321:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015516.339352:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015516.339358:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304444032:0@lo:400:kworker.0 00000100:00100000:3.0:1786015516.339382:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015516.339412:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304443904 00000100:00100000:3.0:1786015516.339416:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304443904 00000100:00100000:3.0:1786015516.339449:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:3.0:1786015516.339456:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304443904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015516.339493:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304443904:12345-0@lo:400:kworker.0 Request processed in 37us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015516.339498:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:3.0:1786015516.339516:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304444032 00000100:00100000:3.0:1786015516.339519:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304444032 00000100:00100000:3.0:1786015516.339541:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1786015516.339546:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304444032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015516.339575:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304444032:12345-0@lo:400:kworker.0 Request processed in 28us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015516.339581:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00080000:3.0:1786015516.339593:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015516.339596:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015516.339638:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304444160:0@lo:400:kworker.0 00000100:00100000:3.0:1786015516.339653:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304443776:0@lo:400:kworker.0 00000100:00100000:3.0:1786015516.339691:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304444032:0@lo:400:kworker.0 00000100:00100000:3.0:1786015516.339701:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304443904:0@lo:400:kworker.0 00000100:00100000:0.0:1786015516.346134:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304443648:12345-0@lo:400:kworker.0 Request processed in 7903us (13743us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015516.346154:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:3.0:1786015516.346411:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304443648:0@lo:400:kworker.0 00000100:00100000:1.0:1786015516.350411:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304443520:12345-0@lo:400:kworker.0 Request processed in 11726us (17647us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015516.350435:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:2.0:1786015516.358550:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304443520:0@lo:400:kworker.0 00010000:00010000:3.0:1786015516.525499:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015516.844196:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786015516.844230:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304444288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015516.844399:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015516.844517:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304444288 00000100:00100000:1.0:1786015516.844529:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304444288 00000100:00100000:1.0:1786015516.845051:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1786015516.845065:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304444288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015516.845116:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86704128 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015516.845197:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304444288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015516.845206:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1786015516.845482:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304444288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015516.866589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015516.866817:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280591872 00000100:00100000:1.0:1786015516.866831:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280591872 00000100:00100000:1.0:1786015516.866938:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1297 00000100:00100000:1.0:1786015516.866953:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+46:30804:x1872772280591872:12345-192.168.202.56@tcp:101:stat.0 00010000:00010000:1.0:1786015516.866986:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015516.867029:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c5028a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8cbd expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.867129:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5028a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.867148:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5028a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.867165:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5028a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.867184:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5028ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.867191:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5028ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.867199:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5028ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.867856:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5028b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.867870:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5028b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.867878:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5028b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015516.867929:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00000004:00200000:1.0:1786015516.867935:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015516.867967:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5028b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.867980:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5028b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.867991:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5028a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.868001:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5028a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.868009:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5028a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.868016:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015516.868021:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5028a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.868029:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5028a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.868045:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:1.0:1786015516.868049:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015516.868056:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5028a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.868062:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5028a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.868078:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5028ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.868085:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5028ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.868091:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5028ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.868095:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015516.868099:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5028ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.868106:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5028ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.868113:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff8b748f194600) 00010000:00010000:1.0:1786015516.868115:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015516.868118:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5028ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.868123:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5028ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.868169:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c5028a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cbd expref: 48 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.868185:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5028b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cbd expref: 47 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015516.868193:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f194900) 00010000:00010000:1.0:1786015516.868196:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015516.868199:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921c00, rc 0) 00000100:00100000:1.0:1786015516.868307:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+47:30804:x1872772280591872:12345-192.168.202.56@tcp:101:stat.0 Request processed in 1356us (1740us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015516.868318:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1297 00000100:00080000:3.0:1786015516.869474:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015517.176122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015517.176255:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280592000 00000100:00100000:3.0:1786015517.176283:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280592000 00000100:00100000:3.0:1786015517.176396:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1298 00000100:00100000:3.0:1786015517.176412:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+7:30828:x1872772280592000:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00000100:00080000:0.0:1786015517.176475:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786015517.176743:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015517.176834:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5028bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8cc4 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015517.176938:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5028c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015517.177499:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5028c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015517.177518:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5028c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015517.179944:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1786015517.179959:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 31 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015517.180088:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5028c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015517.180149:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c5028bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cc4 expref: 9 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015517.180177:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5028c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cc4 expref: 8 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015517.180189:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:3.0:1786015517.180193:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015517.180198:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbcc00, rc 0) 00000100:00100000:3.0:1786015517.180827:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+8:30828:x1872772280592000:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 4415us (4715us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015517.180839:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1298 00000100:00100000:1.0:1786015517.193449:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015517.193593:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280592256 00000100:00100000:0.0:1786015517.193610:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280592256 00000100:00100000:0.0:1786015517.193692:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1299 00000100:00100000:0.0:1786015517.193703:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+8:30829:x1872772280592256:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015517.193734:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015517.193801:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5028ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ccb expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.193920:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5028d1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.193938:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5028d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.193952:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5028d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.193970:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.193978:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.193985:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.194549:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5028df lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.194562:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5028df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.194569:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5028df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015517.194581:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1786015517.194816:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5028d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.194825:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5028d1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.194832:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5028d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.194838:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73813bf800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015517.194844:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5028d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.194853:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5028d1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.194868:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b749802e100) 00010000:00010000:0.0:1786015517.194872:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015517.194878:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5028d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.194884:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf800/0xb1a5ef690c5028d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.194899:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.194905:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028d8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.194911:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.194917:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015517.194920:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.194930:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028d8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.194938:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8b748f24a100) 00010000:00010000:0.0:1786015517.194940:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015517.194943:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028d8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.194949:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028d8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.198141:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bf600/0xb1a5ef690c5028ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ccb expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.198180:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5028df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ccb expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015517.198192:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:0.0:1786015517.198195:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015517.198199:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc000, rc 0) 00000100:00100000:0.0:1786015517.198323:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30829:x1872772280592256:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 4619us (4899us total) trans 4294968164 rc 0/0 00000100:00100000:0.0:1786015517.198335:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1299 00000100:00100000:1.0:1786015517.203040:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015517.203329:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280592384 00000100:00100000:2.0:1786015517.203344:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280592384 00000100:00100000:2.0:1786015517.203444:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1300 00000100:00100000:2.0:1786015517.203457:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30829:x1872772280592384:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1786015517.203739:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30829:x1872772280592384:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 284us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015517.203749:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1300 00000100:00100000:1.0:1786015517.204887:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015517.204989:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280592512 00000100:00100000:3.0:1786015517.205001:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280592512 00000100:00100000:3.0:1786015517.205085:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:3.0:1786015517.205098:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:2352:x1872772280592512:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015517.205118:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015517.205159:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5028df lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ccb expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015517.205184:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:3.0:1786015517.205190:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015517.205249:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+9:2352:x1872772280592512:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 154us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015517.205257:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 60 00010000:00010000:0.0:1786015517.548146:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015518.124334:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015518.124350:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015518.124563:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 39 count 3 00000040:00080000:3.0:1786015518.124574:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015518.124977:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304444416:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015518.125276:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359180 going to sleep for 11 seconds 00000100:00100000:1.0:1786015518.149479:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015518.149929:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304444416:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786015518.150946:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280592640 00000100:00100000:0.0:1786015518.150960:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280592640 00000100:00100000:0.0:1786015518.151094:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1301 00000100:00100000:0.0:1786015518.151108:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+9:30830:x1872772280592640:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015518.151154:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x27:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015518.151323:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+9:30830:x1872772280592640:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 218us (1861us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015518.151331:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1301 00000100:00100000:1.0:1786015518.155957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015518.156146:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280592768 00000100:00100000:0.0:1786015518.156161:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280592768 00000100:00100000:0.0:1786015518.156237:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1302 00000100:00100000:0.0:1786015518.156667:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+9:30830:x1872772280592768:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1786015518.156965:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028ed lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.156989:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157005:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157023:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5028f4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157030:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5028f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157036:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5028f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157062:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5028fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157072:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5028fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157079:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5028fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015518.157145:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00000004:00200000:0.0:1786015518.157150:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015518.157169:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5028fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157182:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157189:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028ed lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157196:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028ed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157202:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015518.157208:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028ed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157217:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028ed lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157231:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:0.0:1786015518.157235:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015518.157240:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157248:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5028ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157671:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5028f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157749:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5028f4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157756:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5028f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157819:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015518.157823:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5028f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157831:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5028f4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157842:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4e3552f8 (ffff8b748f24a100) 00010000:00010000:0.0:1786015518.157845:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015518.157849:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5028f4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157855:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c5028f4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157878:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5028fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157884:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5028fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157890:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5028fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157897:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015518.157900:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5028fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157907:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5028fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157915:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f194900) 00010000:00010000:0.0:1786015518.157918:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015518.157921:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5028fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.157927:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5028fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015518.158049:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+9:30830:x1872772280592768:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 1797us (2103us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015518.158061:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1302 00000100:00100000:2.0:1786015518.163308:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015518.163517:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280593024 00000100:00100000:3.0:1786015518.163538:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280593024 00000100:00100000:3.0:1786015518.163693:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1303 00000100:00100000:3.0:1786015518.163707:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+9:30830:x1872772280593024:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015518.163743:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015518.163824:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502902 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8cd2 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.163995:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502909 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.164018:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502909 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.164035:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502909 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015518.164069:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00010000:00010000:3.0:1786015518.164216:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502909 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.164224:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502909 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.164236:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502909 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.164243:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbdc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015518.164248:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502909 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.165194:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502909 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.165217:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f194900) 00010000:00010000:3.0:1786015518.165220:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015518.165226:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502909 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.165234:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c502909 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.166613:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502902 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cd2 expref: 11 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.166648:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:3.0:1786015518.166651:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786015518.166663:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502902 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cd2 expref: 11 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.166741:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd200, rc 0) 00000100:00100000:3.0:1786015518.167072:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30830:x1872772280593024:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 3365us (3779us total) trans 4294968165 rc 301/301 00000100:00100000:3.0:1786015518.167098:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1303 00000100:00100000:3.0:1786015518.175421:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015518.175550:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280593152 00000100:00100000:0.0:1786015518.175563:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280593152 00000100:00100000:0.0:1786015518.175640:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1304 00000100:00100000:0.0:1786015518.175652:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30830:x1872772280593152:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015518.175714:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x27:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015518.179793:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30830:x1872772280593152:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 4109us (4352us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015518.179815:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1304 00000100:00100000:2.0:1786015518.184551:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015518.184718:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280593280 00000100:00100000:0.0:1786015518.184735:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280593280 00000100:00100000:0.0:1786015518.184833:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1305 00000100:00100000:0.0:1786015518.184846:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30830:x1872772280593280:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015518.184877:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015518.184909:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502917 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8cd9 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.185005:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50291e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.185024:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50291e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.185038:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50291e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.185054:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502925 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.185061:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502925 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.185067:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502925 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.187875:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50292c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.187903:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50292c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.187919:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50292c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015518.188023:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 7680 00000004:00200000:0.0:1786015518.188028:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015518.193041:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50292c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.193079:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50291e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.193198:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50291e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.193207:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50291e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.193214:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015518.193219:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50291e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.193230:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50291e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.193363:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015518.193367:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015518.193375:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50291e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.193382:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50291e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.193400:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502925 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.193410:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502925 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.193416:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502925 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.193420:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015518.193423:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502925 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.193430:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502925 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.193438:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28683846 (ffff8b748f24a100) 00010000:00010000:0.0:1786015518.193608:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015518.193613:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502925 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.193620:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502925 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.193758:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502917 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cd9 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.193843:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50292c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cd9 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.193852:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:0.0:1786015518.193856:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786015518.193859:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc000, rc 0) 00000100:00100000:0.0:1786015518.194040:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+11:30830:x1872772280593280:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 9194us (9500us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015518.194052:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1305 00000100:00100000:2.0:1786015518.202291:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015518.202394:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280593408 00000100:00100000:0.0:1786015518.202409:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280593408 00000100:00100000:0.0:1786015518.202493:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:0.0:1786015518.202506:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+11:30830:x1872772280593408:12345-192.168.202.56@tcp:700:lhsmtool_posix.0 00000100:00100000:0.0:1786015518.202625:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+11:30830:x1872772280593408:12345-192.168.202.56@tcp:700:lhsmtool_posix.0 Request processed in 121us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015518.202634:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:3.0:1786015518.225233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015518.225360:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280593664 00000100:00100000:2.0:1786015518.225376:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280593664 00000100:00100000:2.0:1786015518.225740:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1306 00000100:00100000:2.0:1786015518.225756:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+11:30830:x1872772280593664:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015518.225840:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015518.225873:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502933 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ce0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.227299:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c50293a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.227321:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c50293a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.227339:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c50293a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015518.227352:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 0 00010000:00010000:2.0:1786015518.227431:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502933 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ce0 expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.227460:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c50293a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ce0 expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.227471:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8b7487f06300) 00010000:00010000:2.0:1786015518.227476:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015518.227480:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488060200, rc 0) 00000100:00100000:2.0:1786015518.227585:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+13:30830:x1872772280593664:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1833us (2367us total) trans 4294968166 rc 0/0 00000100:00100000:2.0:1786015518.227595:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1306 00000100:00100000:2.0:1786015518.236457:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015518.236607:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280593920 00000100:00100000:0.0:1786015518.236621:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280593920 00000100:00100000:0.0:1786015518.236712:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1307 00000100:00100000:0.0:1786015518.236724:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+13:30830:x1872772280593920:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786015518.236838:0:12526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015518.236875:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c50293a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ce0 expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.236898:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8b7487f06300) 00010000:00010000:0.0:1786015518.236912:0:12526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015518.236947:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502948 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.236963:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5027d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c77 expref: 98 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.236979:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502948 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.237027:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5027d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c77 expref: 98 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.237045:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5027d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c77 expref: 98 pid: 5795 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015518.237062:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304444544:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015518.237176:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174900 going to sleep for 11 seconds 00000100:00100000:0.0:1786015518.245150:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304444544:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015518.245199:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502948 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015518.251187:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015518.251328:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280594048 00000100:00100000:0.0:1786015518.251342:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280594048 00010000:00010000:0.0:1786015518.251434:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5027d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c77 expref: 99 pid: 5795 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015518.251500:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 388 00000100:00100000:0.0:1786015518.251522:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+99:2354:x1872772280594048:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015518.251544:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015518.251553:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5027d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c77 expref: 99 pid: 5795 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.251574:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5027d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c77 expref: 99 pid: 5795 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.251601:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c5027d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c77 expref: 99 pid: 5795 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.251620:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:0.0:1786015518.251626:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502948 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.251637:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502948 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.251645:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502948 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786015518.251874:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786015518.251944:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015518.252017:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+98:2354:x1872772280594048:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 506us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015518.252027:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 388 00010000:00010000:2.0:1786015518.252910:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502948 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.252925:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502948 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.252963:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c50294f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4b:0x0].0x6a8c829d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.252974:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c50294f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x6a8c829d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.252985:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c50294f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x6a8c829d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.253972:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502948 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.253992:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502948 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.254000:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502948 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.254006:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015518.254011:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502948 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.254019:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502948 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.254036:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:2.0:1786015518.254039:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015518.254045:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502948 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.254051:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c502948 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.254067:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c50294f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x6a8c829d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.254074:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c50294f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x6a8c829d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.254079:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c50294f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x6a8c829d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.254087:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015518.254090:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c50294f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x6a8c829d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.254096:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c50294f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x6a8c829d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.254102:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x6a8c829d (ffff8b7487f06700) 00010000:00010000:2.0:1786015518.254105:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015518.254108:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c50294f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x6a8c829d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.254114:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c50294f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x6a8c829d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015518.254321:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+12:30830:x1872772280593920:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 17593us (17882us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786015518.254331:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1307 00000100:00100000:2.0:1786015518.267275:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015518.268077:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280594176 00000100:00100000:0.0:1786015518.268095:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280594176 00000100:00100000:0.0:1786015518.268178:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1308 00000100:00100000:0.0:1786015518.268191:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+12:30830:x1872772280594176:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015518.268221:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015518.268267:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502956 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ce7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.268328:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50295d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.268345:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50295d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.268369:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50295d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.268921:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c502956 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ce7 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.268945:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50295d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ce7 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.268956:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:0.0:1786015518.268959:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015518.268963:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afcc00, rc 0) 00000100:00100000:0.0:1786015518.269187:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+13:30830:x1872772280594176:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 997us (1940us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015518.269197:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1308 00000100:00100000:0.0:1786015518.293419:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015518.293611:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280594432 00000100:00100000:2.0:1786015518.293626:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280594432 00000100:00100000:2.0:1786015518.293718:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1309 00000100:00100000:2.0:1786015518.293729:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+13:30830:x1872772280594432:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786015518.293904:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502964 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.293928:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502964 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.293943:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502964 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015518.294227:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017fc1fbd reply state 000000008a015271 transno 4294968167 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502964 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015518.294239:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786015518.294408:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+15:30830:x1872772280594432:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 679us (1002us total) trans 4294968167 rc 0/0 00000100:00100000:2.0:1786015518.294417:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1309 00010000:00010000:1.0:1786015518.302089:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502964 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.302114:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502964 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.302123:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502964 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.302131:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015518.302138:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502964 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.302149:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502964 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.302175:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:1.0:1786015518.302179:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786015518.302186:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502964 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.302192:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502964 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015518.309752:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015518.310172:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280594560 00000100:00100000:2.0:1786015518.310187:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280594560 00000100:00100000:3.0:1786015518.310374:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1310 00000100:00100000:3.0:1786015518.310392:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+14:30830:x1872772280594560:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015518.310432:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015518.310464:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50296b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8cee expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.310562:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50296b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cee expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.310582:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50296b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cee expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.310593:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:3.0:1786015518.310596:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015518.310601:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbce00, rc 0) 00000100:00100000:3.0:1786015518.310757:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+15:30830:x1872772280594560:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 370us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015518.310792:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1310 00000100:00100000:0.0:1786015518.315087:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015518.315202:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280594688 00000100:00100000:2.0:1786015518.315216:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280594688 00000100:00100000:2.0:1786015518.315388:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 263 00000100:00100000:2.0:1786015518.315400:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+15:30830:x1872772280594688:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1786015518.315635:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+15:30830:x1872772280594688:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 Request processed in 236us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015518.315643:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 263 00000100:00100000:0.0:1786015518.330925:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015518.331043:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280594944 00000100:00100000:2.0:1786015518.331056:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280594944 00000100:00100000:2.0:1786015518.331156:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 264 00000100:00100000:2.0:1786015518.331170:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+15:30830:x1872772280594944:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015518.331547:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+16:30830:x1872772280594944:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 379us (637us total) trans 4294968168 rc 0/0 00000100:00100000:2.0:1786015518.331556:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 264 00000100:00100000:2.0:1786015518.335277:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015518.335668:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280595200 00000100:00100000:0.0:1786015518.335692:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280595200 00000100:00100000:0.0:1786015518.335817:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1311 00000100:00100000:0.0:1786015518.335830:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+16:30830:x1872772280595200:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015518.335997:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+16:30830:x1872772280595200:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 169us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015518.336006:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1311 00000100:00100000:0.0:1786015518.345952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015518.346091:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280595456 00000100:00100000:1.0:1786015518.346107:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280595456 00000100:00100000:1.0:1786015518.346204:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1312 00000100:00100000:1.0:1786015518.346218:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+16:30830:x1872772280595456:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015518.346640:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015518.346677:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502972 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8cf5 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.348272:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502979 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.348304:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50296b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cee expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.348314:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502979 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.348566:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50296b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cee expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.348589:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50296b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cee expref: 17 pid: 5794 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015518.348609:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304444672:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015518.348945:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486540780 going to sleep for 11 seconds 00000100:00100000:3.0:1786015518.359602:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015518.359725:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280595584 00000100:00100000:0.0:1786015518.359739:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280595584 00010000:00010000:0.0:1786015518.359830:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50296b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cee expref: 18 pid: 5794 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015518.359885:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 389 00000100:00100000:0.0:1786015518.359898:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+18:2353:x1872772280595584:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015518.359919:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015518.359929:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50296b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cee expref: 18 pid: 5794 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.359945:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50296b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cee expref: 18 pid: 5794 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.359977:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:0.0:1786015518.359983:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502979 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.359994:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502979 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.360002:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502979 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.360026:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015518.360096:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+18:2353:x1872772280595584:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 200us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015518.360105:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 389 00010000:00010000:2.0:1786015518.360548:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c50296b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cee expref: 17 pid: 5794 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015518.360572:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304444672:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015518.360602:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502979 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.360613:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502979 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.360619:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502979 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015518.360644:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 0 00000004:00080000:2.0:1786015518.361185:0:7673:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c:0x0], index 1: 0 00010000:00010000:2.0:1786015518.362043:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502979 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.362057:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502979 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.362066:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502979 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.362072:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015518.362078:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502979 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.362086:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502979 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.362105:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:2.0:1786015518.362108:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015518.362114:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502979 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.362121:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502979 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.362201:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502972 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cf5 expref: 17 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.362213:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:2.0:1786015518.362216:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786015518.362220:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502972 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cf5 expref: 17 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.362247:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920000, rc 0) 00000100:00100000:2.0:1786015518.362413:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+16:30830:x1872772280595456:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 16197us (16478us total) trans 4294968169 rc 301/301 00000100:00100000:2.0:1786015518.362424:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1312 00000100:00100000:3.0:1786015518.366988:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015518.367360:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280595840 00000100:00100000:2.0:1786015518.367377:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280595840 00000100:00100000:2.0:1786015518.367481:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 265 00000100:00100000:2.0:1786015518.367493:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+16:30830:x1872772280595840:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015518.368012:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+17:30830:x1872772280595840:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 519us (1035us total) trans 4294968170 rc 0/0 00000100:00100000:2.0:1786015518.368021:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 265 00000100:00100000:0.0:1786015518.372605:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015518.372803:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280595968 00000100:00100000:2.0:1786015518.372817:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280595968 00000100:00100000:2.0:1786015518.372893:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1313 00000100:00100000:2.0:1786015518.372906:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+17:30830:x1872772280595968:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015518.372941:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015518.372970:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502987 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8cfc expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.373074:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c50298e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.373092:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c50298e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.373106:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c50298e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015518.373151:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 0 00000004:00200000:2.0:1786015518.373155:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015518.373177:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c50298e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.373205:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502987 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cfc expref: 19 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.373226:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c50298e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cfc expref: 18 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.373236:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:2.0:1786015518.373239:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786015518.373242:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488061000, rc 0) 00000100:00100000:2.0:1786015518.373331:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+18:30830:x1872772280595968:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 428us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015518.373339:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1313 00000100:00100000:1.0:1786015518.380491:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015518.380972:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280596096 00000100:00100000:0.0:1786015518.380988:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280596096 00000100:00080000:3.0:1786015518.381103:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015518.381234:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 358 00000100:00100000:3.0:1786015518.381270:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+5:2353:x1872772280596096:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015518.381298:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015518.381333:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c502995 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d03 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015518.381374:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786015518.381402:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=753s v=(0 0) 00010000:00010000:3.0:1786015518.381409:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015518.381422:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c502995 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d03 expref: 6 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.381444:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c502995 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d03 expref: 6 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.381461:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbce00, rc 0) 00000100:00100000:3.0:1786015518.381551:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:2353:x1872772280596096:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 305us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015518.381559:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 358 00000100:00100000:0.0:1786015518.388193:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015518.388343:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280596352 00000100:00100000:2.0:1786015518.388367:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280596352 00000100:00100000:2.0:1786015518.388483:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1314 00000100:00100000:2.0:1786015518.388496:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+18:30830:x1872772280596352:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015518.388667:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+18:30830:x1872772280596352:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 173us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015518.388675:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1314 00000100:00100000:0.0:1786015518.406222:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015518.406317:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280596480 00000100:00100000:3.0:1786015518.406331:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280596480 00000100:00100000:3.0:1786015518.406415:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 359 00000100:00100000:3.0:1786015518.406439:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:30830:x1872772280596480:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015518.406467:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015518.406494:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c50299c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d0a expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.407184:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c502995 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d03 expref: 7 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.407195:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015518.407201:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015518.407208:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c50299c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d0a expref: 7 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.407365:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c502995 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d03 expref: 7 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.407383:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c502995 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d03 expref: 7 pid: 6590 timeout: 853 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015518.407401:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304444800:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015518.407653:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359180 going to sleep for 11 seconds 00000100:00100000:3.0:1786015518.414697:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304444800:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015518.414748:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c50299c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d0a expref: 7 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.414820:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbde00, rc 0) 00000100:00100000:3.0:1786015518.414898:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+7:30830:x1872772280596480:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 8461us (8691us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015518.414909:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 359 00000100:00100000:1.0:1786015518.415074:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015518.416706:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280596608 00000100:00100000:3.0:1786015518.416725:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280596608 00010000:00010000:3.0:1786015518.417028:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c502995 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d03 expref: 7 pid: 6590 timeout: 853 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015518.417090:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 390 00000100:00100000:3.0:1786015518.417103:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+7:2354:x1872772280596608:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015518.417125:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015518.417228:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c502995 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d03 expref: 7 pid: 6590 timeout: 853 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.417246:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c502995 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d03 expref: 7 pid: 6590 timeout: 853 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.417289:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f96dbd/0xb1a5ef690c502995 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d03 expref: 7 pid: 6590 timeout: 853 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.417312:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015518.417318:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015518.417329:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c50299c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d0a expref: 6 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.417341:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c50299c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d0a expref: 6 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.417548:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c50299c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d0a expref: 6 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015518.417568:0:5781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1872772304444928:192.168.202.56@tcp:105: 00000100:00100000:3.0:1786015518.417702:0:5781:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359180 going to sleep for 11 seconds 00000100:00100000:3.0:1786015518.422697:0:5781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1872772304444928:192.168.202.56@tcp:105: 00010000:00010000:3.0:1786015518.422736:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015518.422851:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:2354:x1872772280596608:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 5749us (7777us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015518.422865:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 390 00000100:00100000:1.0:1786015518.470646:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015518.471104:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280596736 00000100:00100000:3.0:1786015518.471119:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280596736 00002000:00100000:3.0:1786015518.471201:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1c:0x0] (0->1048575) req@ffff8b74aef03480 x1872772280596736/t0(0) o4->15271907-a1cf-47fa-aa4f-97fea3c6cdd8@192.168.202.56@tcp:364/0 lens 488/0 e 0 to 0 dl 1786015529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015518.471216:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aef03480 with x1872772280596736 ext(0->1048575) 00002000:00010000:3.0:1786015518.471224:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74aef03480 00000100:00100000:3.0:1786015518.471276:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 113 00000100:00100000:3.0:1786015518.471288:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:2352:x1872772280596736:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1786015518.503662:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+8:2352:x1872772280596736:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 32359us (33015us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1786015518.503686:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 113 00002000:00100000:2.0:1786015518.503705:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1c:0x0] (0->1048575) req@ffff8b74aef03480 x1872772280596736/t4294967376(0) o4->15271907-a1cf-47fa-aa4f-97fea3c6cdd8@192.168.202.56@tcp:364/0 lens 488/448 e 0 to 0 dl 1786015529 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015518.503718:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aef03480 with x1872772280596736 ext(0->1048575) 00002000:00010000:2.0:1786015518.503727:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74aef03480 00000100:00100000:0.0:1786015518.507980:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015518.508067:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280596864 00000100:00100000:2.0:1786015518.508080:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280596864 00000100:00100000:2.0:1786015518.508194:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1315 00000100:00100000:2.0:1786015518.508207:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+18:30830:x1872772280596864:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1786015518.547210:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968164 is committed 00000020:00080000:1.0:1786015518.547239:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 29 batchid updated 00000001:00080000:1.0:1786015518.547267:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968170 is committed 00000020:00080000:3.0:1786015518.547627:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 29 00000020:00080000:3.0:1786015518.547642:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 29 00000100:00100000:3.0:1786015518.550219:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+11:30830:x1872772280596864:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 41998us (42236us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015518.550237:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1315 00000100:00100000:0.0:1786015518.553603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015518.553801:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280596992 00000100:00100000:3.0:1786015518.553815:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280596992 00000100:00100000:3.0:1786015518.554097:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 360 00000100:00100000:3.0:1786015518.554110:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+8:2351:x1872772280596992:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1786015518.572728:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786015518.596576:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967376 is committed 00000100:00100000:0.0:1786015518.596950:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:2351:x1872772280596992:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 42833us (43353us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015518.596966:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 360 00000100:00100000:1.0:1786015518.599962:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015518.600061:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280597248 00000100:00100000:0.0:1786015518.600076:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280597248 00000100:00100000:0.0:1786015518.600154:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1316 00000100:00100000:0.0:1786015518.600166:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+11:30830:x1872772280597248:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786015518.600249:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015518.600297:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c50298e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cfc expref: 11 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.600322:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:0.0:1786015518.600328:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015518.600370:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029a3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.600394:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029a3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.600406:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029a3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015518.600683:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000018f4ccd3 reply state 00000000852610de transno 4294968171 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029a3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015518.600695:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015518.602121:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+12:30830:x1872772280597248:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 1942us (2158us total) trans 4294968171 rc 0/0 00000100:00100000:0.0:1786015518.602137:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1316 00000100:00100000:1.0:1786015518.605743:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015518.605967:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280597376 00000100:00100000:2.0:1786015518.605981:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280597376 00000100:00100000:2.0:1786015518.606064:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1317 00000100:00100000:2.0:1786015518.606077:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+12:30830:x1872772280597376:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015518.606113:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015518.606142:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c5029aa lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d11 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.606229:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c5029aa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d11 expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.606247:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c5029aa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d11 expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.606283:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:2.0:1786015518.606288:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015518.606294:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488061c00, rc 0) 00000100:00100000:2.0:1786015518.606376:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+13:30830:x1872772280597376:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 302us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015518.606386:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1317 00010000:00010000:0.0:1786015518.607662:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029a3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.607680:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029a3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.607687:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029a3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.607694:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015518.607700:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029a3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.607710:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029a3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.607731:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:0.0:1786015518.607735:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015518.607740:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029a3 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.607747:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029a3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015518.610506:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015518.610720:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280597504 00000100:00100000:3.0:1786015518.610734:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280597504 00000100:00100000:3.0:1786015518.610844:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 361 00000100:00100000:3.0:1786015518.610857:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:2351:x1872772280597504:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1786015518.611215:0:6590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1786015518.611219:0:6590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb mtime from disk: 0 -> 1786015509 00002000:00010000:3.0:1786015518.611222:0:6590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb atime from disk: 0 -> 1786015509 00002000:00010000:3.0:1786015518.611224:0:6590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb ctime from disk: 0 -> 1786015509 00002000:00010000:3.0:1786015518.611226:0:6590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 1 -> 2051 00000100:00100000:3.0:1786015518.611317:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+7:2351:x1872772280597504:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 463us (829us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1786015518.611326:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 361 00000100:00100000:3.0:1786015518.614984:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015518.615193:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280597760 00000100:00100000:1.0:1786015518.615207:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280597760 00000100:00100000:1.0:1786015518.615295:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1318 00000100:00100000:1.0:1786015518.615309:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+12:30830:x1872772280597760:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1786015518.615415:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5029b1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.615446:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50295d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ce7 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.615457:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5029b1 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.615505:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50295d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ce7 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.615521:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50295d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ce7 expref: 12 pid: 5796 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015518.615539:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304445056:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015518.615659:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0023f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786015518.620013:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015518.620201:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280597888 00000100:00100000:3.0:1786015518.620213:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280597888 00010000:00010000:3.0:1786015518.620280:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50295d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ce7 expref: 13 pid: 5796 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015518.620326:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 391 00000100:00100000:3.0:1786015518.620336:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+13:2354:x1872772280597888:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015518.620362:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015518.620371:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50295d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ce7 expref: 13 pid: 5796 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.620385:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50295d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ce7 expref: 13 pid: 5796 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.620416:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:3.0:1786015518.620423:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5029b1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.620435:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5029b1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.620454:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5029b1 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.620481:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015518.620558:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+13:2354:x1872772280597888:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 223us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015518.620567:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 391 00010000:00010000:1.0:1786015518.621400:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50295d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ce7 expref: 12 pid: 5796 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015518.621426:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304445056:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015518.621467:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5029b1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.621478:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5029b1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.621485:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5029b1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.621527:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5029b1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.621535:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5029b1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.621542:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5029b1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.621549:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015518.621554:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5029b1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.621566:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5029b1 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.621580:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:1.0:1786015518.621584:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1786015518.621588:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5029b1 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.621595:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c5029b1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015518.621676:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+11:30830:x1872772280597760:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 6370us (6706us total) trans 0 rc -22/-22 00000100:00100000:1.0:1786015518.621686:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1318 00000100:00100000:0.0:1786015518.627623:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015518.627811:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280598016 00000100:00100000:1.0:1786015518.627837:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280598016 00000100:00100000:1.0:1786015518.627908:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 362 00000100:00100000:1.0:1786015518.627921:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+7:2352:x1872772280598016:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015518.627987:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5029b8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.628017:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c50299c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d0a expref: 7 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.628028:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015518.628033:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015518.628038:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5029b8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.628090:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c50299c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d0a expref: 7 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.628108:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c50299c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d0a expref: 7 pid: 11384 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015518.628127:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef02a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304445184:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015518.628242:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0023f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015518.636656:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef02a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304445184:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015518.636710:0:11384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5029b8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015518.637572:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015518.637953:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280598144 00000100:00100000:3.0:1786015518.637967:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280598144 00010000:00010000:3.0:1786015518.638029:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c50299c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d0a expref: 8 pid: 11384 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015518.638073:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 392 00000100:00100000:3.0:1786015518.638085:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+8:2353:x1872772280598144:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015518.638106:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015518.638139:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c50299c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d0a expref: 8 pid: 11384 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.638239:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c50299c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d0a expref: 8 pid: 11384 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.638309:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c50299c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d0a expref: 8 pid: 11384 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.638335:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015518.638410:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015518.638420:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5029b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.638432:0:17038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5029b8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.638537:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015518.638621:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+7:2353:x1872772280598144:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 538us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015518.638631:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 392 00010000:00010000:1.0:1786015518.639109:0:11384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5029b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.639123:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5029b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.639307:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5029b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.639317:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5029b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.639331:0:11384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5029b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.639340:0:11384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920e00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015518.639354:0:11384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5029b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.639364:0:11384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5029b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.639379:0:11384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5029b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.639388:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5029b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015518.639596:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:2352:x1872772280598016:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 11676us (11987us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015518.639609:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 362 00000100:00100000:2.0:1786015518.645315:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015518.645506:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280598400 00000100:00100000:3.0:1786015518.645522:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280598400 00000100:00100000:3.0:1786015518.645609:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1319 00000100:00100000:3.0:1786015518.645624:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+11:30830:x1872772280598400:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786015518.645752:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5029bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.645814:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5029bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.645840:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5029bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.646140:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5029c6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.646314:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c5029aa lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d11 expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.646322:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5029c6 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.646449:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c5029aa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d11 expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.646470:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c5029aa lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d11 expref: 12 pid: 5794 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015518.646492:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304445312:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015518.646622:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b13f0480 going to sleep for 11 seconds 00000100:00100000:2.0:1786015518.650704:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015518.650890:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304445312:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015518.650930:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5029c6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015518.651669:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280598528 00000100:00100000:1.0:1786015518.651681:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280598528 00010000:00010000:1.0:1786015518.651737:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c5029aa lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d11 expref: 13 pid: 5794 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015518.652287:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 393 00000100:00100000:3.0:1786015518.652306:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+13:2353:x1872772280598528:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015518.652328:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015518.652338:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c5029aa lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d11 expref: 13 pid: 5794 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.652559:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c5029aa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d11 expref: 13 pid: 5794 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.652589:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c5029aa lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d11 expref: 13 pid: 5794 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.652611:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:3.0:1786015518.652617:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5029c6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.652628:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5029c6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.652637:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5029c6 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.652676:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015518.652933:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5029c6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.652944:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5029c6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015518.653429:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+12:2353:x1872772280598528:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1127us (2747us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015518.653450:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 393 00000001:00080000:0.0:1786015518.655290:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968172 00000001:00080000:0.0:1786015518.655608:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968173 00000001:00080000:0.0:1786015518.655676:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968174 00000100:00100000:0.0:1786015518.657934:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304445440:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786015518.658059:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015518.658114:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482b33d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786015518.658285:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304445440 00000100:00100000:3.0:1786015518.658298:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304445440 00000100:00100000:3.0:1786015518.658404:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1786015518.658416:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1872772304445440:12345-0@lo:1000:mdt00_001.0 00000100:00080000:1.0:1786015518.658644:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015518.659524:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1872772304445440:12345-0@lo:1000:mdt00_001.0 Request processed in 1105us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015518.659535:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1786015518.659627:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304445440:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1786015518.660657:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968175 00000100:00100000:0.0:1786015518.660951:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304445568:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786015518.661232:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015518.661317:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c13186c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015518.661418:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304445568 00000100:00100000:3.0:1786015518.661427:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304445568 00000100:00100000:3.0:1786015518.661544:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1786015518.661554:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748736ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1872772304445568:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786015518.662016:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748736ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5795:x1872772304445568:12345-0@lo:1000:mdt00_001.0 Request processed in 462us (783us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1786015518.662025:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1786015518.662599:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304445568:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1786015518.662752:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968176 00010000:00010000:0.0:1786015518.663070:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5029c6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.663083:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5029c6 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.663092:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5029c6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.663100:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015518.663105:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5029c6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.663114:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5029c6 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.663132:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:0.0:1786015518.663135:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015518.663139:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5029c6 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.663205:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5029c6 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.663244:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50288b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.663251:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50288b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.663266:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50288b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.663272:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015518.663275:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50288b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.663281:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50288b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.663294:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f194900) 00010000:00010000:0.0:1786015518.663296:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015518.663305:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060c00/0xb1a5ef690c502892 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cb6 expref: 97 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.663319:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060c00/0xb1a5ef690c502892 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cb6 expref: 97 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.663329:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060c00/0xb1a5ef690c502892 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cb6 expref: 97 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.663434:0:5795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060c00/0xb1a5ef690c502892 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cb6 expref: 97 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015518.663512:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304445696:192.168.202.56@tcp:105: 00000100:00100000:0.0:1786015518.663658:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c13186c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015518.671164:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304445696:192.168.202.56@tcp:105: 00010000:00010000:0.0:1786015518.671212:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50288b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.671225:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50288b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.671281:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029cd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.671298:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5028b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cbd expref: 46 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.671308:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029cd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.671361:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5028b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cbd expref: 46 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.671382:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5028b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cbd expref: 46 pid: 7673 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015518.671401:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304445824:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015518.671521:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c13186c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015518.673093:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015518.673331:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280598656 00000100:00100000:2.0:1786015518.673355:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280598656 00000100:00100000:2.0:1786015518.673465:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 266 00000100:00100000:2.0:1786015518.673479:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916afc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+98:30801:x1872772280598656:12345-192.168.202.56@tcp:49:cat.0 00000100:00100000:2.0:1786015518.673663:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916afc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+98:30801:x1872772280598656:12345-192.168.202.56@tcp:49:cat.0 Request processed in 185us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015518.673672:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 266 00000100:00100000:2.0:1786015518.678934:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015518.679550:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280598784 00000100:00100000:0.0:1786015518.679564:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280598784 00000100:00100000:2.0:1786015518.679661:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00080000:1.0:1786015518.680402:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015518.680585:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304445824:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015518.680629:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029cd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015518.680792:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 363 00000100:00100000:0.0:1786015518.680813:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+13:30801:x1872772280598784:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1786015518.680849:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015518.680882:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5029d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d18 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015518.680915:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 1048576, mtime: 0x6a746f15, atime: 0x6a746f15, ctime: 0x6a746f15, blocks: 0x803 00010000:00010000:0.0:1786015518.680946:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=753s v=(0 0) 00010000:00010000:0.0:1786015518.680951:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015518.680964:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5029d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d18 expref: 14 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.680984:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5029d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d18 expref: 14 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.681000:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd800, rc 0) 00000100:00100000:0.0:1786015518.681067:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+14:30801:x1872772280598784:12345-192.168.202.56@tcp:101:cat.0 Request processed in 265us (2148us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015518.681075:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 363 00000100:00100000:0.0:1786015518.681115:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280598912 00000100:00100000:0.0:1786015518.681122:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280598912 00010000:00010000:0.0:1786015518.681363:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5028b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cbd expref: 47 pid: 7673 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786015518.686315:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015518.687102:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 394 00000100:00100000:0.0:1786015518.687138:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2354:x1872772280598912:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015518.687187:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015518.687204:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5028b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cbd expref: 47 pid: 7673 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.687226:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5028b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cbd expref: 47 pid: 7673 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.687270:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5028b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cbd expref: 47 pid: 7673 timeout: 853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.687294:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f194900) 00010000:00010000:0.0:1786015518.687302:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029cd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.687314:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.687325:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029cd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.687369:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015518.687473:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+46:2354:x1872772280598912:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 355us (7812us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015518.687483:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 394 00010000:00010000:1.0:1786015518.688491:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.688509:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.688528:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.688535:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029cd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.688543:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.688550:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015518.688555:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.688563:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029cd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.688582:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f194900) 00010000:00010000:1.0:1786015518.688585:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015518.688590:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029cd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.688597:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5029cd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.688617:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5029bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.688624:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5029bf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.688630:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5029bf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.688636:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015518.688639:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5029bf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.688645:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5029bf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.688653:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f194900) 00010000:00010000:1.0:1786015518.688656:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015518.688659:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5029bf lrc: 2/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.688666:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5029bf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786015518.689163:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015518.689169:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015518.689665:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1786015518.689675:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015518.690095:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+16:30830:x1872772280598400:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 44468us (45326us total) trans 4294968177 rc 0/0 00000100:00100000:1.0:1786015518.690109:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1319 00000020:00080000:1.0:1786015518.690117:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:2.0:1786015518.697420:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015518.697661:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015518.698167:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280599296 00000100:00100000:3.0:1786015518.698182:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280599296 00002000:00100000:3.0:1786015518.698273:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1c:0x0] (0->1048575) req@ffff8b7384bb6a00 x1872772280599296/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:364/0 lens 488/0 e 0 to 0 dl 1786015529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015518.698285:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb6a00 with x1872772280599296 ext(0->1048575) 00002000:00010000:3.0:1786015518.698294:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384bb6a00 00000100:00100000:3.0:1786015518.698336:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 114 00000100:00100000:3.0:1786015518.698499:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+14:2353:x1872772280599296:12345-192.168.202.56@tcp:3:cat.0 00000100:00100000:1.0:1786015518.704704:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280599168 00000100:00100000:1.0:1786015518.704725:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280599168 00000100:00100000:1.0:1786015518.704878:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 267 00000100:00100000:1.0:1786015518.704892:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+16:30830:x1872772280599168:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1786015518.705807:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000403:0x1:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1786015518.705928:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968178 00010000:00010000:1.0:1786015518.705989:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5029db lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.706009:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5029db lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.706023:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5029db lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.706032:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5029db lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.706039:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5029db lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.706049:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5029db lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.706083:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786015518.706211:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+18:30830:x1872772280599168:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1317us (8865us total) trans 4294968179 rc 0/0 00000100:00100000:1.0:1786015518.706221:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 267 00000020:00080000:1.0:1786015518.706227:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786015518.707967:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786015518.707986:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5029db lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.707998:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921600 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015518.708003:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5029db lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.708013:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5029db lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.708035:0:8308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8b748f194600) 00010000:00010000:3.0:1786015518.708039:0:8308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786015518.708045:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5029db lrc: 1/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.708052:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5029db lrc: 0/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.708079:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015518.708081:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015518.708083:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015518.723579:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+14:2353:x1872772280599296:12345-192.168.202.56@tcp:3:cat.0 Request processed in 25217us (25900us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1786015518.723598:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 114 00002000:00100000:3.0:1786015518.723614:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1c:0x0] (0->1048575) req@ffff8b7384bb6a00 x1872772280599296/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:364/0 lens 488/440 e 0 to 0 dl 1786015529 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015518.723626:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7384bb6a00 with x1872772280599296 ext(0->1048575) 00002000:00010000:3.0:1786015518.723634:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7384bb6a00 00000100:00100000:0.0:1786015518.732165:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015518.732839:0:17970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280599424 00000100:00100000:2.0:1786015518.732852:0:17970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280599424 00002000:00100000:2.0:1786015518.732915:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1c:0x0] (1048576->1052671) req@ffff8b73824f4700 x1872772280599424/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:364/0 lens 488/0 e 0 to 0 dl 1786015529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015518.732925:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b73824f4700 with x1872772280599424 ext(1048576->1052671) 00002000:00010000:2.0:1786015518.732930:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b73824f4700 00000100:00100000:2.0:1786015518.732961:0:17970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 115 00000100:00100000:2.0:1786015518.732969:0:17970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41677fca-39fb-471c-b582-96bce6540a36+14:2353:x1872772280599424:12345-192.168.202.56@tcp:3:cat.0 00000100:00100000:2.0:1786015518.733994:0:17970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:41677fca-39fb-471c-b582-96bce6540a36+14:2353:x1872772280599424:12345-192.168.202.56@tcp:3:cat.0 Request processed in 1017us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015518.734002:0:17970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 115 00002000:00100000:2.0:1786015518.734010:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1c:0x0] (1048576->1052671) req@ffff8b73824f4700 x1872772280599424/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:364/0 lens 488/440 e 0 to 0 dl 1786015529 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015518.734017:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b73824f4700 with x1872772280599424 ext(1048576->1052671) 00002000:00010000:2.0:1786015518.734021:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b73824f4700 00000100:00100000:2.0:1786015518.738162:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015518.738325:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280599680 00000100:00100000:1.0:1786015518.738340:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280599680 00000100:00100000:1.0:1786015518.738449:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 268 00000100:00100000:1.0:1786015518.738461:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+98:30801:x1872772280599680:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:1.0:1786015518.739091:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+99:30801:x1872772280599680:12345-192.168.202.56@tcp:35:cat.0 Request processed in 628us (946us total) trans 4294968180 rc 0/0 00000100:00100000:1.0:1786015518.739100:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 268 00000100:00100000:3.0:1786015518.748152:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015518.748322:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280599808 00000100:00100000:1.0:1786015518.748337:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280599808 00000100:00100000:1.0:1786015518.748415:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1320 00000100:00100000:1.0:1786015518.748428:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+99:30831:x1872772280599808:12345-192.168.202.56@tcp:101:stat.0 00010000:00010000:1.0:1786015518.748457:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015518.748483:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c5029e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d1f expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.748565:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5029e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.748584:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5029e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.748598:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5029e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.748614:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5029f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.748621:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5029f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.748628:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5029f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749075:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c5029f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749084:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c5029f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749089:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c5029f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015518.749127:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00000004:00200000:1.0:1786015518.749131:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015518.749156:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c5029f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749169:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c5029f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749178:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5029e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749189:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5029e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749197:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5029e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749204:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015518.749209:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5029e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749217:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5029e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749229:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:1.0:1786015518.749232:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015518.749237:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5029e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749244:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5029e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749268:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5029f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749275:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5029f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749282:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5029f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749288:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015518.749292:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5029f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749298:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5029f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749305:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff8b748f194d00) 00010000:00010000:1.0:1786015518.749308:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015518.749311:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5029f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749316:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5029f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749353:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c5029e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d1f expref: 101 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749369:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c5029f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d1f expref: 100 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.749376:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f194900) 00010000:00010000:1.0:1786015518.749379:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015518.749381:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921e00, rc 0) 00000100:00100000:1.0:1786015518.749640:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+100:30831:x1872772280599808:12345-192.168.202.56@tcp:101:stat.0 Request processed in 1212us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015518.749650:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1320 00000100:00100000:0.0:1786015518.760242:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015518.760407:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280599936 00000100:00100000:1.0:1786015518.760419:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280599936 00000100:00100000:1.0:1786015518.760571:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1321 00000100:00100000:1.0:1786015518.760581:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+46:30832:x1872772280599936:12345-192.168.202.56@tcp:101:stat.0 00010000:00010000:1.0:1786015518.760609:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015518.760635:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c5029fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d26 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.760722:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.760740:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.760756:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.760790:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502a0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.760795:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.760800:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761136:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502a13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761144:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502a13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761152:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502a13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015518.761198:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00000004:00200000:1.0:1786015518.761204:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015518.761229:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502a13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761244:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502a13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761265:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761273:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761280:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761288:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015518.761293:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761302:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761317:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:1.0:1786015518.761321:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015518.761326:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761334:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761357:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761366:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502a0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761370:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502a0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761373:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015518.761375:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502a0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761378:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502a0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761383:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff8b748f194d00) 00010000:00010000:1.0:1786015518.761384:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015518.761386:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502a0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761390:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502a0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761427:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920800/0xb1a5ef690c5029fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d26 expref: 48 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761520:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502a13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d26 expref: 47 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.761529:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f194900) 00010000:00010000:1.0:1786015518.761532:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015518.761535:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920e00, rc 0) 00000100:00100000:1.0:1786015518.761619:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+47:30832:x1872772280599936:12345-192.168.202.56@tcp:101:stat.0 Request processed in 1039us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015518.761626:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1321 00000100:00100000:2.0:1786015518.764030:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015518.764108:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280600064 00000100:00100000:1.0:1786015518.764119:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280600064 00000100:00100000:1.0:1786015518.764275:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 364 00000100:00100000:1.0:1786015518.764289:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280600064:12345-192.168.202.56@tcp:101:stat.0 00010000:00010000:1.0:1786015518.764315:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015518.764339:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c502a1a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d2d expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.764375:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786015518.764379:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015518.764390:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c502a1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d2d expref: 11 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.764410:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c502a1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d2d expref: 11 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.764423:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920a00, rc 0) 00000100:00080000:2.0:1786015518.764503:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015518.764582:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280600064:12345-192.168.202.56@tcp:101:stat.0 Request processed in 298us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015518.764588:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 364 00000100:00100000:3.0:1786015518.768468:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015518.768575:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280600320 00000100:00100000:1.0:1786015518.768588:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280600320 00000100:00100000:1.0:1786015518.768655:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1322 00000100:00100000:1.0:1786015518.768665:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+100:30546:x1872772280600320:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1786015518.768703:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015518.768736:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502a21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d34 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.768961:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502a28 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.768975:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c5029f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d1f expref: 101 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.768981:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502a13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d26 expref: 46 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.768987:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502a28 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.769023:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502a13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d26 expref: 46 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.769034:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502a13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d26 expref: 46 pid: 7673 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015518.769045:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304445952:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015518.769148:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c5029f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d1f expref: 101 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.769157:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c5029f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d1f expref: 101 pid: 12526 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015518.769167:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef00380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304446080:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015518.769193:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b01b0840 going to sleep for 11 seconds 00000100:00100000:1.0:1786015518.773589:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef00380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304446080:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015518.773697:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304445952:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015518.773739:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502a28 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015518.774498:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015518.774625:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280600448 00000100:00100000:0.0:1786015518.774637:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280600448 00010000:00010000:0.0:1786015518.774695:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502a13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d26 expref: 47 pid: 7673 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015518.774739:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 395 00000100:00100000:0.0:1786015518.774750:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2353:x1872772280600448:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015518.774787:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015518.774796:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502a13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d26 expref: 47 pid: 7673 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.774810:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502a13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d26 expref: 47 pid: 7673 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.775569:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502a13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d26 expref: 47 pid: 7673 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.775596:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f194900) 00010000:00010000:0.0:1786015518.775602:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502a28 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.775613:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502a28 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.775620:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015518.775719:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+46:2353:x1872772280600448:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 969us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015518.775730:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 395 00000100:00100000:2.0:1786015518.777226:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015518.777625:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280600576 00000100:00100000:3.0:1786015518.777637:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280600576 00010000:00010000:3.0:1786015518.777689:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c5029f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d1f expref: 102 pid: 12526 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015518.777735:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 396 00000100:00100000:3.0:1786015518.777745:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+102:2353:x1872772280600576:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015518.777783:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015518.777789:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c5029f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d1f expref: 102 pid: 12526 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.777802:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c5029f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d1f expref: 102 pid: 12526 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.777912:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c5029f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d1f expref: 102 pid: 12526 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.777930:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f194900) 00010000:00010000:3.0:1786015518.777936:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502a28 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.777949:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502a28 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.777958:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502a28 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.777994:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015518.778057:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+101:2353:x1872772280600576:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 313us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015518.778064:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 396 00010000:00010000:2.0:1786015518.778220:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502a28 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.778229:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502a28 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015518.778262:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00010000:00010000:2.0:1786015518.778524:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502a21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d34 expref: 102 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.778539:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502a28 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d34 expref: 101 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.778548:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f194900) 00010000:00010000:2.0:1786015518.778550:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786015518.778552:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920600, rc 0) 00000100:00100000:2.0:1786015518.778590:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+101:30546:x1872772280600320:12345-192.168.202.56@tcp:101:bash.0 Request processed in 9927us (10136us total) trans 4294968181 rc 0/0 00000100:00100000:2.0:1786015518.778596:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1322 00000100:00100000:3.0:1786015518.780679:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015518.781029:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280600832 00000100:00100000:0.0:1786015518.781041:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280600832 00000100:00100000:0.0:1786015518.781121:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1323 00000100:00100000:0.0:1786015518.781130:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+101:30546:x1872772280600832:12345-192.168.202.56@tcp:36:bash.0 00010000:00010000:0.0:1786015518.781541:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502a36 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.781563:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502a36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.781576:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502a36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786015518.781638:0:12526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968182 00000004:00010000:0.0:1786015518.781668:0:12526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2a1c126 reply state 00000000bf1d728e transno 4294968183 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502a36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015518.781689:0:12526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1786015518.781746:0:12526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968183 00000100:00100000:0.0:1786015518.782010:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+105:30546:x1872772280600832:12345-192.168.202.56@tcp:36:bash.0 Request processed in 878us (1339us total) trans 4294968184 rc 0/0 00000100:00100000:0.0:1786015518.782020:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1323 00000020:00080000:0.0:1786015518.782024:0:12526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1786015518.784222:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502a36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.784246:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502a36 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.784264:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502a36 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.784271:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015518.784277:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502a36 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.784288:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502a36 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.784310:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f194900) 00010000:00010000:1.0:1786015518.784314:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015518.784320:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502a36 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.784328:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502a36 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015518.788079:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015518.788509:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280600960 00000100:00100000:1.0:1786015518.788523:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280600960 00000100:00100000:1.0:1786015518.788608:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 365 00000100:00100000:1.0:1786015518.788620:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+14:30546:x1872772280600960:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1786015518.788648:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015518.788677:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001eed9d61/0xb1a5ef690c502a3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d3b expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.789181:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5029d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d18 expref: 15 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.789195:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c502a1a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d2d expref: 10 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.789204:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015518.789210:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015518.789216:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001eed9d61/0xb1a5ef690c502a3d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d3b expref: 15 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.789279:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c502a1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d2d expref: 10 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.789297:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c502a1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d2d expref: 10 pid: 14547 timeout: 854 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015518.789315:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304446208:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015518.789478:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5029d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d18 expref: 15 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.789490:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5029d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d18 expref: 15 pid: 6592 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015518.789507:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304446336:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015518.789531:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c13189c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015518.795606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015518.795926:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280601088 00000100:00100000:1.0:1786015518.795940:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280601088 00010000:00010000:1.0:1786015518.796002:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c502a1a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d2d expref: 11 pid: 14547 timeout: 854 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015518.796059:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 397 00000100:00100000:1.0:1786015518.796071:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280601088:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015518.796095:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015518.796102:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c502a1a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d2d expref: 11 pid: 14547 timeout: 854 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.796118:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c502a1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d2d expref: 11 pid: 14547 timeout: 854 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.796152:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015518.796228:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280601088:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 159us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015518.796237:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 397 00000100:00100000:1.0:1786015518.796361:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015518.796399:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280601216 00000100:00100000:1.0:1786015518.796403:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280601216 00010000:00010000:1.0:1786015518.796420:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5029d4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d18 expref: 16 pid: 6592 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015518.796451:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 398 00000100:00100000:1.0:1786015518.796459:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280601216:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015518.796468:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015518.796473:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5029d4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d18 expref: 16 pid: 6592 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.796484:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5029d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d18 expref: 16 pid: 6592 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.796500:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015518.796505:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015518.796513:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001eed9d61/0xb1a5ef690c502a3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d3b expref: 16 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.796525:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001eed9d61/0xb1a5ef690c502a3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d3b expref: 16 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.796569:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001eed9d61/0xb1a5ef690c502a3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d3b expref: 16 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015518.796587:0:5781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef01f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1872772304446464:192.168.202.56@tcp:105: 00000100:00100000:1.0:1786015518.796657:0:5781:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b01b0e40 going to sleep for 11 seconds 00010000:00010000:0.0:1786015518.797227:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c502a1a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d2d expref: 10 pid: 14547 timeout: 854 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015518.797250:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304446208:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015518.797276:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6646e5c/0xb1a5ef690c5029d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d18 expref: 16 pid: 6592 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015518.797287:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11384:1872772304446336:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015518.797325:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001eed9d61/0xb1a5ef690c502a3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d3b expref: 15 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.797339:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920800, rc 0) 00000100:00100000:0.0:1786015518.797400:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+15:30546:x1872772280600960:12345-192.168.202.56@tcp:101:bash.0 Request processed in 8782us (9334us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015518.797410:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 365 00000100:00100000:2.0:1786015518.799754:0:5781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef01f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1872772304446464:192.168.202.56@tcp:105: 00010000:00010000:2.0:1786015518.799814:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015518.799877:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+14:2353:x1872772280601216:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 3419us (3516us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015518.799887:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 398 00000100:00100000:1.0:1786015518.802720:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015518.802806:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280601344 00000100:00100000:2.0:1786015518.802823:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280601344 00002000:00010000:2.0:1786015518.802871:0:6596:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/28 (0->18446744073709551615) 00002000:00100000:2.0:1786015518.802876:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aef01c00 with x1872772280601344 ext(0->18446744073709551615) 00002000:00010000:2.0:1786015518.802890:0:6596:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74aef01c00. 00000100:00100000:2.0:1786015518.802916:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 116 00000100:00100000:2.0:1786015518.802925:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41677fca-39fb-471c-b582-96bce6540a36+14:2353:x1872772280601344:12345-192.168.202.56@tcp:10:bash.0 00002000:00010000:2.0:1786015518.803306:0:6596:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 1048576 -> 0 00002000:00010000:2.0:1786015518.803311:0:6596:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb mtime from disk: 1786015509 -> 1786015519 00002000:00010000:2.0:1786015518.803313:0:6596:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb atime from disk: 1786015509 -> 1786015509 00002000:00010000:2.0:1786015518.803316:0:6596:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb ctime from disk: 1786015509 -> 1786015519 00002000:00010000:2.0:1786015518.803318:0:6596:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 2051 -> 2051 00000100:00100000:2.0:1786015518.803397:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41677fca-39fb-471c-b582-96bce6540a36+15:2353:x1872772280601344:12345-192.168.202.56@tcp:10:bash.0 Request processed in 471us (688us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1786015518.803405:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 116 00002000:00010000:2.0:1786015518.803409:0:6596:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/28 (0->18446744073709551615) 00002000:00100000:2.0:1786015518.803411:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aef01c00 with x1872772280601344 ext(0->18446744073709551615) 00002000:00010000:2.0:1786015518.803414:0:6596:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74aef01c00. 00000100:00100000:3.0:1786015518.819049:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015518.819106:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280601472 00000100:00100000:1.0:1786015518.819122:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280601472 00000100:00100000:1.0:1786015518.819199:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1324 00000100:00100000:1.0:1786015518.819211:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+104:30833:x1872772280601472:12345-192.168.202.56@tcp:101:stat.0 00010000:00010000:1.0:1786015518.819248:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015518.819406:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502a44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d42 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.819573:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a4b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.819588:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.819598:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.819610:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502a52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.819615:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015518.819619:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.820116:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6e00/0xb1a5ef690c502a59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.820128:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502a28 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d34 expref: 105 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.820135:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6e00/0xb1a5ef690c502a59 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.820189:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502a28 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d34 expref: 105 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.820208:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502a28 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d34 expref: 105 pid: 5795 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015518.820221:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304446592:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015518.820360:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c13189c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015518.822999:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015518.823264:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304446592:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015518.823304:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6e00/0xb1a5ef690c502a59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015518.823543:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280601728 00000100:00100000:3.0:1786015518.823553:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280601728 00000100:00100000:3.0:1786015518.823641:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 269 00000100:00100000:3.0:1786015518.823652:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+106:5568:x1872772280601728:12345-192.168.202.56@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1786015518.824625:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+107:5568:x1872772280601728:12345-192.168.202.56@tcp:35:ldlm_bl.0 Request processed in 969us (1634us total) trans 4294968185 rc 0/0 00000100:00100000:2.0:1786015518.824635:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 269 00000100:00100000:1.0:1786015518.827892:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015518.827972:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280601856 00000100:00100000:0.0:1786015518.827983:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280601856 00010000:00010000:0.0:1786015518.828033:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502a28 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d34 expref: 107 pid: 5795 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015518.828071:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 399 00000100:00100000:0.0:1786015518.828078:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+107:2354:x1872772280601856:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015518.828095:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015518.828101:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502a28 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d34 expref: 107 pid: 5795 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.828112:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502a28 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d34 expref: 107 pid: 5795 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.828140:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502a28 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d34 expref: 107 pid: 5795 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.828161:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f194900) 00010000:00010000:0.0:1786015518.828168:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6e00/0xb1a5ef690c502a59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.828180:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6e00/0xb1a5ef690c502a59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.828189:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6e00/0xb1a5ef690c502a59 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015518.828227:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015518.828315:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+106:2354:x1872772280601856:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 234us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015518.828324:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 399 00010000:00010000:3.0:1786015518.828503:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6e00/0xb1a5ef690c502a59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.828512:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6e00/0xb1a5ef690c502a59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015518.828572:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 0 00000004:00200000:3.0:1786015518.828577:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015518.828610:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6e00/0xb1a5ef690c502a59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.828625:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6e00/0xb1a5ef690c502a59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.828638:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.828645:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a4b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.828653:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.828659:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015518.828665:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.828673:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a4b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.829293:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:3.0:1786015518.829299:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015518.829307:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.829316:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502a4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.829332:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.829346:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502a52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.829353:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502a52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.829358:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015518.829362:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502a52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.829369:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502a52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.829377:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff8b748f194d00) 00010000:00010000:3.0:1786015518.829379:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015518.829382:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502a52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.829388:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502a52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.829446:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502a44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d42 expref: 106 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.829469:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6e00/0xb1a5ef690c502a59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d42 expref: 105 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015518.829477:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f194900) 00010000:00010000:3.0:1786015518.829480:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015518.829483:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6e00, rc 0) 00000100:00100000:3.0:1786015518.829545:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+105:30833:x1872772280601472:12345-192.168.202.56@tcp:101:stat.0 Request processed in 10335us (10509us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015518.829554:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1324 00000100:00100000:1.0:1786015518.840108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015518.840186:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280601984 00000100:00100000:2.0:1786015518.840200:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280601984 00000100:00100000:2.0:1786015518.840395:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1325 00000100:00100000:2.0:1786015518.840406:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+46:30834:x1872772280601984:12345-192.168.202.56@tcp:101:stat.0 00010000:00010000:2.0:1786015518.840431:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015518.840457:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061800/0xb1a5ef690c502a60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d49 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.840535:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502a67 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.840549:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502a67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.840559:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502a67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.840571:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502a6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.840575:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.840579:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841468:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061a00/0xb1a5ef690c502a75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841485:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061a00/0xb1a5ef690c502a75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841495:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061a00/0xb1a5ef690c502a75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015518.841539:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 0 00000004:00200000:2.0:1786015518.841544:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015518.841567:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061a00/0xb1a5ef690c502a75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841578:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061a00/0xb1a5ef690c502a75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841585:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502a67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841590:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502a67 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841595:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502a67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841599:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015518.841602:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502a67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841609:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502a67 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841620:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:2.0:1786015518.841622:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015518.841626:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502a67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841630:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502a67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841640:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841644:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502a6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841648:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502a6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841651:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015518.841652:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502a6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841656:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502a6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841659:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff8b7487f06700) 00010000:00010000:2.0:1786015518.841661:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015518.841662:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502a6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841669:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502a6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841865:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061800/0xb1a5ef690c502a60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d49 expref: 48 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841876:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061a00/0xb1a5ef690c502a75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d49 expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.841882:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8b748f194900) 00010000:00010000:2.0:1786015518.841884:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015518.841886:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488061a00, rc 0) 00000100:00100000:2.0:1786015518.841965:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:30834:x1872772280601984:12345-192.168.202.56@tcp:101:stat.0 Request processed in 1559us (1871us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015518.841974:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1325 00000100:00100000:0.0:1786015518.846239:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015518.846561:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280602112 00000100:00100000:3.0:1786015518.846574:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280602112 00000100:00100000:3.0:1786015518.846638:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 366 00000100:00100000:3.0:1786015518.846646:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280602112:12345-192.168.202.56@tcp:101:stat.0 00010000:00010000:3.0:1786015518.846669:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015518.846699:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac472ba5/0xb1a5ef690c502a7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d50 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015518.846926:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304446720:192.168.202.56@tcp:106: 00000100:00100000:2.0:1786015518.847225:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b13f09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786015518.850984:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304446720:192.168.202.56@tcp:106: 00010000:00010000:2.0:1786015518.851053:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac472ba5/0xb1a5ef690c502a7c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d50 expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.851085:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac472ba5/0xb1a5ef690c502a7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d50 expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015518.851103:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd600, rc 0) 00000100:00100000:2.0:1786015518.851202:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280602112:12345-192.168.202.56@tcp:101:stat.0 Request processed in 4554us (4977us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015518.851214:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 366 00000100:00100000:1.0:1786015519.298116:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015519.298179:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015519.298218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015519.298259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015519.298282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015519.298306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015519.298326:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015519.298343:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015519.298350:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280602752 00000100:00100000:3.0:1786015519.298364:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280602752 00000100:00100000:1.0:1786015519.298372:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280602496 00000100:00100000:1.0:1786015519.298375:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280602496 00000100:00100000:1.0:1786015519.298422:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280603008 00000100:00100000:3.0:1786015519.298424:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280602368 00000100:00100000:1.0:1786015519.298425:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280603008 00000100:00100000:3.0:1786015519.298426:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280602368 00000100:00100000:3.0:1786015519.298450:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 515 00000100:00100000:3.0:1786015519.298461:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2354:x1872772280602752:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015519.298577:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2354:x1872772280602752:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 117us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015519.298586:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 515 00000100:00100000:3.0:1786015519.298607:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 516 00000100:00100000:3.0:1786015519.298614:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+105:2354:x1872772280602368:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015519.298644:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+105:2354:x1872772280602368:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015519.298651:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 516 00000100:00100000:3.0:1786015519.298677:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280603264 00000100:00100000:3.0:1786015519.298680:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280603264 00000100:00100000:3.0:1786015519.298697:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280602624 00000100:00100000:3.0:1786015519.298700:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280602624 00000100:00100000:3.0:1786015519.298709:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280602880 00000100:00100000:3.0:1786015519.298711:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280602880 00000100:00100000:3.0:1786015519.298726:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 511 00000100:00100000:3.0:1786015519.298731:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280602496:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015519.298758:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280602496:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015519.298799:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 511 00000100:00100000:2.0:1786015519.298818:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280602240 00000100:00100000:2.0:1786015519.298824:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280602240 00000100:00100000:2.0:1786015519.298858:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 622 00000100:00100000:2.0:1786015519.298865:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+16:2354:x1872772280602240:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015519.298895:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+16:2354:x1872772280602240:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015519.298902:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 622 00000100:00100000:2.0:1786015519.298966:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 512 00000100:00100000:2.0:1786015519.298974:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280603008:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015519.299003:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280603008:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015519.299010:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 512 00000100:00100000:2.0:1786015519.299026:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 513 00000100:00100000:2.0:1786015519.299031:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+5:2354:x1872772280603264:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015519.299053:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+5:2354:x1872772280603264:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015519.299059:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 513 00000100:00100000:2.0:1786015519.299070:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 514 00000100:00100000:2.0:1786015519.299077:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+15:2354:x1872772280602624:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015519.299098:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+15:2354:x1872772280602624:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015519.299103:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 514 00000100:00100000:2.0:1786015519.299114:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 515 00000100:00100000:2.0:1786015519.299119:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280602880:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015519.299144:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280602880:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015519.299150:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 515 00000100:00100000:2.0:1786015519.299221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015519.299330:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280603136 00000100:00100000:3.0:1786015519.299344:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280603136 00000100:00100000:3.0:1786015519.299380:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 517 00000100:00100000:3.0:1786015519.299387:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+18:2354:x1872772280603136:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015519.299416:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+18:2354:x1872772280603136:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015519.299422:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 517 00000100:00080000:3.0:1786015519.299449:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015519.299454:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015519.311720:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015519.312282:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280603392 00000100:00100000:2.0:1786015519.312301:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280603392 00000100:00100000:2.0:1786015519.312397:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 516 00000100:00100000:2.0:1786015519.312409:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:2354:x1872772280603392:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015519.312934:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+6:2354:x1872772280603392:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 525us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015519.312943:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 516 00010000:00010000:3.0:1786015519.596468:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015519.916256:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786015519.916289:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304446848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015519.916391:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015519.920056:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304446848 00000100:00100000:3.0:1786015519.920081:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304446848 00000100:00100000:3.0:1786015519.920183:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1786015519.920197:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304446848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015519.920267:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1786015519.920407:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304446848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 214us (4016us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015519.920415:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1786015519.920505:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304446848:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786015519.924360:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1786015520.008913:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967367 is committed 00010000:00010000:1.0:1786015520.625983:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015521.452494:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304447104:0@lo:400:kworker.0 00000100:00100000:3.0:1786015521.452602:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015521.452688:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304447616:0@lo:400:kworker.0 00000100:00100000:3.0:1786015521.452722:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015521.452753:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786015521.452778:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304447232:0@lo:400:kworker.0 00000100:00100000:3.0:1786015521.452802:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015521.452858:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304447104 00000100:00100000:3.0:1786015521.452869:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304447104 00000100:00100000:3.0:1786015521.452929:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304447232 00000100:00100000:3.0:1786015521.452932:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304447232 00000100:00100000:3.0:1786015521.452968:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:3.0:1786015521.452978:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304447104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015521.453049:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304447104:12345-0@lo:400:kworker.0 Request processed in 72us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015521.453061:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:3.0:1786015521.453084:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1786015521.453091:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304447232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015521.453123:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304447232:12345-0@lo:400:kworker.0 Request processed in 33us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015521.453129:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00080000:3.0:1786015521.453152:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015521.453197:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304447232:0@lo:400:kworker.0 00000100:00100000:3.0:1786015521.453209:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304447104:0@lo:400:kworker.0 00000100:00100000:1.0:1786015521.453531:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304446976:0@lo:400:kworker.0 00000100:00100000:1.0:1786015521.453579:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015521.453621:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304447488:0@lo:400:kworker.0 00000100:00100000:1.0:1786015521.453650:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015521.453669:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786015521.453675:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b897ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304447360:0@lo:400:kworker.0 00000100:00100000:1.0:1786015521.453700:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015521.454002:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304447616 00000100:00100000:0.0:1786015521.454010:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304447616 00000100:00100000:0.0:1786015521.454082:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304447360 00000100:00100000:0.0:1786015521.454085:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304447360 00000100:00100000:0.0:1786015521.454110:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:0.0:1786015521.454119:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304447616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015521.454174:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304447616:12345-0@lo:400:kworker.0 Request processed in 57us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015521.454181:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:0.0:1786015521.454196:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1786015521.454202:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304447360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015521.454247:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304447360:12345-0@lo:400:kworker.0 Request processed in 45us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015521.454254:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1786015521.454275:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304447488 00000100:00100000:0.0:1786015521.454278:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304447488 00000100:00100000:0.0:1786015521.454308:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1786015521.454316:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304447488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015521.454346:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304447488:12345-0@lo:400:kworker.0 Request processed in 31us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015521.454352:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1786015521.454398:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967367 gen 2 00000004:00080000:0.0:1786015521.454405:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b7381cc0a80, transno 4294967367 00000100:00100000:0.0:1786015521.454430:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b897ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304447360:0@lo:400:kworker.0 00000100:00100000:0.0:1786015521.454444:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304447488:0@lo:400:kworker.0 00000100:00100000:0.0:1786015521.454988:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304447616:0@lo:400:kworker.0 00000100:00080000:1.0:1786015521.455448:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015521.455455:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015521.455458:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015521.457263:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304446976 00000100:00100000:3.0:1786015521.457284:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304446976 00000100:00100000:3.0:1786015521.457382:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:3.0:1786015521.457397:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304446976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015521.457565:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304446976:12345-0@lo:400:kworker.0 Request processed in 171us (3983us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015521.457573:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:3.0:1786015521.457654:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304446976:0@lo:400:kworker.0 00010000:00010000:1.0:1786015521.645145:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015521.967257:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786015521.967291:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304447744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015521.967397:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015521.967889:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304447744 00000100:00100000:3.0:1786015521.967901:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304447744 00000100:00100000:3.0:1786015521.967968:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1786015521.967980:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304447744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015521.968032:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 88408064 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1786015521.968106:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304447744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015521.968117:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1786015521.968179:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304447744:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786015522.668009:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015523.691952:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786015524.116521:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967379 is committed 00000001:00080000:0.0:1786015524.116544:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967378 is committed 00000001:00080000:0.0:1786015524.116552:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967377 is committed 00000001:00080000:1.0:1786015524.169247:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968184 is committed 00000001:00080000:1.0:1786015524.169270:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968177 is committed 00000020:00080000:1.0:1786015524.169282:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b7482b333c0 refcount 2 committed 0 result 0 batchid 30 00000020:00080000:1.0:1786015524.169287:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74aa90d900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b7482b33d80 00000020:00080000:1.0:1786015524.169291:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74aa90d100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74bf3f0000 00000020:00080000:3.0:1786015524.169332:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30 committed batchid 29 00000020:00080000:3.0:1786015524.169648:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 29 00000001:00080000:1.0:1786015524.172304:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968179 is committed 00000001:00080000:1.0:1786015524.172330:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968185 is committed 00000100:00100000:2.0:1786015524.424685:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015524.424743:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015524.424794:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015524.424819:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015524.424850:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015524.424871:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015524.424890:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015524.424912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015524.424932:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015524.424953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015524.425312:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280603776 00000100:00100000:1.0:1786015524.425326:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280603776 00000100:00100000:1.0:1786015524.425408:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280604288 00000100:00100000:1.0:1786015524.425412:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280604288 00000100:00100000:1.0:1786015524.425430:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280604544 00000100:00100000:1.0:1786015524.425433:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280604544 00000100:00100000:1.0:1786015524.425447:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280603904 00000100:00100000:1.0:1786015524.425450:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280603904 00000100:00100000:1.0:1786015524.425465:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280604160 00000100:00100000:1.0:1786015524.425468:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280604160 00000100:00100000:1.0:1786015524.425482:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280604672 00000100:00100000:1.0:1786015524.425484:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280604672 00000100:00100000:1.0:1786015524.425505:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 519 00000100:00100000:1.0:1786015524.425517:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280603776:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015524.425646:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280603776:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 129us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015524.425655:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 519 00000100:00100000:1.0:1786015524.425676:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 520 00000100:00100000:1.0:1786015524.425683:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280604288:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015524.425714:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280604288:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015524.425721:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 520 00000100:00100000:1.0:1786015524.425733:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 521 00000100:00100000:1.0:1786015524.425740:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+5:2354:x1872772280604544:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015524.425790:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+5:2354:x1872772280604544:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 49us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015524.425796:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 521 00000100:00100000:1.0:1786015524.425808:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 522 00000100:00100000:1.0:1786015524.425814:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+14:2354:x1872772280603904:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015524.425838:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+14:2354:x1872772280603904:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015524.425844:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 522 00000100:00100000:1.0:1786015524.425855:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 523 00000100:00100000:1.0:1786015524.425860:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280604160:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015524.425881:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280604160:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015524.425887:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 523 00000100:00100000:1.0:1786015524.425897:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 524 00000100:00100000:1.0:1786015524.425903:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+5:2354:x1872772280604672:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015524.425923:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+5:2354:x1872772280604672:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015524.425929:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 524 00000100:00100000:3.0:1786015524.426651:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280603520 00000100:00100000:3.0:1786015524.426661:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280603520 00000100:00100000:3.0:1786015524.426713:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 624 00000100:00100000:3.0:1786015524.426723:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+16:2354:x1872772280603520:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015524.426801:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+16:2354:x1872772280603520:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 80us (2133us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015524.426808:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 624 00000100:00100000:3.0:1786015524.426843:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280604032 00000100:00100000:3.0:1786015524.426847:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280604032 00000100:00100000:3.0:1786015524.426875:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280603648 00000100:00100000:3.0:1786015524.426878:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280603648 00000100:00100000:3.0:1786015524.426893:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280604416 00000100:00100000:3.0:1786015524.426896:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280604416 00000100:00100000:3.0:1786015524.426911:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 521 00000100:00100000:3.0:1786015524.426916:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2354:x1872772280604032:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015524.426944:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2354:x1872772280604032:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (2151us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015524.426950:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 521 00000100:00100000:3.0:1786015524.426960:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 522 00000100:00100000:3.0:1786015524.426965:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+99:2354:x1872772280603648:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015524.426986:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+99:2354:x1872772280603648:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015524.426992:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 522 00000100:00100000:3.0:1786015524.427000:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 523 00000100:00100000:3.0:1786015524.427005:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+9:2354:x1872772280604416:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015524.427023:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+9:2354:x1872772280604416:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 18us (2091us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015524.427028:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 523 00000100:00080000:2.0:1786015524.427285:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786015524.427291:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015524.427293:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015524.527888:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015524.527993:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280604800 00000100:00100000:0.0:1786015524.528005:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280604800 00000100:00100000:0.0:1786015524.528072:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1326 00000100:00100000:0.0:1786015524.528083:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+9:30829:x1872772280604800:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1786015524.528219:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+9:30829:x1872772280604800:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 136us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015524.528230:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1326 00000100:00100000:0.0:1786015524.547483:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015524.549492:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280605056 00000100:00100000:2.0:1786015524.549511:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280605056 00000100:00100000:2.0:1786015524.549624:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 270 00000100:00100000:2.0:1786015524.549638:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+9:30829:x1872772280605056:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015524.550419:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:30829:x1872772280605056:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 781us (3785us total) trans 4294968186 rc 0/0 00000100:00100000:2.0:1786015524.550430:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 270 00010000:00010000:1.0:1786015524.717324:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015525.038021:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304447872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015525.038156:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015525.038222:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304447872 00000100:00100000:1.0:1786015525.038234:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304447872 00000100:00080000:0.0:1786015525.038297:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015525.038325:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1786015525.038342:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304447872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015525.038380:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015525.038478:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304447872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015525.038486:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1786015525.038905:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304447872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786015525.740249:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015526.572085:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304448000:0@lo:400:kworker.0 00000100:00100000:0.0:1786015526.572237:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015526.572393:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304448000 00000100:00100000:2.0:1786015526.572405:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304448000 00000100:00100000:2.0:1786015526.572490:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:2.0:1786015526.572501:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304448000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015526.572629:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304448384:0@lo:400:kworker.0 00000100:00100000:1.0:1786015526.574951:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015526.575099:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304448384 00000100:00100000:1.0:1786015526.575112:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304448384 00000100:00100000:1.0:1786015526.575176:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1786015526.575201:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304448384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015526.575292:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304448384:12345-0@lo:400:kworker.0 Request processed in 95us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015526.575301:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1786015526.575379:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304448384:0@lo:400:kworker.0 00000100:00100000:1.0:1786015526.575469:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304448128:0@lo:400:kworker.0 00000100:00100000:1.0:1786015526.575516:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015526.575700:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786015526.575712:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304448256:0@lo:400:kworker.0 00000100:00100000:1.0:1786015526.575844:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015526.575892:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304448128 00000100:00100000:1.0:1786015526.575897:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304448128 00000100:00100000:1.0:1786015526.575930:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304448256 00000100:00100000:1.0:1786015526.575933:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304448256 00000100:00100000:1.0:1786015526.575966:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1786015526.575974:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304448128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015526.576020:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304448128:12345-0@lo:400:kworker.0 Request processed in 46us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015526.576027:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1786015526.576041:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1786015526.576047:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304448256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015526.576078:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304448256:12345-0@lo:400:kworker.0 Request processed in 31us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015526.576084:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1786015526.576119:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304448256:0@lo:400:kworker.0 00000100:00100000:1.0:1786015526.576131:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304448128:0@lo:400:kworker.0 00000100:00080000:1.0:1786015526.576158:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015526.579469:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304448640:0@lo:400:kworker.0 00000100:00100000:3.0:1786015526.579583:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015526.579847:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304448000:12345-0@lo:400:kworker.0 Request processed in 7344us (7606us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015526.579861:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:2.0:1786015526.579946:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304448640 00000100:00100000:2.0:1786015526.579958:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304448640 00000100:00100000:1.0:1786015526.579988:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015526.580007:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304448512:0@lo:400:kworker.0 00000100:00100000:1.0:1786015526.580053:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015526.580112:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304448512 00000100:00100000:1.0:1786015526.580117:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304448512 00000100:00100000:0.0:1786015526.582847:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304448000:0@lo:400:kworker.0 00000100:00080000:3.0:1786015526.587822:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015526.587840:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015526.587937:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:1.0:1786015526.587955:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304448512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015526.588872:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304448512:12345-0@lo:400:kworker.0 Request processed in 918us (8814us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015526.588883:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:0.0:1786015526.589045:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304448512:0@lo:400:kworker.0 00000100:00100000:0.0:1786015526.590929:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:0.0:1786015526.590965:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304448640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015526.594860:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304448640:12345-0@lo:400:kworker.0 Request processed in 3893us (15268us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015526.595031:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967378 gen 2 00000004:00080000:3.0:1786015526.595041:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967378 committed transno 4294967378 00000100:00100000:3.0:1786015526.596826:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304448640:0@lo:400:kworker.0 00000100:00100000:0.0:1786015526.599360:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00010000:00010000:3.0:1786015526.764317:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015526.806098:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015526.806151:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015526.806202:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015526.806318:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280605312 00000100:00100000:2.0:1786015526.806333:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280605312 00000100:00100000:2.0:1786015526.806436:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280605184 00000100:00100000:2.0:1786015526.806441:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280605184 00000100:00100000:2.0:1786015526.806466:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280605440 00000100:00100000:2.0:1786015526.806469:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280605440 00000100:00100000:2.0:1786015526.806490:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:2.0:1786015526.806502:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+18:2351:x1872772280605312:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015526.806525:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015526.806564:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7384afca00/0xb1a5ef690c502654 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8bd6 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015526.806593:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015526.806667:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+17:2351:x1872772280605312:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 167us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015526.806676:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:2.0:1786015526.807047:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:2.0:1786015526.807060:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+16:2351:x1872772280605184:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015526.807069:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015526.807081:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7384bbc600/0xb1a5ef690c50264d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8bac expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015526.807094:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015526.807117:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+15:2351:x1872772280605184:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 61us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015526.807123:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:2.0:1786015526.807141:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:2.0:1786015526.807148:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+14:2351:x1872772280605440:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015526.807156:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015526.807165:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b7384afce00/0xb1a5ef690c50265b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8bdd expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015526.807175:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015526.807204:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280605440:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 57us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015526.807211:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:3.0:1786015526.816030:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015526.816215:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280605568 00000100:00100000:0.0:1786015526.816231:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280605568 00000100:00100000:0.0:1786015526.816362:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 367 00000100:00100000:0.0:1786015526.816375:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+5:2350:x1872772280605568:12345-192.168.202.56@tcp:9:umount.0 00000020:00000080:0.0:1786015526.816423:0:6592:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1a5ef690c502670 00000100:00080000:0.0:1786015526.816436:0:6592:0:(import.c:65:import_set_state_nolock()) ffff8b74bf860800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786015526.816500:0:6592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967379 00000100:00100000:0.0:1786015526.816880:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+2:2350:x1872772280605568:12345-192.168.202.56@tcp:9:umount.0 Request processed in 506us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015526.816889:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 367 00010000:00010000:2.0:1786015526.817478:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786015526.817626:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015526.826107:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015526.831196:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280605696 00000100:00100000:1.0:1786015526.831218:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280605696 00000100:00080000:3.0:1786015526.831383:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015526.831484:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 368 00000100:00100000:1.0:1786015526.831503:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+5:2350:x1872772280605696:12345-192.168.202.56@tcp:9:umount.0 00000020:00000080:1.0:1786015526.831546:0:6591:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1a5ef690c502669 00000100:00080000:1.0:1786015526.831558:0:6591:0:(import.c:65:import_set_state_nolock()) ffff8b74b8e25000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786015526.831622:0:6591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967367 00000100:00100000:1.0:1786015526.832338:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+2:2350:x1872772280605696:12345-192.168.202.56@tcp:9:umount.0 Request processed in 839us (6244us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015526.832351:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 368 00010000:00010000:0.0:1786015526.833160:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015526.850940:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015526.851265:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280606336 00000100:00100000:1.0:1786015526.851278:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280606336 00000100:00080000:3.0:1786015526.851465:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015526.851530:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1327 00000100:00100000:1.0:1786015526.851544:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+10:2350:x1872772280606336:12345-192.168.202.56@tcp:39:umount.0 00000020:00000080:1.0:1786015526.851603:0:5796:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1a5ef690c502662 00000020:00010000:1.0:1786015526.851626:0:5796:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8b74bf418000: total 0 00000100:00080000:1.0:1786015526.851631:0:5796:0:(import.c:65:import_set_state_nolock()) ffff8b74bf41b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786015526.851711:0:5796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294968186 00000100:00100000:1.0:1786015526.852233:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15271907-a1cf-47fa-aa4f-97fea3c6cdd8+9:2350:x1872772280606336:12345-192.168.202.56@tcp:39:umount.0 Request processed in 689us (1313us total) trans 4294968187 rc 0/0 00000100:00100000:1.0:1786015526.852244:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1327 00000020:00010000:3.0:1786015526.859497:0:6606:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8b74bf418000: total 0 00010000:00010000:3.0:1786015526.860576:0:6606:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8b74bf418000, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1786015526.860635:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:3.0:1786015526.860639:0:6606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015526.860654:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c5028c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cc4 expref: 8 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015526.861030:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:3.0:1786015526.861041:0:6606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015526.861052:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5026b6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c15 expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015526.861150:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b749802e100) 00010000:00010000:3.0:1786015526.861153:0:6606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015526.861158:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50269a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c0e expref: 6 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015526.861175:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8b748f24a900) 00010000:00010000:3.0:1786015526.861188:0:6606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786015526.861193:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50292c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8cd9 expref: 5 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015526.861205:0:6606:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8b74bf418000, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1786015526.861241:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015526.861244:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015526.861247:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015526.892586:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015526.892603:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015526.893573:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 39 count 2 00000040:00080000:2.0:1786015526.893588:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015527.090759:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304448768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015527.090927:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015527.091258:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304448768 00000100:00100000:0.0:1786015527.091269:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304448768 00000100:00100000:0.0:1786015527.091356:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1786015527.091368:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304448768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015527.091429:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015527.091495:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304448768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015527.091508:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1786015527.093093:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304448768:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786015527.788126:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786015528.802054:0:21423:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12r: lseek restores released file ===== 07:25:27 (1786015527) 00010000:00010000:2.0:1786015528.812065:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015529.089362:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015529.091444:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280606464 00000100:00100000:2.0:1786015529.091466:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280606464 00000100:00100000:2.0:1786015529.091734:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1328 00000100:00100000:2.0:1786015529.091750:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+47:31467:x1872772280606464:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1786015529.092135:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+47:31467:x1872772280606464:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 323us (2727us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015529.092147:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1328 00000100:00080000:1.0:1786015529.107100:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015529.126127:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015529.126203:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280606592 00000100:00100000:0.0:1786015529.126218:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280606592 00000100:00100000:0.0:1786015529.126294:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1329 00000100:00100000:0.0:1786015529.126305:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+99:31468:x1872772280606592:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015529.126332:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015529.126359:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c502a83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d57 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.126442:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502a8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.126459:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502a8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.126473:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502a8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.126491:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502a91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.126498:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502a91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.126505:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502a91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.126834:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502a8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.126843:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502a8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.126849:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502a8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.126854:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015529.126858:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502a8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.126866:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502a8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.127993:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015529.128002:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015529.128010:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502a8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.128020:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502a8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.128041:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502a91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.128049:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502a91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.128056:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502a91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.128063:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015529.129290:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502a91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.129312:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502a91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.129329:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9699eafa (ffff8b748f24a100) 00010000:00010000:0.0:1786015529.129332:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015529.129337:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502a91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.129344:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502a91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.129412:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c502a83 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d57 expref: 100 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.129429:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015529.129432:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015529.129437:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c502a83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d57 expref: 100 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.129448:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6800, rc 0) 00000100:00100000:0.0:1786015529.129557:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+99:31468:x1872772280606592:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3251us (3441us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015529.129568:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1329 00000100:00080000:0.0:1786015529.129628:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015529.148863:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015529.149447:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280606848 00000100:00100000:2.0:1786015529.149463:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280606848 00000100:00100000:2.0:1786015529.149535:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1330 00000100:00100000:2.0:1786015529.149547:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+99:31468:x1872772280606848:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:2.0:1786015529.150065:0:12526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015529.150325:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c502781 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c54 expref: 99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015529.150428:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:2.0:1786015529.150436:0:12526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015529.154242:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502a98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015529.154287:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c2a expref: 46 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015529.154298:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502a98 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015529.154573:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c2a expref: 46 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015529.154600:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c2a expref: 46 pid: 5795 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015529.155385:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381942300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304448896:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015529.155581:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d06b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786015529.173260:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015529.173349:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381942300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304448896:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015529.173391:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502a98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015529.173432:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280606976 00000100:00100000:1.0:1786015529.173440:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280606976 00010000:00010000:1.0:1786015529.173491:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c2a expref: 47 pid: 5795 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015529.173540:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 400 00000100:00100000:1.0:1786015529.173553:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2353:x1872772280606976:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015529.173576:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015529.173585:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c2a expref: 47 pid: 5795 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.173599:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c2a expref: 47 pid: 5795 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.173645:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5026fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8c2a expref: 47 pid: 5795 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.173666:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:1.0:1786015529.173672:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502a98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.173686:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502a98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.173694:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502a98 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.173722:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015529.173817:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+46:2353:x1872772280606976:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 266us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015529.173826:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 400 00010000:00010000:1.0:1786015529.173853:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502a98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.173862:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502a98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.173891:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502a9f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.173902:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502a9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.173911:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502a9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015529.175613:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 512 00010000:00010000:1.0:1786015529.175637:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502a98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.175650:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502a98 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.175659:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502a98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.175666:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488060a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015529.175672:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502a98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.175682:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502a98 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.175704:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:1.0:1786015529.175707:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015529.175714:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502a98 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.175721:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502a98 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786015529.175753:0:12526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000daf289f8 reply state 000000002b2c8d52 transno 4294968188 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502a9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015529.175799:0:12526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786015529.175927:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+100:31468:x1872772280606848:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 26374us (27085us total) trans 4294968188 rc 0/0 00000100:00100000:1.0:1786015529.175938:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1330 00000100:00100000:1.0:1786015529.193105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:0.0:1786015529.193893:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502a9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.193910:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502a9f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.193918:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502a9f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.193924:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015529.193929:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502a9f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.193937:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502a9f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.194016:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9699eafa (ffff8b748f194200) 00010000:00010000:0.0:1786015529.194020:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015529.194025:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502a9f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.194031:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502a9f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015529.194774:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280607104 00000100:00100000:2.0:1786015529.194794:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280607104 00000100:00100000:2.0:1786015529.195013:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1331 00000100:00100000:2.0:1786015529.195026:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+99:31469:x1872772280607104:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1786015529.195061:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015529.195092:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502aa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d5e expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015529.195191:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502aad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015529.195208:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502aad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015529.195226:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502aad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015529.201105:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1786015529.201121:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 32 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015529.201186:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502aad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015529.201254:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502aa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d5e expref: 101 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015529.201281:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502aad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d5e expref: 100 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015529.201292:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06200) 00010000:00010000:2.0:1786015529.201295:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015529.201299:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488060200, rc 0) 00000100:00100000:2.0:1786015529.201400:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+100:31469:x1872772280607104:12345-192.168.202.56@tcp:101:bash.0 Request processed in 6375us (8789us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015529.201411:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1331 00000100:00100000:1.0:1786015529.220035:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015529.220104:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280607232 00000100:00100000:3.0:1786015529.220125:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280607232 00000100:00100000:3.0:1786015529.220217:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1332 00000100:00100000:3.0:1786015529.220230:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+100:31469:x1872772280607232:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1786015529.220256:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015529.220282:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502ab4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d65 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.220362:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502abb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.220379:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502abb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.220393:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502abb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.220411:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502ac2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.220418:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.220424:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.221334:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c502ac9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.221346:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c502ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.221355:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c502ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015529.221392:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 512 00000004:00200000:3.0:1786015529.221397:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015529.221427:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c502ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.221440:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502abb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.221446:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502abb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.221453:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502abb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.221459:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015529.221465:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502abb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.221472:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502abb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.221486:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06200) 00010000:00010000:3.0:1786015529.225040:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015529.225060:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502abb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.225073:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502abb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.225096:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.225103:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502ac2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.225114:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.225120:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015529.225124:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.225132:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.225148:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9699eafa (ffff8b74a04b5b00) 00010000:00010000:3.0:1786015529.225150:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015529.225169:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502ac2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.225176:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502ac2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.225228:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502ab4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d65 expref: 102 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.225244:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc800/0xb1a5ef690c502ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d65 expref: 101 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.225250:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:3.0:1786015529.225252:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786015529.225255:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc800, rc 0) 00000001:00100000:1.0:1786015529.226287:0:7497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 15271907-a1cf-47fa-aa4f-97fea3c6cdd8 00000020:00000080:1.0:1786015529.226298:0:7497:0:(genops.c:906:class_export_put()) final put ffff8b74bf862000/15271907-a1cf-47fa-aa4f-97fea3c6cdd8 00000020:00000080:1.0:1786015529.226356:0:14414:0:(genops.c:865:class_export_destroy()) destroying export ffff8b74bf862000/15271907-a1cf-47fa-aa4f-97fea3c6cdd8 for lustre-OST0001 00000020:00000080:1.0:1786015529.226415:0:14414:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b74bf860800 for lustre-OST0001 00000100:00100000:3.0:1786015529.227108:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+101:31469:x1872772280607232:12345-192.168.202.56@tcp:101:bash.0 Request processed in 5109us (5316us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015529.227129:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1332 00000100:00100000:1.0:1786015529.254112:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015529.254176:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280607360 00000100:00100000:0.0:1786015529.254195:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280607360 00000100:00100000:1.0:1786015529.255089:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1333 00000100:00100000:1.0:1786015529.255117:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+101:31469:x1872772280607360:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1786015529.255162:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015529.255197:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c502ad0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d6c expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.255709:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ad7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.255736:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.255753:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.255800:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502ade lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.255809:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.255816:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.258319:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.258551:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ad7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.258560:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ad7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.258566:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015529.258572:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ad7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.258582:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ad7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.258606:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:1.0:1786015529.258976:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015529.258985:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ad7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.258993:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ad7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.259016:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.259022:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502ade lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.259027:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.259033:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015529.259037:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.259044:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502ade lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.259057:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff8b748f194a00) 00010000:00010000:1.0:1786015529.259060:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015529.259064:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502ade lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.259069:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502ade lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.259142:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c502ad0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d6c expref: 102 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.259171:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:1.0:1786015529.259174:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015529.259178:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c502ad0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d6c expref: 102 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.259189:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921e00, rc 0) 00000100:00100000:1.0:1786015529.259304:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+101:31469:x1872772280607360:12345-192.168.202.56@tcp:101:bash.0 Request processed in 4198us (5211us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015529.259317:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1333 00000001:00100000:1.0:1786015529.261835:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 15271907-a1cf-47fa-aa4f-97fea3c6cdd8 00000001:00080000:1.0:1786015529.261859:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968187 is committed 00000020:00000080:1.0:1786015529.261891:0:5816:0:(genops.c:906:class_export_put()) final put ffff8b74bf418000/15271907-a1cf-47fa-aa4f-97fea3c6cdd8 00000020:00080000:1.0:1786015529.261918:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 30 batchid updated 00000020:00080000:3.0:1786015529.264538:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30 00000020:00080000:3.0:1786015529.264560:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30 00000020:00000080:0.0:1786015529.264648:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8b74bf418000/15271907-a1cf-47fa-aa4f-97fea3c6cdd8 for lustre-MDT0000 00000020:00000080:0.0:1786015529.264728:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b74bf41b000 for lustre-MDT0000 00000100:00100000:1.0:1786015529.270476:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015529.270606:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280607488 00000100:00100000:3.0:1786015529.270627:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280607488 00000100:00100000:3.0:1786015529.270716:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1334 00000100:00100000:3.0:1786015529.270728:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+46:31470:x1872772280607488:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015529.270752:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015529.270822:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502ae5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d73 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.270901:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502aec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.270915:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502aec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.270928:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502aec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015529.270994:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1786015529.270998:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 32 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015529.271025:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502aec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.271050:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502ae5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d73 expref: 48 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.271069:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502aec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d73 expref: 47 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.271080:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06200) 00010000:00010000:3.0:1786015529.271083:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015529.271086:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbcc00, rc 0) 00000100:00100000:3.0:1786015529.271188:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+47:31470:x1872772280607488:12345-192.168.202.56@tcp:101:rm.0 Request processed in 431us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015529.271196:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1334 00000100:00100000:0.0:1786015529.284387:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015529.284499:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280607616 00000100:00100000:3.0:1786015529.284510:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280607616 00000100:00100000:3.0:1786015529.284576:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1335 00000100:00100000:3.0:1786015529.284588:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+47:31470:x1872772280607616:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015529.284613:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015529.284636:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502af3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d7a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.284706:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502afa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.284724:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502afa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.284736:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502afa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.284752:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502b01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.284812:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502b01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.284825:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502b01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.284957:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502b08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.284966:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.284973:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015529.285007:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 512 00000004:00200000:3.0:1786015529.285011:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015529.285034:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.285047:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502afa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.285053:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502afa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.285060:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502afa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.285066:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015529.285071:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502afa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.285078:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502afa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.285090:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06200) 00010000:00010000:3.0:1786015529.285093:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015529.285098:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502afa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.285104:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc000/0xb1a5ef690c502afa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.285118:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502b01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.285125:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502b01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.285131:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502b01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.285137:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015529.285139:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502b01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.285146:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502b01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.285167:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9699eafa (ffff8b7499c59e00) 00010000:00010000:3.0:1786015529.285170:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015529.285173:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502b01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.285179:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502b01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.285215:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502af3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d7a expref: 49 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.285229:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd200/0xb1a5ef690c502b08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d7a expref: 48 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.285237:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:3.0:1786015529.285239:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786015529.285242:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd200, rc 0) 00000100:00100000:3.0:1786015529.285297:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+48:31470:x1872772280607616:12345-192.168.202.56@tcp:101:rm.0 Request processed in 711us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015529.285306:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1335 00000100:00100000:2.0:1786015529.299968:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015529.301882:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280607744 00000100:00100000:1.0:1786015529.301900:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280607744 00000100:00100000:0.0:1786015529.304893:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1336 00000100:00100000:0.0:1786015529.304911:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:31470:x1872772280607744:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:0.0:1786015529.304934:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015529.304971:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502b0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d81 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305052:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305081:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305095:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305111:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305119:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305131:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305214:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305222:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305229:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305236:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015529.305240:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305248:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305259:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:0.0:1786015529.305263:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015529.305267:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305273:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305286:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305293:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305299:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305305:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015529.305308:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305314:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305321:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff8b748f24a600) 00010000:00010000:0.0:1786015529.305323:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015529.305326:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305333:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305366:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502b0f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d81 expref: 49 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305377:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:0.0:1786015529.305379:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015529.305383:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502b0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d81 expref: 49 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.305393:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7800, rc 0) 00000100:00100000:0.0:1786015529.305458:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:31470:x1872772280607744:12345-192.168.202.56@tcp:101:rm.0 Request processed in 554us (5501us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015529.305469:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1336 00000100:00100000:2.0:1786015529.319907:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015529.320082:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280607872 00000100:00100000:0.0:1786015529.320095:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280607872 00000100:00100000:0.0:1786015529.320171:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1337 00000100:00100000:0.0:1786015529.320183:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+48:31470:x1872772280607872:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:0.0:1786015529.320209:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015529.320240:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502b24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d88 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320318:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320334:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320347:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320364:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320371:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320377:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320447:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320460:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320467:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320474:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015529.320478:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320486:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320499:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:0.0:1786015529.320502:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015529.320507:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320513:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320527:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320533:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320539:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320545:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015529.320548:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320554:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320562:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff8b748f24a600) 00010000:00010000:0.0:1786015529.320564:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015529.320567:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320573:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320681:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502b24 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d88 expref: 49 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320692:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:0.0:1786015529.320694:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015529.320698:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502b24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d88 expref: 49 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.320706:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7800, rc 0) 00000100:00100000:0.0:1786015529.321111:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+48:31470:x1872772280607872:12345-192.168.202.56@tcp:101:rm.0 Request processed in 927us (1209us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015529.321121:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1337 00000100:00100000:1.0:1786015529.352175:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015529.352297:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280608000 00000100:00100000:0.0:1786015529.352307:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280608000 00000100:00100000:0.0:1786015529.352367:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1338 00000100:00100000:0.0:1786015529.352376:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+48:31471:x1872772280608000:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015529.352399:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015529.352420:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502b39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d8f expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352486:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352500:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352512:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352525:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352532:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352539:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352606:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352613:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b40 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352619:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352625:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015529.352630:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352638:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b40 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352650:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:0.0:1786015529.352652:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015529.352657:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352663:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352677:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352683:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352688:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352693:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015529.352696:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352701:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352708:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff8b748f24a600) 00010000:00010000:0.0:1786015529.352710:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015529.352714:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352720:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352754:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502b39 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d8f expref: 49 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352830:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:0.0:1786015529.352832:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015529.352836:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502b39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d8f expref: 49 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.352845:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7800, rc 0) 00000100:00100000:0.0:1786015529.352906:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+48:31471:x1872772280608000:12345-192.168.202.56@tcp:101:cp.0 Request processed in 531us (752us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015529.352913:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1338 00000100:00100000:1.0:1786015529.358997:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015529.359116:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280608128 00000100:00100000:0.0:1786015529.359127:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280608128 00000100:00100000:0.0:1786015529.359192:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1339 00000100:00100000:0.0:1786015529.359202:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:31471:x1872772280608128:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015529.359225:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015529.359249:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d96 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359325:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b55 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359355:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359368:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359382:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359389:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359395:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359458:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359465:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359471:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359477:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015529.359481:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359488:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359499:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:0.0:1786015529.359503:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015529.359507:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359513:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502b55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359525:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359531:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359536:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359542:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015529.359544:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359550:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359557:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff8b748f24a600) 00010000:00010000:0.0:1786015529.359560:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015529.359563:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359569:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359607:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b4e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d96 expref: 49 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359618:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:0.0:1786015529.359620:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015529.359624:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d96 expref: 49 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.359632:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7e00, rc 0) 00000100:00100000:0.0:1786015529.359697:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:31471:x1872772280608128:12345-192.168.202.56@tcp:101:cp.0 Request processed in 496us (711us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015529.359704:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1339 00000100:00100000:1.0:1786015529.364024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015529.364215:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280608384 00000100:00100000:3.0:1786015529.364227:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280608384 00000100:00100000:1.0:1786015529.364426:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1340 00000100:00100000:1.0:1786015529.364437:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+48:31471:x1872772280608384:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015529.364458:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015529.364484:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c502b63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8d9d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.364629:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502b6a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.364644:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502b6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.364657:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502b6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.364671:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502b71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.364678:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.364684:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786015529.365472:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a:0x0], index 0: 0 00010000:00010000:1.0:1786015529.365660:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502b78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.365673:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502b78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.365695:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502b78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.365735:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502b6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.365742:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502b6a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.365748:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502b6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.365754:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015529.365789:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502b6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.365798:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502b6a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.365812:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:1.0:1786015529.365814:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015529.365818:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502b6a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.365824:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502b6a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786015529.365837:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e6fefb18 reply state 00000000bd8c7f28 transno 4294968189 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015529.365846:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786015529.365881:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c502b63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d9d expref: 51 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.365895:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502b78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d9d expref: 50 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.365903:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b748f194e00) 00010000:00010000:1.0:1786015529.365906:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015529.365908:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921c00, rc 0) 00000100:00100000:1.0:1786015529.365974:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:31471:x1872772280608384:12345-192.168.202.56@tcp:101:cp.0 Request processed in 1540us (2033us total) trans 4294968189 rc 0/0 00000100:00100000:1.0:1786015529.365984:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1340 00010000:00010000:3.0:1786015529.368423:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.368441:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502b71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.368448:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502b71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.368455:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015529.368459:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502b71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.368467:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502b71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.368484:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff8b748f194a00) 00010000:00010000:3.0:1786015529.368488:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015529.368492:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502b71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015529.368499:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502b71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015529.371559:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015529.372729:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280608512 00000100:00100000:2.0:1786015529.372743:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280608512 00000100:00100000:2.0:1786015529.372841:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 369 00000100:00100000:2.0:1786015529.372852:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2352:x1872772280608512:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015529.372869:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015529.372891:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502b86 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8da4 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015529.372918:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786015529.372939:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=764s v=(0 0) 00010000:00010000:2.0:1786015529.372953:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015529.372962:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502b86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8da4 expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015529.372980:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502b86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8da4 expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015529.372996:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488060a00, rc 0) 00000100:00100000:2.0:1786015529.373050:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280608512:12345-192.168.202.56@tcp:101:cp.0 Request processed in 201us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015529.373057:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 369 00000100:00080000:0.0:1786015529.374111:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015529.377485:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015529.377673:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280608640 00000100:00100000:1.0:1786015529.377683:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280608640 00000100:00100000:1.0:1786015529.377750:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 370 00000100:00100000:1.0:1786015529.377793:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:31471:x1872772280608640:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015529.377812:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015529.377831:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c502b8d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8dab expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.377863:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502b86 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8da4 expref: 10 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.377871:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015529.377875:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015529.377880:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c502b8d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dab expref: 10 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.377912:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502b86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8da4 expref: 10 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.377926:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502b86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8da4 expref: 10 pid: 6590 timeout: 864 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015529.377939:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304449024:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015529.378196:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7484eefd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786015529.386976:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304449024:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015529.387015:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c502b8d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dab expref: 10 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015529.387034:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921200, rc 0) 00000100:00100000:2.0:1786015529.387090:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:31471:x1872772280608640:12345-192.168.202.56@tcp:101:cp.0 Request processed in 9333us (9616us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015529.387099:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 370 00000100:00100000:3.0:1786015529.388270:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015529.388373:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280608768 00000100:00100000:0.0:1786015529.388383:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280608768 00010000:00010000:0.0:1786015529.388425:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502b86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8da4 expref: 10 pid: 6590 timeout: 864 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015529.388470:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 401 00000100:00100000:0.0:1786015529.388480:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8979c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280608768:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015529.388505:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015529.388529:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502b86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8da4 expref: 10 pid: 6590 timeout: 864 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.388544:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502b86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8da4 expref: 10 pid: 6590 timeout: 864 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.388568:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502b86 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8da4 expref: 10 pid: 6590 timeout: 864 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.388594:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015529.388599:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015529.388609:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c502b8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dab expref: 9 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.388620:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c502b8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dab expref: 9 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.388658:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c502b8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dab expref: 9 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015529.388682:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa475f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5782:1872772304449152:192.168.202.56@tcp:105: 00000100:00100000:0.0:1786015529.388803:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c0f0acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015529.394942:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa475f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5782:1872772304449152:192.168.202.56@tcp:105: 00010000:00010000:0.0:1786015529.394972:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015529.395056:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015529.395270:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8979c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280608768:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 6790us (7005us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015529.395283:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 401 00000100:00100000:1.0:1786015529.395310:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280609024 00000100:00100000:1.0:1786015529.395319:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280609024 00000100:00100000:1.0:1786015529.395811:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 271 00000100:00100000:1.0:1786015529.395822:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+50:31471:x1872772280609024:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:1.0:1786015529.396212:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:31471:x1872772280609024:12345-192.168.202.56@tcp:35:cp.0 Request processed in 391us (1156us total) trans 4294968190 rc 0/0 00000100:00100000:1.0:1786015529.396221:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 271 00000100:00100000:3.0:1786015529.437077:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015529.437174:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280609152 00000100:00100000:0.0:1786015529.437184:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280609152 00000100:00100000:0.0:1786015529.437251:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1341 00000100:00100000:0.0:1786015529.437261:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+101:31474:x1872772280609152:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015529.437287:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015529.437315:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8db2 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437412:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b9b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437430:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437442:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437458:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502ba2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437465:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437472:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437593:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502ba9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437602:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437609:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015529.437645:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 158 00000004:00200000:0.0:1786015529.437650:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015529.437669:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437692:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437705:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437710:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b9b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437717:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437724:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015529.437728:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437737:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437749:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:0.0:1786015529.437752:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015529.437758:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437814:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502b9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437828:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437833:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502ba2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437839:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437845:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015529.437849:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437855:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437863:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff8b748f24a600) 00010000:00010000:0.0:1786015529.437865:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015529.437868:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502ba2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437874:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502ba2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437906:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502b94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8db2 expref: 103 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437919:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8db2 expref: 102 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.437927:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b748f194e00) 00010000:00010000:0.0:1786015529.437930:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015529.437932:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7800, rc 0) 00000100:00100000:0.0:1786015529.438269:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+102:31474:x1872772280609152:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1007us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015529.438278:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1341 00000100:00100000:3.0:1786015529.444215:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015529.444920:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280609280 00000100:00100000:1.0:1786015529.444932:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280609280 00000100:00100000:1.0:1786015529.445091:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 371 00000100:00100000:1.0:1786015529.445103:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280609280:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015529.445123:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015529.445146:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004affeb6d/0xb1a5ef690c502bb0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8db9 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015529.445219:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304449280:192.168.202.56@tcp:106: 00000100:00100000:1.0:1786015529.445325:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7490fa2e40 going to sleep for 11 seconds 00000100:00080000:0.0:1786015529.446516:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1786015529.448161:0:6591:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1786015529.448172:0:6591:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb mtime: 0 -> 1786015529 00002000:00010000:1.0:1786015529.448174:0:6591:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb atime: 0 -> 1786015529 00002000:00010000:1.0:1786015529.448176:0:6591:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb ctime: 0 -> 1786015529 00000100:00100000:1.0:1786015529.448206:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304449280:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015529.448262:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004affeb6d/0xb1a5ef690c502bb0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8db9 expref: 17 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.448290:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004affeb6d/0xb1a5ef690c502bb0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8db9 expref: 17 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.448303:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921600, rc 0) 00000100:00100000:1.0:1786015529.448382:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280609280:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3280us (4176us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015529.448390:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 371 00000100:00100000:3.0:1786015529.453113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015529.453211:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280609408 00000100:00100000:1.0:1786015529.453221:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280609408 00000100:00100000:1.0:1786015529.453294:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1342 00000100:00100000:1.0:1786015529.453304:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+102:31474:x1872772280609408:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015529.453326:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015529.453464:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c502bb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8dc0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.453543:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502bbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.453558:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.453572:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015529.453637:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 512 00000004:00200000:1.0:1786015529.453641:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015529.453667:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.453705:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c502bb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dc0 expref: 104 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.453728:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502bbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dc0 expref: 103 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.453737:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:1.0:1786015529.453740:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015529.453744:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920000, rc 0) 00000100:00100000:1.0:1786015529.453837:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+103:31474:x1872772280609408:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 535us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015529.453844:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1342 00000100:00100000:3.0:1786015529.457966:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015529.458065:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280609536 00000100:00100000:0.0:1786015529.458080:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280609536 00000100:00100000:0.0:1786015529.458143:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 372 00000100:00100000:0.0:1786015529.458164:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280609536:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015529.458185:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015529.458207:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3802bfa/0xb1a5ef690c502bc5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8dc7 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015529.458285:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa475f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304449408:192.168.202.56@tcp:106: 00000100:00100000:0.0:1786015529.458405:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c0f0acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015529.461593:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa475f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304449408:192.168.202.56@tcp:106: 00010000:00010000:0.0:1786015529.461633:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e3802bfa/0xb1a5ef690c502bc5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dc7 expref: 17 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.461660:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3802bfa/0xb1a5ef690c502bc5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dc7 expref: 17 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015529.461673:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7e00, rc 0) 00000100:00100000:0.0:1786015529.461739:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280609536:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3587us (3787us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015529.461748:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 372 00000100:00100000:3.0:1786015529.467041:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015529.467160:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280609792 00000100:00100000:2.0:1786015529.467171:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280609792 00000100:00100000:2.0:1786015529.467248:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1343 00000100:00100000:2.0:1786015529.467260:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+103:31474:x1872772280609792:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:2.0:1786015529.467652:0:7673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].39, 136 off13496 00000100:00100000:2.0:1786015529.467758:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+103:31474:x1872772280609792:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 500us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015529.467803:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1343 00000100:00100000:3.0:1786015529.542044:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015529.542099:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015529.542142:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015529.542187:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015529.542220:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015529.542265:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280610048 00000100:00100000:3.0:1786015529.542277:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280610048 00000100:00100000:3.0:1786015529.542330:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280610432 00000100:00100000:3.0:1786015529.542333:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280610432 00000100:00100000:3.0:1786015529.542380:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 527 00000100:00100000:3.0:1786015529.542391:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280610432:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015529.542475:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8e63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280610432:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 86us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015529.542484:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 527 00000100:00100000:3.0:1786015529.542500:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280610304 00000100:00100000:3.0:1786015529.542504:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280610304 00000100:00100000:3.0:1786015529.542522:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 528 00000100:00100000:3.0:1786015529.542528:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+14:2354:x1872772280610304:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015529.542556:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+14:2354:x1872772280610304:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015529.542563:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 528 00000100:00100000:3.0:1786015529.542575:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 373 00000100:00100000:3.0:1786015529.542581:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280610048:12345-192.168.202.56@tcp:16:kworker.0 00000100:00100000:3.0:1786015529.542644:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280610048:12345-192.168.202.56@tcp:16:kworker.0 Request processed in 63us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015529.542651:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 373 00000100:00080000:3.0:1786015529.542841:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015529.543043:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280610176 00000100:00100000:1.0:1786015529.543049:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280610176 00000100:00100000:1.0:1786015529.543090:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 626 00000100:00100000:1.0:1786015529.543097:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280610176:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015529.543131:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280610176:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 35us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015529.543137:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 626 00000100:00100000:0.0:1786015529.543657:0:17969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280609920 00000100:00100000:0.0:1786015529.543664:0:17969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280609920 00002000:00100000:0.0:1786015529.543701:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1a:0x0] (0->157) req@ffff8b74c0cf0700 x1872772280609920/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:375/0 lens 648/0 e 0 to 0 dl 1786015540 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015529.543712:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c0cf0700 with x1872772280609920 ext(0->157) 00002000:00010000:0.0:1786015529.543719:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74c0cf0700 00000100:00100000:0.0:1786015529.543747:0:17969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 117 00000100:00100000:0.0:1786015529.543755:0:17969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280609920:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:0.0:1786015529.544333:0:17969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280609920:12345-192.168.202.56@tcp:4:cp.0 Request processed in 576us (2299us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1786015529.544528:0:17969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 117 00002000:00100000:0.0:1786015529.544538:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1a:0x0] (0->157) req@ffff8b74c0cf0700 x1872772280609920/t4294967368(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:375/0 lens 648/448 e 0 to 0 dl 1786015540 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015529.544548:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c0cf0700 with x1872772280609920 ext(0->157) 00002000:00010000:0.0:1786015529.544553:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74c0cf0700 00010000:00010000:1.0:1786015529.838461:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015529.970393:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015529.970401:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015529.970444:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 40 count 3 00000040:00080000:3.0:1786015529.970451:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015529.970753:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304449536:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015529.970872:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74937c6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786015529.986878:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015529.986920:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280610560 00000100:00100000:3.0:1786015529.986929:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280610560 00000100:00100000:3.0:1786015529.986980:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1344 00000100:00100000:3.0:1786015529.986989:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+52:31485:x1872772280610560:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015529.987024:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x28:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015529.987126:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+52:31485:x1872772280610560:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 138us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015529.987132:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1344 00000100:00100000:2.0:1786015529.994947:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304449536:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786015529.996176:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015529.996243:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280610816 00000100:00100000:1.0:1786015529.996252:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280610816 00000100:00100000:1.0:1786015529.996313:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1345 00000100:00100000:1.0:1786015529.996323:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+51:31485:x1872772280610816:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015529.996347:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015529.996371:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c502bcc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8dce expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.996475:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502bd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.996492:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.996505:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015529.996517:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 158 00010000:00010000:1.0:1786015529.996890:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c502bcc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dce expref: 54 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.996909:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dce expref: 53 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015529.996918:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b748f194e00) 00010000:00010000:1.0:1786015529.996921:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015529.996925:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921600, rc 0) 00000100:00100000:1.0:1786015529.996988:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:31485:x1872772280610816:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 666us (818us total) trans 4294968191 rc 0/0 00000100:00100000:1.0:1786015529.996996:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1345 00000100:00100000:2.0:1786015530.012082:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015530.012126:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015530.012204:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280610944 00000100:00100000:1.0:1786015530.012214:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280610944 00000100:00100000:1.0:1786015530.012272:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:1.0:1786015530.012281:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280610944:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015530.012297:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015530.012322:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502bd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dce expref: 53 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.012340:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b748f194e00) 00010000:00010000:1.0:1786015530.012345:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015530.012389:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+52:2353:x1872772280610944:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 109us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015530.012395:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:3.0:1786015530.016177:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280611072 00000100:00100000:3.0:1786015530.016191:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280611072 00000100:00100000:3.0:1786015530.016295:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 374 00000100:00100000:3.0:1786015530.016307:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280611072:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015530.016359:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ac472ba5/0xb1a5ef690c502be1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.016382:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c502b8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dab expref: 11 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.016390:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1a:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786015530.016395:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015530.016400:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac472ba5/0xb1a5ef690c502be1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.016442:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c502b8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dab expref: 11 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.016459:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c502b8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dab expref: 11 pid: 14547 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015530.016475:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304449664:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015530.016573:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482b33900 going to sleep for 11 seconds 00000100:00100000:1.0:1786015530.024814:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015530.024821:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304449664:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015530.024851:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ac472ba5/0xb1a5ef690c502be1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015530.024989:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280611200 00000100:00100000:1.0:1786015530.024996:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280611200 00010000:00010000:1.0:1786015530.025032:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c502b8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dab expref: 12 pid: 14547 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015530.025080:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 402 00000100:00100000:1.0:1786015530.025091:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280611200:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015530.025106:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015530.025131:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c502b8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dab expref: 12 pid: 14547 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.025154:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c502b8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dab expref: 12 pid: 14547 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.025178:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006703c5f5/0xb1a5ef690c502b8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dab expref: 12 pid: 14547 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.025193:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015530.025198:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015530.025204:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac472ba5/0xb1a5ef690c502be1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.025214:0:17038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac472ba5/0xb1a5ef690c502be1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.025316:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015530.025376:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280611200:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 286us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015530.025385:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 402 00010000:00010000:3.0:1786015530.026795:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ac472ba5/0xb1a5ef690c502be1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.026813:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac472ba5/0xb1a5ef690c502be1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.026847:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ac472ba5/0xb1a5ef690c502be1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.026855:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac472ba5/0xb1a5ef690c502be1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.026863:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac472ba5/0xb1a5ef690c502be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.026870:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd600 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015530.026875:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac472ba5/0xb1a5ef690c502be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.026883:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac472ba5/0xb1a5ef690c502be1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.026904:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac472ba5/0xb1a5ef690c502be1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.026911:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac472ba5/0xb1a5ef690c502be1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015530.026992:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280611072:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 10684us (14861us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015530.027001:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 374 00000100:00100000:1.0:1786015530.035393:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015530.038861:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280611456 00000100:00100000:3.0:1786015530.038877:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280611456 00000100:00100000:3.0:1786015530.038954:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1346 00000100:00100000:3.0:1786015530.038964:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+52:31485:x1872772280611456:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786015530.039092:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+52:31485:x1872772280611456:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 128us (3707us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015530.039099:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1346 00000100:00100000:1.0:1786015530.044313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015530.045547:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280611584 00000100:00100000:3.0:1786015530.045561:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280611584 00000100:00100000:3.0:1786015530.045629:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 375 00000100:00100000:3.0:1786015530.045640:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280611584:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015530.045658:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015530.045678:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c502be8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8dd5 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015530.045710:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 158, mtime: 0x6a746f29, atime: 0x0, ctime: 0x6a746f29, blocks: 0x1 00010000:00010000:3.0:1786015530.045727:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1786015530.045731:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015530.045741:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c502be8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dd5 expref: 11 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.045758:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c502be8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dd5 expref: 11 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.045796:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbdc00, rc 0) 00000100:00100000:3.0:1786015530.045865:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280611584:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 227us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015530.045872:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 375 00000100:00100000:1.0:1786015530.053057:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015530.053207:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280611840 00000100:00100000:3.0:1786015530.053218:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280611840 00000100:00100000:3.0:1786015530.053281:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1347 00000100:00100000:3.0:1786015530.053291:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+52:31485:x1872772280611840:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786015530.053405:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+52:31485:x1872772280611840:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 115us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015530.053412:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1347 00000100:00100000:1.0:1786015530.058519:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015530.060956:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280611968 00000100:00100000:0.0:1786015530.060972:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280611968 00002000:00100000:0.0:1786015530.061033:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1a:0x0] (0->4095) req@ffff8b7381307480 x1872772280611968/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:376/0 lens 488/0 e 0 to 0 dl 1786015541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015530.061045:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381307480 with x1872772280611968 ext(0->4095) 00002000:00010000:0.0:1786015530.061051:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7381307480 00000100:00100000:0.0:1786015530.061095:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 118 00000100:00100000:0.0:1786015530.061105:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280611968:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1786015530.061381:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280611968:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 276us (2870us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786015530.061389:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 118 00002000:00100000:0.0:1786015530.061396:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1a:0x0] (0->4095) req@ffff8b7381307480 x1872772280611968/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:376/0 lens 488/4536 e 0 to 0 dl 1786015541 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015530.061412:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381307480 with x1872772280611968 ext(0->4095) 00002000:00010000:0.0:1786015530.061416:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7381307480 00000100:00100000:0.0:1786015530.086823:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015530.086936:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280612096 00000100:00100000:1.0:1786015530.086948:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280612096 00000100:00100000:1.0:1786015530.087010:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1348 00000100:00100000:1.0:1786015530.087022:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+52:31485:x1872772280612096:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015530.087044:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015530.087068:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c502bef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ddc expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.087113:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502bf6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.087129:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.087141:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.087256:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c502bef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ddc expref: 54 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.087274:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ddc expref: 53 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.087283:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b748f194e00) 00010000:00010000:1.0:1786015530.087285:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015530.087289:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921600, rc 0) 00000100:00100000:1.0:1786015530.087345:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:31485:x1872772280612096:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 325us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015530.087353:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1348 00000100:00100000:2.0:1786015530.093828:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015530.093925:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280612224 00000100:00100000:3.0:1786015530.093936:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280612224 00000100:00100000:3.0:1786015530.094007:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1349 00000100:00100000:3.0:1786015530.094019:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+53:31485:x1872772280612224:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015530.094057:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x28:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015530.094180:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+53:31485:x1872772280612224:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 162us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015530.094188:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1349 00000100:00100000:0.0:1786015530.111016:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015530.112743:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280612352 00000100:00100000:2.0:1786015530.112781:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280612352 00000100:00100000:2.0:1786015530.112896:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 376 00000100:00100000:2.0:1786015530.112907:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280612352:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786015530.112956:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502bfd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.112974:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015530.112978:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015530.112985:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502bfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.113004:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502bfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.113033:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502bfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.113041:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502bfd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.113050:0:14547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502bfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.113057:0:14547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061e00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015530.113061:0:14547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502bfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.113070:0:14547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502bfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.113085:0:14547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502bfd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.113092:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502bfd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015530.113188:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280612352:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 282us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015530.113196:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 376 00000100:00100000:3.0:1786015530.117514:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015530.117658:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280612608 00000100:00100000:0.0:1786015530.117668:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280612608 00000100:00100000:2.0:1786015530.117798:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1350 00000100:00100000:2.0:1786015530.117811:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:31485:x1872772280612608:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1786015530.117902:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c04 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.117921:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502bf6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ddc expref: 53 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.117929:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c04 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.117963:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ddc expref: 53 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.117979:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502bf6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ddc expref: 53 pid: 7673 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015530.117994:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304449792:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015530.118082:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74939ea780 going to sleep for 11 seconds 00000100:00100000:0.0:1786015530.121222:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304449792:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015530.121256:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c04 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015530.121883:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015530.121987:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280612736 00000100:00100000:2.0:1786015530.121995:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280612736 00010000:00010000:2.0:1786015530.122035:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502bf6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ddc expref: 54 pid: 7673 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015530.122083:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 403 00000100:00100000:2.0:1786015530.122093:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabf6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+54:2353:x1872772280612736:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015530.122107:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015530.122114:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502bf6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ddc expref: 54 pid: 7673 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.122125:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ddc expref: 54 pid: 7673 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.122158:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502bf6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ddc expref: 54 pid: 7673 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.122172:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b748f194e00) 00010000:00010000:2.0:1786015530.122177:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c04 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.122187:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.122204:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c04 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.122229:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015530.122276:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabf6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280612736:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 184us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015530.122283:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 403 00010000:00010000:0.0:1786015530.122833:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.122852:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.123049:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.123058:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c04 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.123064:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c04 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.123070:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015530.123074:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c04 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.123086:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c04 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.123098:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b748f194e00) 00010000:00010000:0.0:1786015530.123100:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015530.123104:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c04 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.123110:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c04 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015530.123267:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:31485:x1872772280612608:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 5457us (5760us total) trans 4294968192 rc 0/0 00000100:00100000:0.0:1786015530.123276:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1350 00000040:00080000:2.0:1786015530.123582:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015530.123587:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015530.124155:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1786015530.124165:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015530.132675:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015530.132911:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280612992 00000100:00100000:1.0:1786015530.132922:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280612992 00000100:00100000:1.0:1786015530.132988:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 272 00000100:00100000:1.0:1786015530.132997:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916ad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:31485:x1872772280612992:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015530.133270:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916ad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+54:31485:x1872772280612992:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 273us (604us total) trans 4294968193 rc 0/0 00000100:00100000:1.0:1786015530.133279:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 272 00000100:00100000:3.0:1786015530.156100:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786015530.156124:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304449920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015530.156213:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015530.156308:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304449920 00000100:00100000:1.0:1786015530.156316:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304449920 00000100:00100000:1.0:1786015530.156380:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1786015530.156390:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304449920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015530.156415:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015530.156466:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304449920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015530.156473:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:3.0:1786015530.156547:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015530.156597:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304449920:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1786015530.232848:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967368 is committed 00000001:00100000:1.0:1786015530.232876:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 15271907-a1cf-47fa-aa4f-97fea3c6cdd8 00000020:00000080:1.0:1786015530.232881:0:6617:0:(genops.c:906:class_export_put()) final put ffff8b74b8e25800/15271907-a1cf-47fa-aa4f-97fea3c6cdd8 00000020:00000080:0.0:1786015530.232991:0:14414:0:(genops.c:865:class_export_destroy()) destroying export ffff8b74b8e25800/15271907-a1cf-47fa-aa4f-97fea3c6cdd8 for lustre-OST0000 00000020:00000080:0.0:1786015530.233056:0:14414:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8b74b8e25000 for lustre-OST0000 00000040:00080000:2.0:1786015530.449925:0:21474:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015530.449934:0:21474:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015530.449978:0:21474:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 40 count 3 00000040:00080000:2.0:1786015530.449984:0:21474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015530.527084:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015530.531312:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280613120 00000100:00100000:2.0:1786015530.531332:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280613120 00000100:00100000:2.0:1786015530.531523:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 377 00000100:00100000:2.0:1786015530.531536:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2351:x1872772280613120:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015530.531561:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015530.531585:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502c0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8de3 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.531619:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015530.531624:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015530.531634:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502c0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8de3 expref: 17 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.531655:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502c0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8de3 expref: 17 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.531672:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488060a00, rc 0) 00000100:00100000:2.0:1786015530.531757:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280613120:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 224us (4687us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015530.531789:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 377 00000100:00100000:0.0:1786015530.548809:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015530.549290:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280613376 00000100:00100000:3.0:1786015530.549305:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280613376 00000100:00100000:3.0:1786015530.549374:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1351 00000100:00100000:3.0:1786015530.549385:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+103:31486:x1872772280613376:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015530.549407:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015530.549430:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502c12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8dea expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.549532:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502c19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.549547:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502c19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.549558:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502c19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015530.549571:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 158 00010000:00010000:3.0:1786015530.549694:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502c12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dea expref: 106 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.549716:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502c19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dea expref: 105 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.549725:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b748f194e00) 00010000:00010000:3.0:1786015530.549728:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786015530.549732:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc200, rc 0) 00000100:00100000:3.0:1786015530.549822:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+105:31486:x1872772280613376:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 438us (1065us total) trans 4294968194 rc 0/0 00000100:00100000:3.0:1786015530.549829:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1351 00000100:00100000:3.0:1786015530.556562:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015530.556622:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280613504 00000100:00100000:0.0:1786015530.556639:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280613504 00000100:00100000:0.0:1786015530.556724:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 378 00000100:00100000:0.0:1786015530.556737:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280613504:12345-192.168.202.56@tcp:1:lfs.0 00010000:00010000:0.0:1786015530.556831:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c502c27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.556860:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c502be8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dd5 expref: 8 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.556872:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502c0b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8de3 expref: 17 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.556881:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015530.556887:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015530.556892:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c502c27 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.556939:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502c0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8de3 expref: 17 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.556958:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502c0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8de3 expref: 17 pid: 6590 timeout: 865 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015530.556978:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa474380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304450048:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015530.557120:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c502be8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dd5 expref: 8 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.557132:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c502be8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dd5 expref: 8 pid: 6592 timeout: 865 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015530.557503:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa477800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304450176:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015530.557609:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786015530.566509:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015530.567326:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa474380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304450048:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015530.567911:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280613632 00000100:00100000:0.0:1786015530.567921:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280613632 00010000:00010000:0.0:1786015530.567967:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502c0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8de3 expref: 18 pid: 6590 timeout: 865 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015530.568009:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 404 00000100:00100000:0.0:1786015530.568018:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280613632:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015530.568036:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786015530.568056:0:5781:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1786015530.568062:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502c0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8de3 expref: 18 pid: 6590 timeout: 865 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.568075:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502c0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8de3 expref: 18 pid: 6590 timeout: 865 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.568097:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000838c7f3c/0xb1a5ef690c502c0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8de3 expref: 18 pid: 6590 timeout: 865 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.568114:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015530.568182:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280613632:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 163us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015530.568190:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 404 00000100:00100000:0.0:1786015530.574380:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa477800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304450176:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015530.574434:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c502c27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015530.574736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015530.575252:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280613760 00000100:00100000:0.0:1786015530.575268:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280613760 00010000:00010000:0.0:1786015530.575322:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c502be8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dd5 expref: 9 pid: 6592 timeout: 865 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015530.575385:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 405 00000100:00100000:0.0:1786015530.575401:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381307800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280613760:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015530.575423:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015530.575454:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c502be8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dd5 expref: 9 pid: 6592 timeout: 865 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.575471:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c502be8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dd5 expref: 9 pid: 6592 timeout: 865 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.575502:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2ddbc2d/0xb1a5ef690c502be8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dd5 expref: 9 pid: 6592 timeout: 865 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.575524:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015530.575530:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015530.575537:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c502c27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.575548:0:17038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c502c27 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.575583:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015530.575653:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381307800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280613760:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 253us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015530.575662:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 405 00010000:00010000:0.0:1786015530.575840:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c502c27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.575850:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c502c27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.575882:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c502c27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.575891:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c502c27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.575900:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c502c27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.575908:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015530.575912:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c502c27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.575921:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c502c27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.575939:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c502c27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.575948:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c502c27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015530.576015:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280613504:12345-192.168.202.56@tcp:1:lfs.0 Request processed in 19281us (19460us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015530.576024:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 378 00000100:00100000:1.0:1786015530.588515:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015530.589349:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280614016 00000100:00100000:2.0:1786015530.589379:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280614016 00000100:00100000:2.0:1786015530.589481:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 273 00000100:00100000:2.0:1786015530.589498:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+105:31486:x1872772280614016:12345-192.168.202.56@tcp:35:lfs.0 00000004:00010000:2.0:1786015530.589587:0:5798:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x28:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502c19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dea expref: 105 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786015530.589911:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968195 00000001:00080000:2.0:1786015530.590698:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968196 00010000:00010000:2.0:1786015530.590851:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502c2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.590877:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502b78 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d9d expref: 53 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.590887:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8db2 expref: 108 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.590895:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502c2e lrc: 5/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.590950:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8db2 expref: 108 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.590972:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8db2 expref: 108 pid: 12526 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015530.590993:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304450304:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015530.591175:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502b78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d9d expref: 53 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.591186:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502b78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d9d expref: 53 pid: 5794 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015530.591196:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cae300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304450432:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015530.591223:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7499c7d240 going to sleep for 11 seconds 00000100:00100000:0.0:1786015530.597711:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015530.598032:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280614144 00000100:00100000:1.0:1786015530.598050:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280614144 00010000:00010000:1.0:1786015530.598097:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502ba9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8db2 expref: 109 pid: 12526 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015530.598173:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 406 00000100:00100000:1.0:1786015530.598184:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+109:2353:x1872772280614144:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015530.598201:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015530.598208:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502ba9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8db2 expref: 109 pid: 12526 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.598221:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8db2 expref: 109 pid: 12526 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.598254:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b748f194e00) 00010000:00010000:1.0:1786015530.598261:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502c2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.598271:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502c2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.598277:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c502ba9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8db2 expref: 109 pid: 12526 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.598280:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015530.598307:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304450304:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015530.598327:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cae300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1872772304450432:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015530.598364:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280614144:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 178us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015530.598373:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 406 00010000:00010000:2.0:1786015530.598376:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502c2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015530.602951:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015530.603027:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280614272 00000100:00100000:2.0:1786015530.603047:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280614272 00010000:00010000:2.0:1786015530.603114:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502b78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d9d expref: 54 pid: 5794 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015530.603189:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 407 00000100:00100000:2.0:1786015530.603202:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+54:2353:x1872772280614272:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015530.603223:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015530.603233:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502b78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d9d expref: 54 pid: 5794 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.603256:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502b78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d9d expref: 54 pid: 5794 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.603286:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502b78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d9d expref: 54 pid: 5794 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.603302:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b748f194e00) 00010000:00010000:2.0:1786015530.603309:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502c2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.603320:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502c2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.603330:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502c2e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.603422:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015530.603506:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280614272:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 306us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015530.603515:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 407 00010000:00010000:3.0:1786015530.604021:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502c2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015530.604034:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502c2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786015530.604236:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968197 00000001:00080000:3.0:1786015530.604630:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968198 00000001:00080000:3.0:1786015530.604704:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968199 00000100:00100000:3.0:1786015530.604860:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304450560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786015530.604947:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015530.605000:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b749995df00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015530.605115:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304450560 00000100:00100000:1.0:1786015530.605131:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304450560 00000100:00100000:1.0:1786015530.605205:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1786015530.605214:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5798:x1872772304450560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786015530.605365:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5798:x1872772304450560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 148us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015530.605373:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1786015530.605476:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304450560:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1786015530.608889:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968200 00000100:00100000:3.0:1786015530.609031:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304450688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786015530.609130:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015530.609941:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015530.614494:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304450688 00000100:00100000:1.0:1786015530.614518:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304450688 00000100:00100000:1.0:1786015530.614739:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1786015530.614754:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5798:x1872772304450688:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786015530.615358:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5798:x1872772304450688:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 607us (6225us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1786015530.615380:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1786015530.615522:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1872772304450688:0@lo:1000:mdt_rdpg00_001.0 00010000:00010000:2.0:1786015530.615584:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502c2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.615598:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502c2e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.615608:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502c2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.615617:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488060a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015530.615623:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502c2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.615632:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502c2e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.615656:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b748f194e00) 00010000:00010000:2.0:1786015530.615659:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1786015530.615665:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502c2e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.615671:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502c2e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786015530.615983:0:5798:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x4e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1786015530.616110:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].12, 64 off8984 00000004:00080000:2.0:1786015530.616124:0:5798:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 765867361966ns, next at 766867359122ns, rc = 0 00000001:00080000:2.0:1786015530.616220:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968201 00010000:00010000:2.0:1786015530.616289:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b748f194e00) 00010000:00010000:2.0:1786015530.616293:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786015530.616303:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502c19 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dea expref: 112 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015530.616459:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+111:31486:x1872772280614016:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 26966us (27953us total) trans 4294968202 rc 0/0 00000100:00100000:2.0:1786015530.616469:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 273 00000020:00080000:2.0:1786015530.616475:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:0.0:1786015530.692870:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015530.693160:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280614528 00000100:00100000:2.0:1786015530.693172:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280614528 00000100:00100000:2.0:1786015530.693245:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1352 00000100:00100000:2.0:1786015530.693257:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+111:31487:x1872772280614528:12345-192.168.202.56@tcp:101:lseek_test.0 00010000:00010000:2.0:1786015530.693286:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015530.693310:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502c35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8df1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693398:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c3c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693414:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693426:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693443:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502c43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693450:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693456:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693596:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693604:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693615:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015530.693626:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 158 00010000:00010000:2.0:1786015530.693738:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693746:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693753:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693791:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015530.693797:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693806:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693820:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:2.0:1786015530.693823:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015530.693827:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693834:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693932:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693945:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502c43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693950:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693957:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015530.693961:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693967:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502c43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693976:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff8b7487f06e00) 00010000:00010000:2.0:1786015530.693979:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015530.693982:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502c43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.693988:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502c43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.694150:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502c35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8df1 expref: 114 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.694166:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8df1 expref: 113 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015530.694174:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:2.0:1786015530.694176:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015530.694179:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488061400, rc 0) 00000100:00100000:2.0:1786015530.694264:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+113:31487:x1872772280614528:12345-192.168.202.56@tcp:101:lseek_test.0 Request processed in 1010us (1415us total) trans 4294968203 rc 0/0 00000100:00100000:2.0:1786015530.694272:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1352 00000100:00100000:1.0:1786015530.697918:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015530.698173:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280614784 00000100:00100000:0.0:1786015530.698185:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280614784 00000100:00100000:0.0:1786015530.698267:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 65 00000100:00100000:0.0:1786015530.698278:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+113:31487:x1872772280614784:12345-192.168.202.56@tcp:103:lseek_test.0 00010000:00010000:0.0:1786015530.698294:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015530.698319:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502c4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8df1 expref: 113 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.698338:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:0.0:1786015530.698351:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015530.698406:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+112:31487:x1872772280614784:12345-192.168.202.56@tcp:103:lseek_test.0 Request processed in 130us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015530.698414:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 65 00000100:00100000:1.0:1786015530.700419:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015530.700843:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280614912 00000100:00100000:0.0:1786015530.700853:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280614912 00000100:00100000:0.0:1786015530.700983:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1353 00000100:00100000:0.0:1786015530.700995:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+112:31487:x1872772280614912:12345-192.168.202.56@tcp:58:lseek_test.0 00010000:00010000:0.0:1786015530.701197:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502c58 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.701215:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502c58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015530.701239:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502c58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786015530.701423:0:7673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].40, 136 off13632 00000100:00100000:0.0:1786015530.701502:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+112:31487:x1872772280614912:12345-192.168.202.56@tcp:58:lseek_test.0 Request processed in 509us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015530.701509:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1353 00000100:00100000:0.0:1786015530.707089:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015530.707182:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280615040 00000100:00100000:1.0:1786015530.707195:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280615040 00000100:00100000:1.0:1786015530.707264:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1354 00000100:00100000:1.0:1786015530.707275:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+112:31487:x1872772280615040:12345-192.168.202.56@tcp:101:lseek_test.0 00010000:00010000:1.0:1786015530.707298:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015530.707333:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c502c5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8df8 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.707395:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502c58 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.707407:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c502c5f lrc: 4/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8df8 expref: 113 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.707428:0:5795:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502c58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.707444:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c502c5f lrc: 3/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8df8 expref: 113 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.707461:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b748f24a600) 00010000:00010000:1.0:1786015530.707465:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015530.707469:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c502c5f lrc: 3/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8df8 expref: 113 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015530.707478:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921e00, rc 0) 00000100:00100000:1.0:1786015530.707552:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+113:31487:x1872772280615040:12345-192.168.202.56@tcp:101:lseek_test.0 Request processed in 279us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015530.707559:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1354 00010000:00010000:3.0:1786015530.859946:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015531.180191:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015531.180201:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015531.180245:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 41 count 4 00000040:00080000:2.0:1786015531.180256:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015531.180389:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cae300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304450816:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786015531.180493:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74aee18e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786015531.206104:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cae300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304450816:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786015531.206322:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015531.206559:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280615168 00000100:00100000:1.0:1786015531.206581:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280615168 00000100:00100000:1.0:1786015531.206671:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1355 00000100:00100000:1.0:1786015531.206681:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:31488:x1872772280615168:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786015531.206718:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x28:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786015531.206844:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:31488:x1872772280615168:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 164us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015531.206852:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1355 00000100:00080000:3.0:1786015531.210205:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015531.221184:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015531.221300:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280615296 00000100:00100000:0.0:1786015531.221311:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280615296 00000100:00100000:0.0:1786015531.221375:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1356 00000100:00100000:0.0:1786015531.221387:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:31488:x1872772280615296:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1786015531.221469:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c502c66 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221488:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c502c66 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221501:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c502c66 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221521:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502c6d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221529:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502c6d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221536:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502c6d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221559:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502c74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221568:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502c74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221574:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502c74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015531.221615:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 158 00000004:00200000:0.0:1786015531.221620:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015531.221634:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502c74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221645:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c502c66 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221651:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c502c66 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221674:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c502c66 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221693:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015531.221697:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c502c66 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221705:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c502c66 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221716:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:0.0:1786015531.221719:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015531.221724:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c502c66 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221730:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c502c66 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221742:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502c6d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221748:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502c6d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221754:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502c6d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221803:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015531.221807:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502c6d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221813:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502c6d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221826:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xefe2aa85 (ffff8b748f24ac00) 00010000:00010000:0.0:1786015531.221828:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015531.221831:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502c6d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221837:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502c6d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221862:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502c74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221869:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502c74 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221875:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502c74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221887:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015531.221890:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502c74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221896:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502c74 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221904:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b748f24a600) 00010000:00010000:0.0:1786015531.221906:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015531.221909:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502c74 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.221914:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502c74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015531.221998:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:31488:x1872772280615296:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 613us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015531.222007:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1356 00000100:00100000:0.0:1786015531.230545:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015531.230619:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280615552 00000100:00100000:2.0:1786015531.230629:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280615552 00000100:00100000:2.0:1786015531.230823:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1357 00000100:00100000:2.0:1786015531.230835:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:31488:x1872772280615552:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015531.230864:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015531.231013:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502c7b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8dff expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.231214:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.231231:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.231246:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015531.231263:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 158 00010000:00010000:2.0:1786015531.231420:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.231428:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c82 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.231433:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.231440:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015531.231444:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.231453:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.231467:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b748f24a600) 00010000:00010000:2.0:1786015531.231470:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015531.231474:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c82 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.231480:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502c82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.231529:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502c7b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dff expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.231540:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:2.0:1786015531.231542:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786015531.231546:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502c7b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dff expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.231555:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488061e00, rc 0) 00000100:00100000:2.0:1786015531.231629:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+54:31488:x1872772280615552:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 797us (1092us total) trans 4294968204 rc 301/301 00000100:00100000:2.0:1786015531.231638:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1357 00000100:00100000:1.0:1786015531.245326:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015531.245501:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280615680 00000100:00100000:3.0:1786015531.245511:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280615680 00000100:00100000:3.0:1786015531.245578:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1358 00000100:00100000:3.0:1786015531.245589:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+54:31488:x1872772280615680:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015531.245633:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x28:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015531.245748:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+54:31488:x1872772280615680:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 161us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015531.245757:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1358 00000100:00100000:1.0:1786015531.253672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015531.253830:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280615936 00000100:00100000:0.0:1786015531.253842:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280615936 00000100:00100000:0.0:1786015531.253988:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1359 00000100:00100000:0.0:1786015531.253998:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+54:31488:x1872772280615936:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015531.254020:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015531.254043:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502c90 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e06 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.256304:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502c97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.256757:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502c97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.257214:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502c97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015531.257232:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x29:0x0]: returning size 0 00010000:00010000:0.0:1786015531.257977:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502c90 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e06 expref: 57 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.258012:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502c97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e06 expref: 56 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.258027:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8b748f24ac00) 00010000:00010000:0.0:1786015531.258030:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015531.258032:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7c00, rc 0) 00000100:00100000:0.0:1786015531.258564:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+56:31488:x1872772280615936:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 4564us (4912us total) trans 4294968205 rc 0/0 00000100:00100000:0.0:1786015531.258575:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1359 00000100:00100000:2.0:1786015531.275212:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015531.275726:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280616192 00000100:00100000:3.0:1786015531.275737:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280616192 00000100:00100000:3.0:1786015531.275831:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1360 00000100:00100000:3.0:1786015531.275841:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+56:31488:x1872772280616192:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786015531.275904:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015531.275932:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c502c97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e06 expref: 56 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.275953:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8b748f24ac00) 00010000:00010000:3.0:1786015531.275964:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015531.275988:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502ca5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.276002:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502bbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dc0 expref: 112 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.276015:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502ca5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.276048:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502bbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dc0 expref: 112 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.276062:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502bbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dc0 expref: 112 pid: 5796 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015531.276077:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304450944:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015531.276173:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015531.283914:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304450944:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015531.283942:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502ca5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015531.286611:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015531.286924:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280616320 00000100:00100000:0.0:1786015531.286935:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280616320 00010000:00010000:0.0:1786015531.287003:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502bbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dc0 expref: 113 pid: 5796 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015531.287046:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 408 00000100:00100000:0.0:1786015531.287056:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+113:2354:x1872772280616320:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015531.287071:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015531.287078:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502bbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dc0 expref: 113 pid: 5796 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.287093:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502bbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dc0 expref: 113 pid: 5796 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.287117:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502bbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8dc0 expref: 113 pid: 5796 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.287148:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:0.0:1786015531.287155:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502ca5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.287166:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502ca5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.287175:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502ca5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.287210:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015531.287260:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+112:2354:x1872772280616320:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 206us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015531.287268:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 408 00010000:00010000:1.0:1786015531.287416:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502ca5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.287424:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502ca5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.287447:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4d:0x0].0x6acb5524 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.287456:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x6acb5524 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.287464:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x6acb5524 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.287548:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502ca5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.287555:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502ca5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.287561:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502ca5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.287567:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015531.287571:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502ca5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.287578:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502ca5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.287585:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:1.0:1786015531.287588:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015531.287590:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502ca5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.287596:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502ca5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.287604:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x6acb5524 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.287608:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x6acb5524 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.287613:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x6acb5524 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.287617:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015531.287619:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x6acb5524 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.287628:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x6acb5524 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.287633:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x6acb5524 (ffff8b748f194000) 00010000:00010000:1.0:1786015531.287635:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015531.287637:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x6acb5524 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.287642:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x6acb5524 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015531.287710:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+55:31488:x1872772280616192:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 11871us (12508us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786015531.287718:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1360 00000100:00080000:3.0:1786015531.287988:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015531.295531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015531.295630:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280616448 00000100:00100000:1.0:1786015531.295644:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280616448 00000100:00100000:1.0:1786015531.295720:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1361 00000100:00100000:1.0:1786015531.295731:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+55:31488:x1872772280616448:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015531.295794:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015531.295823:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cb3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e0d expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.295862:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c502cba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.295875:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c502cba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.295886:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c502cba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.295995:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e0d expref: 57 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.296013:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c502cba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e0d expref: 56 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.296021:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8b748f194000) 00010000:00010000:1.0:1786015531.296024:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015531.296027:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921200, rc 0) 00000100:00100000:1.0:1786015531.296082:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+56:31488:x1872772280616448:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 352us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015531.296089:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1361 00000100:00100000:0.0:1786015531.311454:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015531.312153:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280616704 00000100:00100000:1.0:1786015531.312165:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280616704 00000100:00100000:1.0:1786015531.312281:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1362 00000100:00100000:1.0:1786015531.312293:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+56:31488:x1872772280616704:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786015531.312398:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cc1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.312416:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.312429:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786015531.312639:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e46a1a5a reply state 00000000b04025bb transno 4294968206 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015531.312666:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786015531.313044:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+58:31488:x1872772280616704:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 750us (1597us total) trans 4294968206 rc 0/0 00000100:00100000:1.0:1786015531.313053:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1362 00010000:00010000:0.0:1786015531.317570:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.317589:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cc1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.317597:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cc1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.317603:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015531.317608:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cc1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.317617:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cc1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.317635:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8b748f194000) 00010000:00010000:0.0:1786015531.317638:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786015531.317643:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cc1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.317649:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502cc1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015531.323376:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015531.323510:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280616832 00000100:00100000:1.0:1786015531.323521:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280616832 00000100:00100000:1.0:1786015531.323583:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1363 00000100:00100000:1.0:1786015531.323594:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+57:31488:x1872772280616832:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015531.323620:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015531.323646:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c502cc8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e14 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.324512:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c502cc8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e14 expref: 58 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.324532:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c502cc8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e14 expref: 58 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.324542:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8b748f194000) 00010000:00010000:1.0:1786015531.324545:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786015531.324549:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920200, rc 0) 00000100:00100000:1.0:1786015531.324696:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+58:31488:x1872772280616832:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1102us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015531.324704:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1363 00000100:00100000:2.0:1786015531.332476:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015531.333815:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280616960 00000100:00100000:1.0:1786015531.333828:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280616960 00000100:00100000:1.0:1786015531.333961:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 274 00000100:00100000:1.0:1786015531.333972:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+58:31488:x1872772280616960:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1786015531.334129:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+58:31488:x1872772280616960:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 Request processed in 157us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015531.334145:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 274 00000100:00100000:0.0:1786015531.339795:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015531.339893:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280617216 00000100:00100000:3.0:1786015531.339905:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280617216 00000100:00100000:3.0:1786015531.339969:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 275 00000100:00100000:3.0:1786015531.339978:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+58:31488:x1872772280617216:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786015531.340258:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+59:31488:x1872772280617216:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 280us (495us total) trans 4294968207 rc 0/0 00000100:00100000:3.0:1786015531.340267:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 275 00000100:00100000:0.0:1786015531.343035:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015531.347397:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280617472 00000100:00100000:1.0:1786015531.347415:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280617472 00000100:00100000:0.0:1786015531.350572:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1364 00000100:00100000:0.0:1786015531.350588:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+59:31488:x1872772280617472:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015531.350758:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+59:31488:x1872772280617472:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 173us (7731us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015531.350792:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1364 00000100:00100000:0.0:1786015531.362169:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015531.362347:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280617728 00000100:00100000:1.0:1786015531.362359:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280617728 00000100:00100000:1.0:1786015531.362426:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1365 00000100:00100000:1.0:1786015531.362436:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+59:31488:x1872772280617728:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015531.362460:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015531.362485:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502ccf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e1b expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.362609:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502cd6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.362626:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c502cc8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e14 expref: 60 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.362635:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502cd6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.362671:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c502cc8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e14 expref: 60 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.362685:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c502cc8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e14 expref: 60 pid: 5794 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015531.362700:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aae680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304451072:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015531.363104:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7381ffbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015531.378265:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aae680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304451072:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015531.378302:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502cd6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015531.379109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015531.382875:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280617856 00000100:00100000:1.0:1786015531.382894:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280617856 00010000:00010000:1.0:1786015531.382947:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c502cc8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e14 expref: 61 pid: 5794 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015531.383053:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 409 00000100:00100000:1.0:1786015531.383064:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+61:2354:x1872772280617856:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015531.383080:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015531.383088:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c502cc8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e14 expref: 61 pid: 5794 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.383101:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c502cc8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e14 expref: 61 pid: 5794 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.383122:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c502cc8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e14 expref: 61 pid: 5794 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.383174:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8b748f194000) 00010000:00010000:1.0:1786015531.383180:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502cd6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.383191:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.383199:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502cd6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.383243:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015531.383399:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.383408:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015531.383429:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x29:0x0]: returning size 0 00000004:00080000:2.0:1786015531.383616:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d:0x0], index 1: 0 00010000:00010000:2.0:1786015531.383823:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.383832:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502cd6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.383838:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502cd6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.383845:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015531.383849:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502cd6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.383858:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502cd6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.383869:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8b748f194000) 00010000:00010000:2.0:1786015531.383872:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015531.383876:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502cd6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.383882:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502cd6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.383933:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502ccf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e1b expref: 61 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.383942:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8b74a04b5400) 00010000:00010000:2.0:1786015531.383945:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786015531.383949:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502ccf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e1b expref: 61 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.383957:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920400, rc 0) 00000100:00100000:1.0:1786015531.384186:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+60:2354:x1872772280617856:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1121us (5078us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015531.384196:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 409 00000100:00100000:2.0:1786015531.384542:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+59:31488:x1872772280617728:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 22106us (22382us total) trans 4294968208 rc 301/301 00000100:00100000:2.0:1786015531.384550:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1365 00000100:00100000:2.0:1786015531.389388:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015531.389530:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280618112 00000100:00100000:3.0:1786015531.389540:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280618112 00000100:00100000:3.0:1786015531.389617:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 276 00000100:00100000:3.0:1786015531.389627:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+59:31488:x1872772280618112:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786015531.390044:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+60:31488:x1872772280618112:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 416us (667us total) trans 4294968209 rc 0/0 00000100:00100000:3.0:1786015531.390053:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 276 00000100:00100000:3.0:1786015531.393899:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015531.393994:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280618240 00000100:00100000:1.0:1786015531.394005:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280618240 00000100:00100000:1.0:1786015531.394072:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1366 00000100:00100000:1.0:1786015531.394082:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+60:31488:x1872772280618240:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015531.394233:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015531.394260:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c502ce4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e22 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.394362:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502ceb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.394377:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502ceb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.394390:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502ceb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015531.394431:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x29:0x0]: returning size 0 00000004:00200000:1.0:1786015531.394435:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015531.394460:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502ceb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.394488:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c502ce4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e22 expref: 62 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.394503:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502ceb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e22 expref: 61 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.394512:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8b748f194000) 00010000:00010000:1.0:1786015531.394515:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786015531.394519:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920400, rc 0) 00000100:00100000:1.0:1786015531.394587:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+61:31488:x1872772280618240:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 505us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015531.394594:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1366 00000100:00100000:0.0:1786015531.398204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015531.398314:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280618368 00000100:00100000:3.0:1786015531.398333:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280618368 00000100:00100000:3.0:1786015531.398410:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 379 00000100:00100000:3.0:1786015531.398420:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2352:x1872772280618368:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015531.398440:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015531.398466:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c502cf2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e29 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015531.398497:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786015531.398519:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=766s v=(0 0) 00010000:00010000:3.0:1786015531.398524:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015531.398534:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c502cf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e29 expref: 11 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.398551:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c502cf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e29 expref: 11 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.398565:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc600, rc 0) 00000100:00100000:3.0:1786015531.398635:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280618368:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 217us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015531.398647:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 379 00000100:00080000:0.0:1786015531.398713:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015531.402936:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015531.403031:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280618624 00000100:00100000:0.0:1786015531.403043:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280618624 00000100:00100000:0.0:1786015531.403111:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1367 00000100:00100000:0.0:1786015531.403121:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+61:31488:x1872772280618624:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015531.403259:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+61:31488:x1872772280618624:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 139us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015531.403267:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1367 00000100:00100000:2.0:1786015531.406660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015531.406804:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280618752 00000100:00100000:3.0:1786015531.406814:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280618752 00000100:00100000:3.0:1786015531.406865:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 380 00000100:00100000:3.0:1786015531.406875:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:31488:x1872772280618752:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015531.406892:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015531.406910:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c502cf9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e30 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.406941:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c502cf2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e29 expref: 12 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.406950:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015531.406955:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015531.406961:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c502cf9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e30 expref: 12 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.406995:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c502cf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e29 expref: 12 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.407009:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c502cf2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e29 expref: 12 pid: 11384 timeout: 866 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015531.407022:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304451200:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015531.407096:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1786015531.411250:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015531.411334:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280618880 00000100:00100000:1.0:1786015531.411344:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280618880 00010000:00010000:1.0:1786015531.411385:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c502cf2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e29 expref: 13 pid: 11384 timeout: 866 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015531.411435:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 410 00000100:00100000:1.0:1786015531.411445:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280618880:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015531.411462:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015531.411487:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c502cf2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e29 expref: 13 pid: 11384 timeout: 866 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.411503:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c502cf2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e29 expref: 13 pid: 11384 timeout: 866 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.411531:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015531.411537:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015531.411546:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c502cf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e30 expref: 13 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.411557:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c502cf9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e30 expref: 13 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.411598:0:6607:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c502cf9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e30 expref: 13 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015531.411614:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6607:1872772304451328:192.168.202.56@tcp:105: 00000100:00100000:1.0:1786015531.411704:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7381ffbc00 going to sleep for 11 seconds 00010000:00010000:2.0:1786015531.412434:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000677e1dc6/0xb1a5ef690c502cf2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e29 expref: 13 pid: 11384 timeout: 866 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015531.412456:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304451200:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015531.412480:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c502cf9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e30 expref: 12 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.412492:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc000, rc 0) 00000100:00100000:2.0:1786015531.412545:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:31488:x1872772280618752:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 5671us (5894us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015531.412552:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 380 00000100:00100000:3.0:1786015531.418495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015531.418574:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280619008 00000100:00100000:2.0:1786015531.418584:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280619008 00002000:00100000:2.0:1786015531.418635:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1d:0x0] (0->157) req@ffff8b74c0cf1180 x1872772280619008/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:377/0 lens 648/0 e 0 to 0 dl 1786015542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015531.418646:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c0cf1180 with x1872772280619008 ext(0->157) 00002000:00010000:2.0:1786015531.418652:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74c0cf1180 00000100:00100000:2.0:1786015531.418695:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 119 00000100:00100000:2.0:1786015531.418706:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280619008:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1786015531.419273:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2354:x1872772280619008:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 567us (784us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1786015531.419283:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 119 00002000:00100000:2.0:1786015531.419290:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1d:0x0] (0->157) req@ffff8b74c0cf1180 x1872772280619008/t4294967380(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:377/0 lens 648/448 e 0 to 0 dl 1786015542 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015531.419299:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c0cf1180 with x1872772280619008 ext(0->157) 00002000:00010000:2.0:1786015531.419305:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74c0cf1180 00000100:00100000:1.0:1786015531.424455:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6607:1872772304451328:192.168.202.56@tcp:105: 00010000:00010000:1.0:1786015531.424492:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015531.424904:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280618880:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 13457us (13662us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015531.424917:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 410 00000100:00100000:0.0:1786015531.425049:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015531.425821:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280619136 00000100:00100000:2.0:1786015531.425831:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280619136 00000100:00100000:2.0:1786015531.425931:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1368 00000100:00100000:2.0:1786015531.425943:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+61:31488:x1872772280619136:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1786015531.460813:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968205 is committed 00000001:00080000:0.0:1786015531.460838:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968206 is committed 00000001:00080000:0.0:1786015531.460854:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968188 is committed 00000001:00080000:0.0:1786015531.460861:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968208 is committed 00000001:00080000:0.0:1786015531.460870:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968203 is committed 00000004:00080000:0.0:1786015531.460881:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 14 committed 00000001:00080000:0.0:1786015531.460918:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968209 is committed 00000020:00080000:0.0:1786015531.460929:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b7382cbb000 refcount 2 committed 0 result 0 batchid 31 00000020:00080000:0.0:1786015531.460934:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74b0987100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b7382cbb9c0 00000020:00080000:0.0:1786015531.460938:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74b0987f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74961a1400 00000100:00100000:1.0:1786015531.461131:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:31488:x1872772280619136:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 35185us (36076us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015531.461150:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1368 00000100:00100000:1.0:1786015531.461916:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015531.461935:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304451456:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786015531.461990:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015531.463020:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304451456 00000100:00100000:2.0:1786015531.463031:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304451456 00000100:00100000:2.0:1786015531.463095:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1786015531.463105:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304451456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1786015531.463142:0:6592:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:26 count 1 00002000:00010000:2.0:1786015531.463178:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 158, mtime: 0x6a746f29, atime: 0x0, ctime: 0x6a746f29, blocks: 0xb 00010000:00010000:2.0:1786015531.463187:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502d00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.463204:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=766s v=(0 0) 00010000:00010000:2.0:1786015531.463209:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015531.463216:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502d00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.463241:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502d00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.463251:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502d00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.463259:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502d00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.463280:0:6592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786015531.463837:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786015531.463846:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502d00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.463861:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061e00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015531.463866:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502d00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.463875:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502d00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.463893:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502d00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.463900:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502d00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.463919:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015531.463921:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015531.463923:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015531.464268:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1872772304451456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1163us (2275us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1786015531.464277:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000020:00080000:2.0:1786015531.466123:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 31 committed batchid 30 00000020:00080000:2.0:1786015531.466469:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30 00000004:00080000:1.0:1786015531.468898:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b74aef00000/2, rc 0, transno 4294967370 00000100:00100000:1.0:1786015531.468915:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304451456:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786015531.469092:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015531.469172:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280619264 00000100:00100000:1.0:1786015531.469180:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280619264 00000100:00100000:1.0:1786015531.469345:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 382 00000100:00100000:1.0:1786015531.469357:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2352:x1872772280619264:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1786015531.499694:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967380 is committed 00000100:00100000:1.0:1786015531.499888:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280619264:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 30525us (30791us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015531.499904:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 382 00000100:00100000:0.0:1786015531.502903:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015531.503085:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280619520 00000100:00100000:3.0:1786015531.503096:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280619520 00000100:00100000:3.0:1786015531.503171:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1369 00000100:00100000:3.0:1786015531.503183:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+50:31488:x1872772280619520:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786015531.503263:0:12526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015531.503295:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c502ceb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e22 expref: 50 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.503326:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8b748f194000) 00010000:00010000:3.0:1786015531.503332:0:12526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015531.503368:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d07 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.503383:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.503394:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015531.503594:0:12526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005c2fe8ba reply state 0000000012707502 transno 4294968210 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015531.503604:0:12526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015531.503834:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+51:31488:x1872772280619520:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 653us (942us total) trans 4294968210 rc 0/0 00000100:00100000:3.0:1786015531.503842:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1369 00000100:00100000:1.0:1786015531.508142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:3.0:1786015531.508202:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.508216:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d07 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.508237:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d07 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.508243:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015531.508249:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d07 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.508256:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d07 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.508275:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8b748f194000) 00010000:00010000:3.0:1786015531.508278:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015531.508283:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d07 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.508289:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d07 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015531.508359:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280619648 00000100:00100000:2.0:1786015531.508369:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280619648 00000100:00100000:2.0:1786015531.508423:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1370 00000100:00100000:2.0:1786015531.508432:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+50:31488:x1872772280619648:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015531.508457:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015531.508476:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502d0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e37 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.508535:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502d0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e37 expref: 51 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.508549:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502d0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e37 expref: 51 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.508566:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8b748f194000) 00010000:00010000:2.0:1786015531.508569:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015531.508572:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488060a00, rc 0) 00000100:00100000:2.0:1786015531.509649:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+51:31488:x1872772280619648:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1210us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015531.509661:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1370 00000100:00100000:1.0:1786015531.512540:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015531.513022:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280619776 00000100:00100000:2.0:1786015531.513033:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280619776 00000100:00100000:3.0:1786015531.513158:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 383 00000100:00100000:3.0:1786015531.513169:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280619776:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1786015531.513648:0:6590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1786015531.513653:0:6590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb mtime from disk: 0 -> 1786015529 00002000:00010000:3.0:1786015531.513655:0:6590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb atime from disk: 0 -> 1786015529 00002000:00010000:3.0:1786015531.513658:0:6590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb ctime from disk: 0 -> 1786015529 00002000:00010000:3.0:1786015531.513660:0:6590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1786015531.513803:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280619776:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 633us (1272us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1786015531.513812:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 383 00000100:00100000:0.0:1786015531.516618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015531.516716:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280620032 00000100:00100000:1.0:1786015531.516727:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280620032 00000100:00100000:0.0:1786015531.517051:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1371 00000100:00100000:0.0:1786015531.517063:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+51:31488:x1872772280620032:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1786015531.517142:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d15 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.517161:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c502cba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e0d expref: 51 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.517170:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d15 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.517209:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c502cba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e0d expref: 51 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.517234:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c502cba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e0d expref: 51 pid: 7673 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015531.517250:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304451584:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015531.517490:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015531.521010:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015531.521095:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280620160 00000100:00100000:2.0:1786015531.521106:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280620160 00010000:00010000:2.0:1786015531.521157:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c502cba lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e0d expref: 52 pid: 7673 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015531.521243:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 411 00000100:00100000:2.0:1786015531.521254:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+52:2353:x1872772280620160:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015531.521268:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015531.521275:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c502cba lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e0d expref: 52 pid: 7673 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.521289:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c502cba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e0d expref: 52 pid: 7673 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.521311:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8b748f194000) 00010000:00010000:2.0:1786015531.521325:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d15 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.521335:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.521344:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d15 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.521368:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015531.521433:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+52:2353:x1872772280620160:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 181us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015531.521440:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 411 00010000:00010000:0.0:1786015531.521499:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c502cba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e0d expref: 51 pid: 7673 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015531.521517:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304451584:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015531.521538:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.521547:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.521552:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.521583:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.521600:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d15 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.521606:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d15 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.521612:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015531.521616:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d15 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.521623:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d15 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.521632:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8b748f194000) 00010000:00010000:0.0:1786015531.521635:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1786015531.521639:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d15 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.521645:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d15 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015531.523478:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:31488:x1872772280620032:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 6408us (6858us total) trans 0 rc -22/-22 00000100:00100000:0.0:1786015531.523491:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1371 00000100:00100000:0.0:1786015531.524557:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015531.524620:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280620288 00000100:00100000:1.0:1786015531.524630:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280620288 00000100:00100000:1.0:1786015531.524685:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 384 00000100:00100000:1.0:1786015531.524695:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280620288:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015531.524741:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c502d1c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.524782:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c502cf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e30 expref: 12 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.524792:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015531.524796:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015531.524800:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c502d1c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.524838:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c502cf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e30 expref: 12 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015531.524852:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c502cf9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e30 expref: 12 pid: 6590 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015531.524873:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304451712:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015531.524956:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d066c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786015531.531740:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015531.532242:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280620416 00000100:00100000:0.0:1786015531.532253:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280620416 00010000:00010000:0.0:1786015531.532294:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c502cf9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e30 expref: 13 pid: 6590 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015531.532346:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 412 00000100:00100000:0.0:1786015531.532356:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280620416:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015531.532373:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015531.532397:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c502cf9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e30 expref: 13 pid: 6590 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.532413:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c502cf9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e30 expref: 13 pid: 6590 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.532444:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015531.532449:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015531.532456:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c502d1c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.532468:0:17038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c502d1c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.532488:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015531.532732:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280620416:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 375us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015531.532741:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 412 00010000:00010000:1.0:1786015531.533200:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c502cf9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e30 expref: 12 pid: 6590 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015531.533283:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304451712:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015531.533305:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c502d1c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.534649:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c502d1c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.534667:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c502d1c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.534710:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c502d1c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.534719:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c502d1c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.534728:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c502d1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.534736:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015531.534740:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c502d1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.534754:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c502d1c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.534834:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c502d1c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.534842:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c502d1c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015531.534976:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280620288:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 10277us (10418us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015531.534986:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 384 00000100:00100000:2.0:1786015531.538287:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015531.538413:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280620672 00000100:00100000:0.0:1786015531.538424:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280620672 00000100:00100000:0.0:1786015531.538484:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1372 00000100:00100000:0.0:1786015531.538493:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+50:31488:x1872772280620672:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786015531.538578:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d23 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.538597:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.538609:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.538879:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502d2a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.538892:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502d0e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e37 expref: 51 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.538901:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502d2a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.538934:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502d0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e37 expref: 51 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.538948:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502d0e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e37 expref: 51 pid: 7673 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015531.538964:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304451840:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015531.539047:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf54ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015531.542970:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015531.543097:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304451840:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015531.543126:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502d2a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015531.543219:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280620800 00000100:00100000:2.0:1786015531.543239:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280620800 00010000:00010000:2.0:1786015531.543285:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502d0e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e37 expref: 52 pid: 7673 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015531.543338:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 413 00000100:00100000:2.0:1786015531.543349:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+52:2354:x1872772280620800:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015531.543366:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015531.543373:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502d0e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e37 expref: 52 pid: 7673 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.543386:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502d0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e37 expref: 52 pid: 7673 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.543409:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502d0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e37 expref: 52 pid: 7673 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.543425:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8b748f194000) 00010000:00010000:2.0:1786015531.543430:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502d2a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.543445:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502d2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.543452:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502d2a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.543481:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015531.543535:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+51:2354:x1872772280620800:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 188us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015531.543543:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 413 00010000:00010000:0.0:1786015531.543599:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502d2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.543607:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502d2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786015531.543829:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968211 00000001:00080000:0.0:1786015531.543986:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968212 00000001:00080000:0.0:1786015531.544032:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968213 00000100:00100000:0.0:1786015531.544117:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304451968:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1786015531.545529:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015531.545564:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359180 going to sleep for 11 seconds 00000100:00100000:3.0:1786015531.546793:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304451968 00000100:00100000:3.0:1786015531.546806:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304451968 00000100:00100000:3.0:1786015531.546871:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1786015531.546881:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5796:x1872772304451968:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1786015531.547009:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5796:x1872772304451968:12345-0@lo:1000:mdt00_002.0 Request processed in 130us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015531.547017:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1786015531.547070:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304451968:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1786015531.547516:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968214 00000100:00100000:3.0:1786015531.547590:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304452096:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1786015531.547630:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015531.547658:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304452096 00000100:00100000:3.0:1786015531.547662:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304452096 00000100:00100000:3.0:1786015531.547684:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786015531.547690:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5796:x1872772304452096:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1786015531.547863:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5796:x1872772304452096:12345-0@lo:1000:mdt00_002.0 Request processed in 173us (232us total) trans 4294967382 rc 0/0 00000100:00100000:3.0:1786015531.547870:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786015531.547888:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7381ffb180 going to sleep for 11 seconds 00000100:00100000:3.0:1786015531.547909:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1872772304452096:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1786015531.547988:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968215 00010000:00010000:3.0:1786015531.548018:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502d2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.548029:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502d2a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.548037:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502d2a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.548043:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015531.548047:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502d2a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.548056:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502d2a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.548072:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8b748f194000) 00010000:00010000:3.0:1786015531.548074:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015531.548078:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502d2a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.548085:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502d2a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.548111:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502c58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.548117:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502c58 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.548123:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502c58 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.548128:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015531.548142:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502c58 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.548149:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502c58 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.548156:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b748f24a600) 00010000:00010000:3.0:1786015531.548158:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015531.548165:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c502c5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8df8 expref: 100 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.548177:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c502c5f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8df8 expref: 100 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.548187:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c502c5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8df8 expref: 100 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.548212:0:5796:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921e00/0xb1a5ef690c502c5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8df8 expref: 100 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015531.548222:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304452224:192.168.202.56@tcp:105: 00000100:00100000:3.0:1786015531.548285:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748827c0c0 going to sleep for 11 seconds 00000100:00080000:0.0:1786015531.548861:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015531.551728:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304452224:192.168.202.56@tcp:105: 00010000:00010000:0.0:1786015531.551800:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502c58 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.551811:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502c58 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.551842:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d31 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.551855:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.551866:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.551876:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.551882:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d31 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.551889:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d31 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.551895:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015531.551898:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d31 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.551910:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d31 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.551920:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b748f24a600) 00010000:00010000:0.0:1786015531.551922:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015531.551926:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d31 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.551931:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d31 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.551940:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.551945:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d23 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.551952:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d23 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.551956:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015531.551959:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d23 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.551964:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d23 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.551970:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8b748f24a600) 00010000:00010000:0.0:1786015531.551972:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015531.551974:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d23 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.551984:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d23 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015531.552200:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+55:31488:x1872772280620672:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 13706us (13922us total) trans 4294968216 rc 0/0 00000100:00100000:0.0:1786015531.552210:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1372 00000020:00080000:0.0:1786015531.552215:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1786015531.552820:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015531.552826:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015531.553469:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1786015531.553477:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015531.555211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015531.555483:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280620928 00000100:00100000:2.0:1786015531.555492:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280620928 00000100:00100000:2.0:1786015531.555614:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 277 00000100:00100000:2.0:1786015531.555623:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916ad450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+101:31487:x1872772280620928:12345-192.168.202.56@tcp:49:lseek_test.0 00000100:00100000:2.0:1786015531.555787:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916ad450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+101:31487:x1872772280620928:12345-192.168.202.56@tcp:49:lseek_test.0 Request processed in 164us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015531.555794:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 277 00000100:00100000:1.0:1786015531.559125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015531.559235:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280621056 00000100:00100000:3.0:1786015531.559247:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280621056 00000100:00100000:3.0:1786015531.559325:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 385 00000100:00100000:3.0:1786015531.559336:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+14:31487:x1872772280621056:12345-192.168.202.56@tcp:101:lseek_test.0 00010000:00010000:3.0:1786015531.559355:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015531.559378:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c502d38 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e3e expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015531.559405:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 158, mtime: 0x6a746f29, atime: 0x6a746f29, ctime: 0x6a746f29, blocks: 0xb 00010000:00010000:3.0:1786015531.559425:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=766s v=(0 0) 00010000:00010000:3.0:1786015531.559428:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015531.559435:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c502d38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e3e expref: 15 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.559449:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005bb3b5ed/0xb1a5ef690c502d38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e3e expref: 15 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015531.559459:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc000, rc 0) 00000100:00100000:3.0:1786015531.559512:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+15:31487:x1872772280621056:12345-192.168.202.56@tcp:101:lseek_test.0 Request processed in 179us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015531.559519:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 385 00000100:00080000:0.0:1786015531.559727:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015531.560959:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015531.561130:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280621312 00000100:00100000:1.0:1786015531.561146:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280621312 00000100:00100000:1.0:1786015531.561209:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 278 00000100:00100000:1.0:1786015531.561220:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+55:31488:x1872772280621312:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1786015531.562306:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x29:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1786015531.562395:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968217 00010000:00010000:0.0:1786015531.562440:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d3f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.562453:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.562461:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.562467:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d3f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.562471:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d3f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.562475:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015531.562490:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786015531.562524:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786015531.562531:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d3f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.562538:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015531.562542:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d3f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.562550:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.562562:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:2.0:1786015531.562565:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786015531.562569:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d3f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015531.562575:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d3f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015531.562592:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+57:31488:x1872772280621312:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1372us (1637us total) trans 4294968218 rc 0/0 00010000:00010000:2.0:1786015531.562594:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015531.562596:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015531.562598:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015531.562601:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 278 00000020:00080000:0.0:1786015531.562606:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786015531.565463:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015531.565573:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280621440 00000100:00100000:3.0:1786015531.565584:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280621440 00000100:00100000:3.0:1786015531.565647:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 386 00000100:00100000:3.0:1786015531.565657:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+15:2353:x1872772280621440:12345-192.168.202.56@tcp:23:lseek_test.0 00000001:00080000:0.0:1786015531.598646:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967382 is committed 00000001:00080000:0.0:1786015531.598669:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967381 is committed 00000100:00100000:3.0:1786015531.603863:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+15:2353:x1872772280621440:12345-192.168.202.56@tcp:23:lseek_test.0 Request processed in 38195us (38398us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015531.603878:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 386 00000100:00100000:1.0:1786015531.606685:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015531.606800:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280621696 00000100:00100000:3.0:1786015531.606810:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280621696 00000100:00100000:3.0:1786015531.606883:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 279 00000100:00100000:3.0:1786015531.606894:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+101:31487:x1872772280621696:12345-192.168.202.56@tcp:35:lseek_test.0 00000100:00100000:3.0:1786015531.607182:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+102:31487:x1872772280621696:12345-192.168.202.56@tcp:35:lseek_test.0 Request processed in 289us (506us total) trans 4294968219 rc 0/0 00000100:00100000:3.0:1786015531.607190:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 279 00000100:00100000:1.0:1786015531.692069:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304452480:0@lo:400:kworker.0 00000100:00100000:1.0:1786015531.692152:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015531.692215:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786015531.692230:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304452352:0@lo:400:kworker.0 00000100:00100000:1.0:1786015531.692257:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015531.692286:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304452608:0@lo:400:kworker.0 00000100:00100000:1.0:1786015531.692307:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015531.692326:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015531.692331:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304452736:0@lo:400:kworker.0 00000100:00100000:1.0:1786015531.692349:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015531.692447:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304452480 00000100:00100000:1.0:1786015531.692456:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304452480 00000100:00100000:1.0:1786015531.692498:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304452608 00000100:00100000:1.0:1786015531.692500:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304452608 00000100:00100000:1.0:1786015531.692519:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304452736 00000100:00100000:1.0:1786015531.692521:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304452736 00000100:00100000:1.0:1786015531.692535:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:1.0:1786015531.692542:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304452480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015531.692590:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304452480:12345-0@lo:400:kworker.0 Request processed in 48us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015531.692596:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:1.0:1786015531.692611:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1786015531.692616:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304452608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015531.692641:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304452608:12345-0@lo:400:kworker.0 Request processed in 25us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015531.692646:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1786015531.692655:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1786015531.692660:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304452736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015531.692993:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304452352 00000100:00100000:3.0:1786015531.692998:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304452352 00000100:00100000:3.0:1786015531.693027:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:3.0:1786015531.693033:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304452352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015531.693309:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304452736:12345-0@lo:400:kworker.0 Request processed in 647us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015531.693317:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00080000:0.0:1786015531.694206:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015531.695887:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304452352:12345-0@lo:400:kworker.0 Request processed in 2845us (3619us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015531.695901:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:1.0:1786015531.696926:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304452736:0@lo:400:kworker.0 00000100:00100000:1.0:1786015531.696943:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304452608:0@lo:400:kworker.0 00000100:00100000:0.0:1786015531.702553:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304452480:0@lo:400:kworker.0 00000100:00100000:0.0:1786015531.702589:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304452352:0@lo:400:kworker.0 00010000:00010000:1.0:1786015531.884016:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015532.204955:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304452864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015532.205035:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015532.205217:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304452864 00000100:00100000:1.0:1786015532.205226:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304452864 00000100:00100000:1.0:1786015532.205277:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1786015532.205285:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304452864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015532.205318:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 0 free 3857711104 avail 3854565376 00000100:00100000:1.0:1786015532.205373:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304452864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015532.205380:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1786015532.205420:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967382 gen 2 00000004:00080000:1.0:1786015532.205426:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967382 committed transno 4294967382 00000100:00100000:1.0:1786015532.205458:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304452864:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1786015532.615453:0:21525:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015532.615462:0:21525:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015532.615513:0:21525:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 41 count 4 00000040:00080000:2.0:1786015532.615524:0:21525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786015532.908048:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015533.931971:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015534.668523:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015534.668565:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015534.668601:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015534.668622:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015534.668654:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015534.668671:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280622080 00000100:00100000:0.0:1786015534.668678:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015534.668682:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280622080 00000100:00100000:0.0:1786015534.668705:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015534.668730:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280622592 00000100:00100000:0.0:1786015534.668735:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280622592 00000100:00100000:2.0:1786015534.668744:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280622208 00000100:00100000:2.0:1786015534.668749:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280622208 00000100:00100000:0.0:1786015534.668791:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280622464 00000100:00100000:0.0:1786015534.668796:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280622464 00000100:00100000:2.0:1786015534.668808:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 529 00000100:00100000:2.0:1786015534.668821:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280622080:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015534.668826:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 530 00000100:00100000:0.0:1786015534.668837:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280622592:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015534.668895:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280622592:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 59us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015534.668903:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 530 00000100:00100000:2.0:1786015534.668914:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280622080:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 96us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015534.668921:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 531 00000100:00100000:3.0:1786015534.668989:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280622336 00000100:00100000:3.0:1786015534.668993:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280622336 00000100:00100000:3.0:1786015534.669020:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280621952 00000100:00100000:3.0:1786015534.669022:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280621952 00000100:00100000:3.0:1786015534.669039:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 530 00000100:00100000:3.0:1786015534.669044:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+57:2354:x1872772280622336:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015534.669075:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+57:2354:x1872772280622336:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015534.669081:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 530 00000100:00100000:3.0:1786015534.669092:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 531 00000100:00100000:3.0:1786015534.669097:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+102:2354:x1872772280621952:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015534.669150:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+102:2354:x1872772280621952:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 53us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015534.669156:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 531 00000100:00100000:0.0:1786015534.669190:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+15:2354:x1872772280622208:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015534.669215:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+15:2354:x1872772280622208:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 288us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015534.669256:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280621824 00000100:00100000:2.0:1786015534.669259:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 529 00000100:00100000:1.0:1786015534.669260:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280621824 00000100:00100000:2.0:1786015534.669284:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 532 00000100:00100000:1.0:1786015534.669294:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 628 00000100:00100000:2.0:1786015534.669296:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280622464:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015534.669305:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280621824:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015534.669336:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280622464:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 43us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015534.669340:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280621824:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 36us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015534.669352:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 532 00000100:00100000:1.0:1786015534.669353:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 628 00000100:00080000:2.0:1786015534.669431:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786015534.669438:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015534.669441:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015534.670468:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 531 00010000:00010000:2.0:1786015534.956155:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015535.275957:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786015535.275983:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304452992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015535.276055:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015535.276236:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304452992 00000100:00100000:0.0:1786015535.276245:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304452992 00000100:00100000:0.0:1786015535.276315:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1786015535.276326:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304452992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015535.276362:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 90112000 pending 0 free 3857711104 avail 3855613952 00000100:00080000:3.0:1786015535.276389:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015535.276408:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304452992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015535.276416:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1786015535.276430:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304452992:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1786015535.355743:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967369 is committed 00000001:00080000:1.0:1786015535.358893:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967370 is committed 00010000:00010000:1.0:1786015535.980539:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015536.684144:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015536.684158:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015536.684515:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 41 count 3 00000040:00080000:0.0:1786015536.684524:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015536.812412:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304453504:0@lo:400:kworker.0 00000100:00100000:1.0:1786015536.812522:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015536.812723:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786015536.812749:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304453376:0@lo:400:kworker.0 00000100:00100000:2.0:1786015536.812939:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304453120:0@lo:400:kworker.0 00000100:00100000:1.0:1786015536.812953:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015536.813015:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015536.813073:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304453632:0@lo:400:kworker.0 00000100:00100000:1.0:1786015536.813109:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304453504 00000100:00100000:2.0:1786015536.813118:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015536.813120:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304453504 00000100:00100000:2.0:1786015536.813156:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1786015536.813166:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304453248:0@lo:400:kworker.0 00000100:00100000:1.0:1786015536.813193:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1786015536.813203:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015536.813213:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304453504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015536.813226:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304453760:0@lo:400:kworker.0 00000100:00100000:2.0:1786015536.813259:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015536.813302:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304453504:12345-0@lo:400:kworker.0 Request processed in 92us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015536.813315:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1786015536.813318:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304453376 00000100:00100000:2.0:1786015536.813326:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304453376 00000100:00100000:1.0:1786015536.813347:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304453760 00000100:00100000:1.0:1786015536.813354:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304453760 00000100:00100000:1.0:1786015536.813392:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:1.0:1786015536.813398:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304453760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015536.813440:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304453760:12345-0@lo:400:kworker.0 Request processed in 42us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015536.813446:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:1.0:1786015536.813485:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967370 gen 2 00000004:00080000:1.0:1786015536.813491:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967369 committed transno 4294967370 00000004:00080000:1.0:1786015536.813515:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b74aef00000, transno 4294967370 00000100:00100000:1.0:1786015536.813536:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304453504:0@lo:400:kworker.0 00000100:00100000:3.0:1786015536.813575:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304453120 00000100:00100000:3.0:1786015536.813583:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304453120 00000100:00100000:3.0:1786015536.813629:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1786015536.813642:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304453120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015536.813724:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304453120:12345-0@lo:400:kworker.0 Request processed in 85us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015536.813732:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1786015536.813807:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304453632 00000100:00100000:3.0:1786015536.813812:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304453632 00000100:00100000:2.0:1786015536.813880:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304453248 00000100:00100000:2.0:1786015536.813884:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304453248 00000100:00080000:1.0:1786015536.816661:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015536.816671:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015536.820069:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:2.0:1786015536.820349:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1786015536.820365:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304453632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015536.820739:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304453632:12345-0@lo:400:kworker.0 Request processed in 380us (7620us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015536.820750:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1786015536.820803:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:2.0:1786015536.820811:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304453248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015536.820848:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304453248:12345-0@lo:400:kworker.0 Request processed in 38us (7652us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015536.820854:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:2.0:1786015536.821257:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304453248:0@lo:400:kworker.0 00000100:00100000:2.0:1786015536.821277:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304453760:0@lo:400:kworker.0 00000100:00100000:2.0:1786015536.821289:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304453120:0@lo:400:kworker.0 00000100:00100000:2.0:1786015536.821301:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304453632:0@lo:400:kworker.0 00000100:00100000:2.0:1786015536.821349:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304453376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015536.821531:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304453376:12345-0@lo:400:kworker.0 Request processed in 1434us (8586us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015536.821539:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:2.0:1786015536.821577:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304453376:0@lo:400:kworker.0 00000001:00080000:0.0:1786015536.924233:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968218 is committed 00000020:00080000:0.0:1786015536.924394:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 31 batchid updated 00000001:00080000:0.0:1786015536.924428:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968219 is committed 00000020:00080000:0.0:1786015536.924450:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b74aee18e40 refcount 2 committed 0 result 0 batchid 32 00000020:00080000:0.0:1786015536.924457:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74b0987800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b749306cc00 00000020:00080000:0.0:1786015536.924461:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74b0987300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74bf9e9000 00000020:00080000:2.0:1786015536.924826:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 32 committed batchid 31 00000020:00080000:2.0:1786015536.926249:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 31 00010000:00010000:3.0:1786015537.004380:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015537.329614:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786015537.329645:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304453888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015537.329743:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015537.329854:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304453888 00000100:00100000:2.0:1786015537.329864:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304453888 00000100:00100000:2.0:1786015537.329941:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1786015537.329953:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304453888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015537.330002:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015537.330057:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304453888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015537.330064:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1786015537.330148:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304453888:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786015538.030522:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015538.206143:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015538.206253:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280622720 00000100:00100000:0.0:1786015538.206267:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280622720 00000100:00100000:0.0:1786015538.206351:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1373 00000100:00100000:0.0:1786015538.206362:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+48:31467:x1872772280622720:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1786015538.206497:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+48:31467:x1872772280622720:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 136us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015538.206504:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1373 00000100:00080000:1.0:1786015538.207121:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786015539.052058:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015539.791355:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015539.791420:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015539.791453:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015539.791481:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015539.791512:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015539.791544:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015539.791574:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015539.791620:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280622848 00000100:00100000:1.0:1786015539.791635:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280622848 00000100:00100000:1.0:1786015539.791710:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 630 00000100:00100000:1.0:1786015539.791722:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280622848:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015539.791858:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280622848:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 138us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015539.791866:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 630 00000100:00100000:1.0:1786015539.791906:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280623104 00000100:00100000:1.0:1786015539.791910:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280623104 00000100:00100000:1.0:1786015539.791945:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280623616 00000100:00100000:1.0:1786015539.791947:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280623616 00000100:00100000:1.0:1786015539.791960:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280623232 00000100:00100000:1.0:1786015539.791962:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280623232 00000100:00100000:1.0:1786015539.791976:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280623488 00000100:00100000:1.0:1786015539.791978:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280623488 00000100:00100000:1.0:1786015539.791994:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 535 00000100:00100000:1.0:1786015539.792001:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280623104:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015539.792032:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280623104:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015539.792039:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 535 00000100:00100000:1.0:1786015539.792050:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 536 00000100:00100000:1.0:1786015539.792069:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280623616:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015539.792096:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280623616:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015539.792103:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 536 00000100:00100000:1.0:1786015539.792114:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 537 00000100:00100000:1.0:1786015539.792119:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+15:2353:x1872772280623232:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015539.792140:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+15:2353:x1872772280623232:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015539.792144:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 537 00000100:00100000:1.0:1786015539.792153:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 538 00000100:00100000:1.0:1786015539.792158:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280623488:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015539.792176:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280623488:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 18us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015539.792182:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 538 00000100:00080000:1.0:1786015539.792387:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015539.793174:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280623360 00000100:00100000:2.0:1786015539.793192:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280623360 00000100:00100000:2.0:1786015539.793288:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280622976 00000100:00100000:2.0:1786015539.793292:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280622976 00000100:00100000:2.0:1786015539.793336:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 535 00000100:00100000:2.0:1786015539.793348:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+48:2353:x1872772280623360:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015539.793479:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+48:2353:x1872772280623360:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 132us (2023us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015539.793488:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 535 00000100:00100000:2.0:1786015539.793512:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 536 00000100:00100000:2.0:1786015539.793519:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+101:2353:x1872772280622976:12345-192.168.202.56@tcp:400:kworker.0 00000100:00080000:1.0:1786015539.793674:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015539.793694:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015539.794392:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+101:2353:x1872772280622976:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015539.794409:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 536 00010000:00010000:1.0:1786015540.086125:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786015540.166663:0:21725:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12s: race between restore requests ==== 07:25:38 (1786015538) 00000100:00100000:1.0:1786015540.396225:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786015540.396258:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304454016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015540.396333:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015540.396397:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304454016 00000100:00100000:1.0:1786015540.396405:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304454016 00000100:00100000:1.0:1786015540.396463:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1786015540.396473:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304454016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015540.396518:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 90112000 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015540.396565:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304454016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015540.396572:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1786015540.396626:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304454016:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786015540.397950:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015540.443690:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015540.445804:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280623744 00000100:00100000:2.0:1786015540.445819:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280623744 00000100:00100000:2.0:1786015540.445893:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1374 00000100:00100000:2.0:1786015540.445905:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:32103:x1872772280623744:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1786015540.446039:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:32103:x1872772280623744:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 137us (2359us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015540.446061:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1374 00000100:00080000:1.0:1786015540.450885:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015540.465000:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015540.465323:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280623872 00000100:00100000:2.0:1786015540.465334:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280623872 00000100:00100000:2.0:1786015540.465442:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1375 00000100:00100000:2.0:1786015540.465454:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+101:32104:x1872772280623872:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015540.465476:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015540.470435:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502d46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e45 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.470535:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.470550:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.470562:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.470604:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.470613:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.470620:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.472472:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.472490:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d4d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.472498:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.472504:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015540.472508:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.472516:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.472533:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06200) 00010000:00010000:3.0:1786015540.472536:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015540.472540:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.472547:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.472559:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.472565:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.472571:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.472576:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015540.472579:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.472585:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.472593:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x81f12197 (ffff8b74b0022500) 00010000:00010000:3.0:1786015540.472595:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015540.472599:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.472604:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502d54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.472653:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502d46 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e45 expref: 102 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.472669:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06200) 00010000:00010000:3.0:1786015540.472671:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015540.472675:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502d46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e45 expref: 102 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.472685:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488061c00, rc 0) 00000100:00100000:3.0:1786015540.472783:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+101:32104:x1872772280623872:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 7310us (7771us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015540.475393:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1375 00000100:00100000:1.0:1786015540.478947:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015540.479288:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280624128 00000100:00100000:0.0:1786015540.479300:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280624128 00000100:00100000:0.0:1786015540.479368:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1376 00000100:00100000:0.0:1786015540.479379:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+101:32104:x1872772280624128:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:0.0:1786015540.479437:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015540.479467:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502aad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d5e expref: 101 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.479486:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06200) 00010000:00010000:0.0:1786015540.479492:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015540.482130:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502d5b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.483021:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502aec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d73 expref: 47 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.483031:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502d5b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.483087:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502aec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d73 expref: 47 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.483105:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502aec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d73 expref: 47 pid: 7673 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015540.483121:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304454144:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015540.485521:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb540 going to sleep for 11 seconds 00000100:00100000:0.0:1786015540.488407:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304454144:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015540.488438:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502d5b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015540.489129:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015540.489535:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280624256 00000100:00100000:2.0:1786015540.489544:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280624256 00010000:00010000:2.0:1786015540.489585:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502aec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d73 expref: 48 pid: 7673 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015540.489629:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 414 00000100:00100000:2.0:1786015540.489638:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+48:2353:x1872772280624256:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015540.489654:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015540.489661:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502aec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d73 expref: 48 pid: 7673 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.489675:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502aec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d73 expref: 48 pid: 7673 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.489701:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502aec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8d73 expref: 48 pid: 7673 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.489720:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06200) 00010000:00010000:2.0:1786015540.489726:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502d5b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.489740:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502d5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.489747:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502d5b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.489971:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015540.490067:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+47:2353:x1872772280624256:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 428us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015540.490076:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 414 00010000:00010000:0.0:1786015540.490522:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502d5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.490531:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502d5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.490557:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d62 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.490568:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.490577:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015540.491717:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 512 00010000:00010000:0.0:1786015540.491733:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502d5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.491741:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502d5b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.491747:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502d5b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.491754:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015540.491786:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502d5b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.491794:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502d5b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.491809:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06200) 00010000:00010000:0.0:1786015540.491812:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015540.491817:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502d5b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.491822:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502d5b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015540.491881:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000934c36cc reply state 0000000021357228 transno 4294968220 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015540.491890:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015540.491972:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+102:32104:x1872772280624128:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 12592us (13031us total) trans 4294968220 rc 0/0 00000100:00100000:0.0:1786015540.491980:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1376 00010000:00010000:0.0:1786015540.494509:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.494527:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d62 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.494535:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d62 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.494546:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015540.494551:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d62 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.494558:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d62 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.494575:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x81f12197 (ffff8b748f24a000) 00010000:00010000:0.0:1786015540.494579:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015540.494583:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d62 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.494590:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d62 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015540.499509:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015540.499839:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280624384 00000100:00100000:0.0:1786015540.499851:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280624384 00000100:00100000:0.0:1786015540.499909:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1377 00000100:00100000:0.0:1786015540.499917:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+101:32105:x1872772280624384:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1786015540.499941:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015540.499965:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502d69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e4c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.500037:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.500062:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.500079:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015540.500160:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1786015540.500164:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 33 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015540.500190:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.500215:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c502d69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e4c expref: 103 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.500232:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e4c expref: 102 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.500380:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ac00) 00010000:00010000:0.0:1786015540.500384:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015540.500388:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7e00, rc 0) 00000100:00100000:0.0:1786015540.500523:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+102:32105:x1872772280624384:12345-192.168.202.56@tcp:101:bash.0 Request processed in 605us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015540.500531:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1377 00000100:00100000:0.0:1786015540.504490:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015540.504670:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280624512 00000100:00100000:3.0:1786015540.504683:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280624512 00000100:00100000:3.0:1786015540.504925:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1378 00000100:00100000:3.0:1786015540.504935:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+102:32105:x1872772280624512:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1786015540.504958:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015540.504980:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502d77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e53 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.505058:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502d7e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.505073:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502d7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.505084:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502d7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.505100:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.505108:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.505114:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511495:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502d8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511520:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511533:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015540.511607:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 512 00000004:00200000:3.0:1786015540.511611:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015540.511641:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511656:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502d7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511662:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502d7e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511668:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502d7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511676:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015540.511680:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502d7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511687:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502d7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511701:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ac00) 00010000:00010000:3.0:1786015540.511704:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015540.511709:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502d7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511714:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502d7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511729:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511735:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511741:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511745:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015540.511748:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511753:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511775:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x81f12197 (ffff8b74b0022500) 00010000:00010000:3.0:1786015540.511778:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015540.511781:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d85 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511790:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502d85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511829:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502d77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e53 expref: 104 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511843:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbcc00/0xb1a5ef690c502d8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e53 expref: 103 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.511851:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:3.0:1786015540.511854:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786015540.511856:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbcc00, rc 0) 00000100:00100000:3.0:1786015540.511941:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+103:32105:x1872772280624512:12345-192.168.202.56@tcp:101:bash.0 Request processed in 7006us (7459us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015540.511950:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1378 00000100:00100000:3.0:1786015540.515617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015540.515828:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280624640 00000100:00100000:0.0:1786015540.515839:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280624640 00000100:00100000:0.0:1786015540.515907:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1379 00000100:00100000:0.0:1786015540.515918:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+103:32105:x1872772280624640:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1786015540.515942:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015540.515963:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e5a expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.516033:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.516057:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.516068:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.518799:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502da1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.518825:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.518837:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.518932:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.518939:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.518946:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.518953:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015540.518957:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.518968:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.518981:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:0.0:1786015540.518984:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015540.518989:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.518995:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502d9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.519008:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.519013:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502da1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.519019:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502da1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.519024:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015540.519027:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502da1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.519033:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502da1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.519039:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff8b748f24a000) 00010000:00010000:0.0:1786015540.519041:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015540.519044:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502da1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.519067:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502da1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.519118:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d93 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e5a expref: 104 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.519129:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:0.0:1786015540.519131:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015540.519134:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502d93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e5a expref: 104 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.519144:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6000, rc 0) 00000100:00100000:0.0:1786015540.519213:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+103:32105:x1872772280624640:12345-192.168.202.56@tcp:101:bash.0 Request processed in 3296us (3605us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015540.519221:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1379 00000100:00100000:2.0:1786015540.532878:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015540.532966:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280624768 00000100:00100000:1.0:1786015540.532976:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280624768 00000100:00100000:1.0:1786015540.533037:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1380 00000100:00100000:1.0:1786015540.533059:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+47:32106:x1872772280624768:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:1.0:1786015540.533082:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015540.533106:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502da8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e61 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.533187:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502daf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.533202:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502daf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.533213:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502daf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015540.533289:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1786015540.533294:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 33 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015540.533319:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502daf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.533343:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502da8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e61 expref: 49 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.533369:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502daf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e61 expref: 48 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.533378:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ac00) 00010000:00010000:1.0:1786015540.533382:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015540.533386:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921800, rc 0) 00000100:00100000:1.0:1786015540.533451:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+48:32106:x1872772280624768:12345-192.168.202.56@tcp:101:rm.0 Request processed in 404us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015540.533458:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1380 00000100:00100000:1.0:1786015540.537285:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015540.537392:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280624896 00000100:00100000:3.0:1786015540.537402:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280624896 00000100:00100000:3.0:1786015540.537465:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1381 00000100:00100000:3.0:1786015540.537476:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+48:32106:x1872772280624896:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015540.537498:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015540.537521:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502db6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e68 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537593:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502dbd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537611:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502dbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537621:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502dbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537636:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502dc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537642:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537648:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537757:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502dcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537809:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502dcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537817:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502dcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015540.537849:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 512 00000004:00200000:3.0:1786015540.537854:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015540.537878:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502dcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537890:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502dbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537901:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502dbd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537907:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502dbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537913:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015540.537918:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502dbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537925:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502dbd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537937:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ac00) 00010000:00010000:3.0:1786015540.537940:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015540.537944:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502dbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537950:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502dbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537962:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537968:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502dc4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537974:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537978:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015540.537981:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537986:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502dc4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.537992:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x81f12197 (ffff8b74b0022500) 00010000:00010000:3.0:1786015540.537994:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015540.537996:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502dc4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.538002:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502dc4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.538031:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502db6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e68 expref: 50 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.538057:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc600/0xb1a5ef690c502dcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e68 expref: 49 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.538064:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:3.0:1786015540.538067:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786015540.538069:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc600, rc 0) 00000100:00100000:3.0:1786015540.538131:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32106:x1872772280624896:12345-192.168.202.56@tcp:101:rm.0 Request processed in 657us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015540.538139:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1381 00000100:00100000:3.0:1786015540.543007:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015540.543162:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280625024 00000100:00100000:1.0:1786015540.543173:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280625024 00000100:00100000:1.0:1786015540.543238:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1382 00000100:00100000:1.0:1786015540.543249:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32106:x1872772280625024:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:1.0:1786015540.543269:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015540.543291:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502dd2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e6f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543363:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502dd9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543377:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543388:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543406:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502de0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543412:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543418:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543491:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543499:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502dd9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543506:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502dd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543512:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015540.543516:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502dd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543524:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502dd9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543536:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:1.0:1786015540.543539:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015540.543544:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502dd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543549:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502dd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543561:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543567:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502de0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543573:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502de0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543578:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015540.543581:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502de0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543587:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502de0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543594:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff8b748f194f00) 00010000:00010000:1.0:1786015540.543596:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015540.543599:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502de0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543605:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502de0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543636:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502dd2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e6f expref: 50 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543646:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:1.0:1786015540.543648:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015540.543652:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502dd2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e6f expref: 50 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.543660:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920000, rc 0) 00000100:00100000:1.0:1786015540.544074:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32106:x1872772280625024:12345-192.168.202.56@tcp:101:rm.0 Request processed in 825us (1073us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015540.544083:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1382 00000100:00100000:1.0:1786015540.548698:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015540.549566:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280625152 00000100:00100000:2.0:1786015540.549578:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280625152 00000100:00100000:2.0:1786015540.549647:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1383 00000100:00100000:2.0:1786015540.549657:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32106:x1872772280625152:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015540.549690:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015540.549714:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502de7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e76 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.549978:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502dee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.549994:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502dee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550004:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502dee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550019:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502df5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550027:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502df5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550033:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502df5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550110:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502dee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550119:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502dee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550125:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502dee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550132:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488060a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015540.550487:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502dee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550496:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502dee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550508:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:2.0:1786015540.550511:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015540.550516:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502dee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550522:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502dee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550535:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502df5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550541:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502df5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550547:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502df5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550551:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015540.550555:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502df5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550560:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502df5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550567:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff8b7487f06000) 00010000:00010000:2.0:1786015540.550570:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015540.550572:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502df5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550578:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c502df5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550620:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502de7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e76 expref: 50 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550630:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:2.0:1786015540.550632:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015540.550636:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502de7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e76 expref: 50 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.550650:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488061e00, rc 0) 00000100:00100000:2.0:1786015540.551442:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32106:x1872772280625152:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1783us (2750us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015540.551452:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1383 00000100:00100000:2.0:1786015540.566024:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015540.566156:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280625280 00000100:00100000:0.0:1786015540.566167:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280625280 00000100:00100000:0.0:1786015540.566228:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1384 00000100:00100000:0.0:1786015540.566246:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32107:x1872772280625280:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015540.566269:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015540.566291:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502dfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e7d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566359:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502e03 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566372:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502e03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566383:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502e03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566398:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502e0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566405:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566413:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566475:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502e03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566483:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502e03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566490:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502e03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566496:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015540.566500:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502e03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566507:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502e03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566520:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:0.0:1786015540.566523:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015540.566527:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502e03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566534:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c502e03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566547:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566552:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502e0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566557:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502e0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566562:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015540.566565:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502e0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566571:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502e0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566579:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff8b748f24a000) 00010000:00010000:0.0:1786015540.566581:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015540.566583:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502e0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566589:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c502e0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566623:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502dfc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e7d expref: 50 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566638:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:0.0:1786015540.566640:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015540.566643:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c502dfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e7d expref: 50 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.566652:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6000, rc 0) 00000100:00100000:0.0:1786015540.566721:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32107:x1872772280625280:12345-192.168.202.56@tcp:101:cp.0 Request processed in 476us (705us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015540.566728:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1384 00000100:00100000:3.0:1786015540.571496:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015540.571632:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280625408 00000100:00100000:1.0:1786015540.571643:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280625408 00000100:00100000:1.0:1786015540.571710:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1385 00000100:00100000:1.0:1786015540.571721:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32107:x1872772280625408:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015540.571743:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015540.571801:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502e11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e84 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.571869:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.571884:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.571894:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.571909:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.571916:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.571927:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.571991:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.571997:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.572005:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.572010:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015540.572015:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.572023:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.572034:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:1.0:1786015540.572037:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015540.572041:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.572056:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.572068:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.572075:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.572081:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.572087:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015540.572090:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.572095:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.572103:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff8b748f194f00) 00010000:00010000:1.0:1786015540.572105:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015540.572108:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.572113:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.572146:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502e11 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e84 expref: 50 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.572157:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:1.0:1786015540.572159:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015540.572162:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c502e11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e84 expref: 50 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.572172:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920000, rc 0) 00000100:00100000:1.0:1786015540.572246:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32107:x1872772280625408:12345-192.168.202.56@tcp:101:cp.0 Request processed in 527us (757us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015540.572256:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1385 00000100:00100000:2.0:1786015540.577944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015540.578028:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280625664 00000100:00100000:1.0:1786015540.578039:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280625664 00000100:00100000:1.0:1786015540.578110:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1386 00000100:00100000:1.0:1786015540.578121:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32107:x1872772280625664:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015540.578153:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015540.578178:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502e26 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e8b expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.578328:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502e2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.578343:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502e2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.578356:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502e2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.578370:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502e34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.578377:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502e34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.578384:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502e34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786015540.579719:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b:0x0], index 0: 0 00010000:00010000:1.0:1786015540.579976:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502e3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.579991:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.580002:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.580041:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502e2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.580058:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502e2d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.580064:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502e2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.580070:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015540.580074:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502e2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.580081:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502e2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.580094:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:1.0:1786015540.580098:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015540.580102:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502e2d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.580109:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502e2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786015540.580121:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000089b02feb reply state 000000004afb9cd1 transno 4294968221 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502e34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015540.580131:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786015540.581437:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c502e26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e8b expref: 52 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.581459:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502e3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e8b expref: 51 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.581468:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b748f194800) 00010000:00010000:0.0:1786015540.581470:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015540.581473:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920c00, rc 0) 00000100:00100000:0.0:1786015540.581554:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+52:32107:x1872772280625664:12345-192.168.202.56@tcp:101:cp.0 Request processed in 3434us (3619us total) trans 4294968221 rc 0/0 00000100:00100000:0.0:1786015540.581563:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1386 00010000:00010000:3.0:1786015540.584441:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502e34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.584462:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502e34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.584470:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502e34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.584476:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015540.584481:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502e34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.584488:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502e34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.584505:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff8b748f194700) 00010000:00010000:3.0:1786015540.584508:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015540.584513:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502e34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.584520:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c502e34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015540.589819:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015540.590246:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280625792 00000100:00100000:1.0:1786015540.590259:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280625792 00000100:00100000:1.0:1786015540.590322:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 387 00000100:00100000:1.0:1786015540.590333:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280625792:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015540.590353:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015540.590374:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4e4284e/0xb1a5ef690c502e49 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e92 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015540.590403:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786015540.590423:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=775s v=(0 0) 00010000:00010000:1.0:1786015540.590427:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015540.590438:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4e4284e/0xb1a5ef690c502e49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e92 expref: 9 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.590456:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f4e4284e/0xb1a5ef690c502e49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e92 expref: 9 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.590470:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920e00, rc 0) 00000100:00100000:1.0:1786015540.590534:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280625792:12345-192.168.202.56@tcp:101:cp.0 Request processed in 203us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015540.590542:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 387 00000100:00100000:2.0:1786015540.595341:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015540.595431:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280625920 00000100:00100000:1.0:1786015540.595442:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280625920 00000100:00100000:1.0:1786015540.595504:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 388 00000100:00100000:1.0:1786015540.595514:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:32107:x1872772280625920:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015540.595534:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015540.595554:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502e50 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8e99 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.595585:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4e4284e/0xb1a5ef690c502e49 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e92 expref: 10 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.595594:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015540.595598:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015540.595604:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502e50 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e99 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.595639:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f4e4284e/0xb1a5ef690c502e49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e92 expref: 10 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.595653:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f4e4284e/0xb1a5ef690c502e49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e92 expref: 10 pid: 11384 timeout: 875 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015540.595667:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304454272:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015540.595752:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0175180 going to sleep for 11 seconds 00000100:00100000:3.0:1786015540.599635:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015540.599738:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280626048 00000100:00100000:2.0:1786015540.599748:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280626048 00010000:00010000:2.0:1786015540.599831:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f4e4284e/0xb1a5ef690c502e49 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e92 expref: 11 pid: 11384 timeout: 875 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015540.599874:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 415 00000100:00100000:2.0:1786015540.599884:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280626048:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015540.599899:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015540.599922:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4e4284e/0xb1a5ef690c502e49 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e92 expref: 11 pid: 11384 timeout: 875 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.599938:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4e4284e/0xb1a5ef690c502e49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e92 expref: 11 pid: 11384 timeout: 875 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.599965:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015540.599970:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015540.599979:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502e50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e99 expref: 11 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.599990:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502e50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e99 expref: 11 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.600027:0:6607:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502e50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e99 expref: 11 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015540.600041:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304454400:192.168.202.56@tcp:105: 00000100:00100000:2.0:1786015540.600127:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0023840 going to sleep for 11 seconds 00010000:00010000:1.0:1786015540.600444:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4e4284e/0xb1a5ef690c502e49 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e92 expref: 11 pid: 11384 timeout: 875 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015540.600459:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304454272:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015540.600481:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502e50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e99 expref: 10 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.600492:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920000, rc 0) 00000100:00100000:1.0:1786015540.600537:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:32107:x1872772280625920:12345-192.168.202.56@tcp:101:cp.0 Request processed in 5024us (5205us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015540.600544:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 388 00000100:00100000:3.0:1786015540.609469:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015540.609575:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280626304 00000100:00100000:0.0:1786015540.609586:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280626304 00000100:00100000:0.0:1786015540.609658:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 280 00000100:00100000:0.0:1786015540.609669:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:32107:x1872772280626304:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:0.0:1786015540.610092:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+52:32107:x1872772280626304:12345-192.168.202.56@tcp:35:cp.0 Request processed in 423us (635us total) trans 4294968222 rc 0/0 00000100:00100000:0.0:1786015540.610100:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 280 00000100:00100000:2.0:1786015540.610715:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304454400:192.168.202.56@tcp:105: 00010000:00010000:2.0:1786015540.610740:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015540.610818:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280626048:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 10935us (11191us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015540.610826:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 415 00000100:00100000:3.0:1786015540.661907:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015540.662003:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280626432 00000100:00100000:1.0:1786015540.662022:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280626432 00000100:00100000:1.0:1786015540.662097:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1387 00000100:00100000:1.0:1786015540.662107:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+103:32110:x1872772280626432:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015540.662130:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015540.662163:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502e57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ea0 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662474:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e5e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662490:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662503:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662523:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662530:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662536:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662635:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502e6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662645:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502e6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662653:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502e6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015540.662687:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00000004:00200000:1.0:1786015540.662692:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015540.662710:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502e6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662722:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502e6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662731:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662736:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e5e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662743:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662748:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015540.662753:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662803:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e5e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662818:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:1.0:1786015540.662821:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015540.662826:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662832:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502e5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662846:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662853:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662859:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662864:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015540.662867:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662873:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662881:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff8b748f194b00) 00010000:00010000:1.0:1786015540.662883:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015540.662886:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662891:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502e65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662929:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502e57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ea0 expref: 105 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662943:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502e6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ea0 expref: 104 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.662950:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b748f194800) 00010000:00010000:1.0:1786015540.662953:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015540.662955:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920a00, rc 0) 00000100:00100000:1.0:1786015540.663548:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+104:32110:x1872772280626432:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 909us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015540.663559:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1387 00000100:00100000:3.0:1786015540.668543:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015540.668795:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280626560 00000100:00100000:1.0:1786015540.668807:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280626560 00000100:00100000:1.0:1786015540.668866:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 389 00000100:00100000:1.0:1786015540.668878:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280626560:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015540.668896:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015540.668918:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c502e73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ea7 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015540.668984:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304454528:192.168.202.56@tcp:106: 00000100:00100000:1.0:1786015540.669094:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0175180 going to sleep for 11 seconds 00002000:00010000:1.0:1786015540.673523:0:6591:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1786015540.673532:0:6591:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb mtime: 0 -> 1786015540 00002000:00010000:1.0:1786015540.673535:0:6591:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb atime: 0 -> 1786015540 00002000:00010000:1.0:1786015540.673537:0:6591:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb ctime: 0 -> 1786015540 00000100:00100000:1.0:1786015540.673561:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304454528:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015540.673596:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c502e73 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ea7 expref: 17 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.673620:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c502e73 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ea7 expref: 17 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.673634:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921000, rc 0) 00000100:00100000:1.0:1786015540.673692:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280626560:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 4817us (5162us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015540.673700:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 389 00000100:00100000:3.0:1786015540.678580:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015540.678713:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280626688 00000100:00100000:2.0:1786015540.678725:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280626688 00000100:00100000:2.0:1786015540.678823:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1388 00000100:00100000:2.0:1786015540.678834:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+104:32110:x1872772280626688:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015540.678857:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015540.678881:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502e7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8eae expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.678960:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502e81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.678975:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.678987:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015540.679073:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 512 00000004:00200000:2.0:1786015540.679081:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015540.679109:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.679138:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502e7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eae expref: 106 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.679158:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502e81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eae expref: 105 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.679166:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:2.0:1786015540.679169:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015540.679172:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488060a00, rc 0) 00000100:00100000:2.0:1786015540.679253:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+105:32110:x1872772280626688:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 420us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015540.679260:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1388 00000100:00100000:3.0:1786015540.684151:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015540.684493:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280626816 00000100:00100000:2.0:1786015540.684504:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280626816 00000100:00100000:2.0:1786015540.684569:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 390 00000100:00100000:2.0:1786015540.684580:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280626816:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015540.684599:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015540.684621:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011cc792c/0xb1a5ef690c502e88 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8eb5 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015540.684687:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304454656:192.168.202.56@tcp:106: 00000100:00100000:2.0:1786015540.684794:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0023840 going to sleep for 11 seconds 00000100:00100000:2.0:1786015540.690599:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304454656:192.168.202.56@tcp:106: 00010000:00010000:2.0:1786015540.690647:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000011cc792c/0xb1a5ef690c502e88 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eb5 expref: 17 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.690673:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011cc792c/0xb1a5ef690c502e88 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eb5 expref: 17 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.690687:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488061400, rc 0) 00000100:00100000:2.0:1786015540.690753:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280626816:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 6175us (6624us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015540.690792:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 390 00000100:00100000:3.0:1786015540.698726:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015540.698858:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280627072 00000100:00100000:0.0:1786015540.698868:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280627072 00000100:00100000:0.0:1786015540.698931:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1389 00000100:00100000:0.0:1786015540.698941:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+105:32110:x1872772280627072:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:0.0:1786015540.699279:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].41, 136 off13768 00000100:00100000:0.0:1786015540.699390:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+105:32110:x1872772280627072:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 449us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015540.699398:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1389 00000040:00080000:0.0:1786015540.780054:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015540.780063:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015540.780104:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 42 count 4 00000040:00080000:0.0:1786015540.780110:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015540.780408:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba0000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304454784:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786015540.780515:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb540 going to sleep for 11 seconds 00000100:00100000:3.0:1786015540.793204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015540.793428:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280627200 00000100:00100000:1.0:1786015540.793446:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280627200 00000100:00100000:0.0:1786015540.793550:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba0000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304454784:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015540.793608:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1390 00000100:00100000:1.0:1786015540.793625:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+52:32120:x1872772280627200:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786015540.793689:0:7673:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x2a:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786015540.793951:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+52:32120:x1872772280627200:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 328us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015540.793959:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1390 00000100:00100000:3.0:1786015540.799562:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015540.800017:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280627456 00000100:00100000:2.0:1786015540.800032:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280627456 00000100:00100000:2.0:1786015540.800136:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1391 00000100:00100000:2.0:1786015540.800149:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+52:32120:x1872772280627456:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015540.800365:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015540.800398:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502e8f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ebc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.800549:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502e96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.800571:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502e96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.800587:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502e96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015540.800602:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00010000:00010000:2.0:1786015540.801079:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c502e8f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ebc expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.801104:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502e96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ebc expref: 54 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.801115:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b748f194800) 00010000:00010000:2.0:1786015540.801118:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015540.801122:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488061e00, rc 0) 00000100:00100000:2.0:1786015540.801474:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32120:x1872772280627456:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1325us (1927us total) trans 4294968223 rc 0/0 00000100:00100000:2.0:1786015540.801484:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1391 00000100:00100000:3.0:1786015540.814896:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015540.814973:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015540.815014:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280627712 00000100:00100000:3.0:1786015540.815027:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280627712 00000100:00100000:3.0:1786015540.815119:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 66 00000100:00100000:0.0:1786015540.815355:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280627584 00000100:00100000:0.0:1786015540.815361:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280627584 00000100:00100000:0.0:1786015540.815409:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 391 00000100:00100000:0.0:1786015540.815418:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280627584:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786015540.815487:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000083734aac/0xb1a5ef690c502ea4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.815520:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502e50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e99 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.815530:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1b:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786015540.815535:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015540.815540:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083734aac/0xb1a5ef690c502ea4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.815588:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502e50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e99 expref: 9 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.815608:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502e50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e99 expref: 9 pid: 14547 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015540.815628:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304454912:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015540.815754:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb540 going to sleep for 11 seconds 00000100:00100000:3.0:1786015540.816886:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabf4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+54:2354:x1872772280627712:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015540.816917:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015540.816957:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c502e96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ebc expref: 54 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015540.816981:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b748f194800) 00010000:00010000:3.0:1786015540.816987:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015540.817076:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabf4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2354:x1872772280627712:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1946us (2101us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015540.817088:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 66 00000100:00100000:0.0:1786015540.825496:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304454912:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015540.825539:0:14547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000083734aac/0xb1a5ef690c502ea4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015540.826351:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015540.827155:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280627840 00000100:00100000:2.0:1786015540.827184:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280627840 00002000:00100000:2.0:1786015540.827268:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (0->157) req@ffff8b74aeba0000 x1872772280627840/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:386/0 lens 648/0 e 0 to 0 dl 1786015551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015540.827283:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aeba0000 with x1872772280627840 ext(0->157) 00010000:00010000:2.0:1786015540.827297:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502e50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e99 expref: 10 pid: 14547 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.827324:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502e50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e99 expref: 10 pid: 14547 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015540.827335:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b74aeba0000 00000100:00100000:2.0:1786015540.827380:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:2.0:1786015540.827393:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280627840:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:2.0:1786015540.832405:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2351:x1872772280627840:12345-192.168.202.56@tcp:4:cp.0 Request processed in 5002us (6052us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1786015540.832423:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 14 00002000:00100000:2.0:1786015540.832439:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (0->157) req@ffff8b74aeba0000 x1872772280627840/t4294967371(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:386/0 lens 648/448 e 0 to 0 dl 1786015551 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786015540.832451:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aeba0000 with x1872772280627840 ext(0->157) 00010000:00010000:2.0:1786015540.832463:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502e50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e99 expref: 12 pid: 14547 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.832485:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502e50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e99 expref: 12 pid: 14547 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015540.832493:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b74aeba0000 00000100:00100000:2.0:1786015540.842107:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015540.842495:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280627968 00000100:00100000:0.0:1786015540.842509:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280627968 00010000:00010000:0.0:1786015540.842571:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502e50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e99 expref: 12 pid: 14547 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015540.842648:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 416 00000100:00100000:0.0:1786015540.842661:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2351:x1872772280627968:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015540.842683:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015540.842717:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502e50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e99 expref: 12 pid: 14547 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.842735:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502e50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e99 expref: 12 pid: 14547 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.842820:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c502e50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e99 expref: 12 pid: 14547 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.842845:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015540.842851:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015540.842860:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083734aac/0xb1a5ef690c502ea4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.842872:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083734aac/0xb1a5ef690c502ea4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.842918:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015540.842985:0:14547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000083734aac/0xb1a5ef690c502ea4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.842996:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083734aac/0xb1a5ef690c502ea4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015540.842997:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280627968:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 338us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015540.843005:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 416 00010000:00010000:2.0:1786015540.843031:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000083734aac/0xb1a5ef690c502ea4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.843039:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083734aac/0xb1a5ef690c502ea4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.843059:0:14547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083734aac/0xb1a5ef690c502ea4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.843067:0:14547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7a00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015540.843072:0:14547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083734aac/0xb1a5ef690c502ea4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.843081:0:14547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083734aac/0xb1a5ef690c502ea4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.843095:0:14547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083734aac/0xb1a5ef690c502ea4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.843102:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083734aac/0xb1a5ef690c502ea4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015540.843387:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280627584:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 27968us (28505us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015540.843403:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 391 00000100:00100000:0.0:1786015540.849460:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015540.849551:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280628224 00000100:00100000:2.0:1786015540.849567:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280628224 00000100:00100000:2.0:1786015540.849654:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1392 00000100:00100000:2.0:1786015540.849668:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:32120:x1872772280628224:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015540.849878:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:32120:x1872772280628224:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 212us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015540.849888:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1392 00000100:00100000:0.0:1786015540.872605:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015540.872925:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280628352 00000100:00100000:2.0:1786015540.872938:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280628352 00000100:00100000:2.0:1786015540.873011:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 392 00000100:00100000:2.0:1786015540.873020:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280628352:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015540.873041:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015540.873083:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000888f0864/0xb1a5ef690c502eab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ec3 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015540.873121:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 158, mtime: 0x6a746f34, atime: 0x0, ctime: 0x6a746f34, blocks: 0x1 00010000:00010000:2.0:1786015540.873151:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=776s v=(0 0) 00010000:00010000:2.0:1786015540.873156:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015540.873168:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000888f0864/0xb1a5ef690c502eab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ec3 expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.873190:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000888f0864/0xb1a5ef690c502eab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ec3 expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.873215:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488061200, rc 0) 00000100:00100000:2.0:1786015540.873344:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280628352:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 323us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015540.873353:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 392 00000100:00100000:0.0:1786015540.886466:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015540.886861:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280628608 00000100:00100000:1.0:1786015540.886885:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280628608 00000100:00100000:1.0:1786015540.886959:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1393 00000100:00100000:1.0:1786015540.886971:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:32120:x1872772280628608:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786015540.887209:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:32120:x1872772280628608:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 239us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015540.887231:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1393 00000100:00100000:2.0:1786015540.897692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015540.897796:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280628736 00000100:00100000:0.0:1786015540.897811:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280628736 00002000:00100000:0.0:1786015540.897888:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (0->4095) req@ffff8b74aa477800 x1872772280628736/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:386/0 lens 488/0 e 0 to 0 dl 1786015551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015540.897902:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aa477800 with x1872772280628736 ext(0->4095) 00002000:00010000:0.0:1786015540.897912:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74aa477800 00000100:00100000:0.0:1786015540.897958:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 120 00000100:00100000:0.0:1786015540.897970:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280628736:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1786015540.898487:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280628736:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 504us (801us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786015540.898504:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 120 00002000:00100000:0.0:1786015540.898520:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (0->4095) req@ffff8b74aa477800 x1872772280628736/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:386/0 lens 488/4536 e 0 to 0 dl 1786015551 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015540.898532:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aa477800 with x1872772280628736 ext(0->4095) 00002000:00010000:0.0:1786015540.898540:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74aa477800 00000100:00100000:2.0:1786015540.904014:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015540.904124:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280628864 00000100:00100000:0.0:1786015540.904142:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280628864 00000100:00100000:0.0:1786015540.904221:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1394 00000100:00100000:0.0:1786015540.904232:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:32120:x1872772280628864:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015540.904256:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015540.904281:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c502eb2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8eca expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.904327:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502eb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.904344:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.904356:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.904540:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c502eb2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eca expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.904560:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eca expref: 54 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015540.905741:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b748f194800) 00010000:00010000:0.0:1786015540.905744:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015540.905748:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6600, rc 0) 00000100:00100000:0.0:1786015540.905841:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32120:x1872772280628864:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1608us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015540.905850:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1394 00000100:00100000:0.0:1786015540.918421:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015540.918511:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280628992 00000100:00100000:3.0:1786015540.918530:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280628992 00000100:00100000:3.0:1786015540.918619:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1395 00000100:00100000:3.0:1786015540.918631:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32120:x1872772280628992:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015540.918679:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x2a:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015540.918865:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32120:x1872772280628992:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 234us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015540.918873:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1395 00000100:00100000:2.0:1786015540.923932:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015540.924124:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280629120 00000100:00100000:1.0:1786015540.924140:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280629120 00000100:00100000:1.0:1786015540.924210:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 393 00000100:00100000:1.0:1786015540.924222:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280629120:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015540.924285:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c502ec0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.924306:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015540.924310:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015540.924318:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c502ec0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.924334:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c502ec0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.924374:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c502ec0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.924383:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c502ec0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.924391:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c502ec0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.924397:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921000 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015540.924403:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c502ec0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.924411:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c502ec0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.924425:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c502ec0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.924432:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c502ec0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015540.924540:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280629120:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 318us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015540.924549:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 393 00000100:00100000:0.0:1786015540.935239:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015540.935408:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280629376 00000100:00100000:1.0:1786015540.935424:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280629376 00000100:00100000:1.0:1786015540.935541:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1396 00000100:00100000:1.0:1786015540.935553:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32120:x1872772280629376:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786015540.935693:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ec7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.935715:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502eb9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eca expref: 54 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.935725:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ec7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.935807:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eca expref: 54 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.935838:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502eb9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eca expref: 54 pid: 5794 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015540.935855:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304455040:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015540.935968:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0175180 going to sleep for 11 seconds 00000100:00100000:0.0:1786015540.945391:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015540.945948:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280629504 00000100:00100000:2.0:1786015540.945962:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280629504 00010000:00010000:2.0:1786015540.946023:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502eb9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eca expref: 55 pid: 5794 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015540.946078:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 417 00000100:00100000:2.0:1786015540.946090:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+55:2354:x1872772280629504:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015540.946110:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015540.946118:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502eb9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eca expref: 55 pid: 5794 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.946134:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502eb9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eca expref: 55 pid: 5794 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.946167:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b748f194800) 00010000:00010000:2.0:1786015540.946174:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ec7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.946191:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ec7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.946200:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ec7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015540.946226:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015540.946301:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+55:2354:x1872772280629504:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 212us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015540.946310:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 417 00010000:00010000:1.0:1786015540.948335:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502eb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eca expref: 54 pid: 5794 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015540.948365:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304455040:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015540.948397:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ec7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.948408:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ec7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.948419:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ec7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.949052:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ec7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.949063:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ec7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.949071:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ec7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.949079:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015540.949085:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ec7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.949093:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ec7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.949113:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b748f194800) 00010000:00010000:1.0:1786015540.949116:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015540.949121:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ec7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015540.949127:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ec7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786015540.953450:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015540.953468:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1786015540.953792:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32120:x1872772280629376:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 18211us (18546us total) trans 4294968224 rc 0/0 00000100:00100000:0.0:1786015540.953819:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1396 00000040:00080000:1.0:1786015540.954384:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1786015540.954398:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015540.960425:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015540.960514:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280629760 00000100:00100000:1.0:1786015540.960529:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280629760 00000100:00100000:1.0:1786015540.960627:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 281 00000100:00100000:1.0:1786015540.960639:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32120:x1872772280629760:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015540.961006:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+55:32120:x1872772280629760:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 368us (595us total) trans 4294968225 rc 0/0 00000100:00100000:1.0:1786015540.961015:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 281 00010000:00010000:3.0:1786015541.101223:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015541.597444:0:21774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015541.597455:0:21774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015541.597505:0:21774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 42 count 4 00000040:00080000:1.0:1786015541.597512:0:21774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015541.687050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015541.692686:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280629888 00000100:00100000:2.0:1786015541.692704:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280629888 00000100:00100000:3.0:1786015541.698603:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 394 00000100:00100000:3.0:1786015541.698625:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+16:2351:x1872772280629888:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015541.698649:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015541.698673:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c502ece lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ed1 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015541.698707:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015541.698712:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015541.698724:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c502ece lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ed1 expref: 17 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015541.698744:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c502ece lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ed1 expref: 17 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015541.698798:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc400, rc 0) 00000100:00100000:3.0:1786015541.698872:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280629888:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 255us (11842us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015541.698879:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 394 00000100:00080000:1.0:1786015541.701958:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015541.713741:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015541.713971:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280630144 00000100:00100000:2.0:1786015541.713982:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280630144 00000100:00100000:2.0:1786015541.714109:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1397 00000100:00100000:2.0:1786015541.714124:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+105:32121:x1872772280630144:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015541.714150:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015541.714206:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061800/0xb1a5ef690c502ed5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ed8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015541.714332:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502edc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015541.714352:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502edc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015541.714369:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502edc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015541.714389:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00010000:00010000:2.0:1786015541.714539:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061800/0xb1a5ef690c502ed5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ed8 expref: 108 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015541.714559:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502edc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ed8 expref: 107 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015541.714568:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b748f194800) 00010000:00010000:2.0:1786015541.714571:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786015541.714576:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488061000, rc 0) 00000100:00100000:2.0:1786015541.714642:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+107:32121:x1872772280630144:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 522us (910us total) trans 4294968226 rc 0/0 00000100:00100000:2.0:1786015541.714651:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1397 00000100:00080000:1.0:1786015541.715441:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015541.720950:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015541.723234:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280630272 00000100:00100000:0.0:1786015541.723262:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280630272 00000100:00100000:0.0:1786015541.723349:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 395 00000100:00100000:0.0:1786015541.723361:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280630272:12345-192.168.202.56@tcp:1:lfs.0 00010000:00010000:0.0:1786015541.723427:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e3b593d/0xb1a5ef690c502eea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015541.723455:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000888f0864/0xb1a5ef690c502eab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ec3 expref: 10 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015541.723466:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c502ece lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ed1 expref: 17 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015541.723474:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015541.723480:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015541.723485:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e3b593d/0xb1a5ef690c502eea lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015541.723539:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c502ece lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ed1 expref: 17 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015541.723557:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c502ece lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ed1 expref: 17 pid: 14547 timeout: 876 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015541.723575:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383749180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304455168:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015541.723720:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000888f0864/0xb1a5ef690c502eab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ec3 expref: 10 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015541.723731:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000888f0864/0xb1a5ef690c502eab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ec3 expref: 10 pid: 6591 timeout: 876 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015541.723742:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383748380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304455296:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015541.723790:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b7e16300 going to sleep for 11 seconds 00000100:00100000:1.0:1786015541.726555:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383749180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304455168:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015541.726568:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383748380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304455296:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015541.726599:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004e3b593d/0xb1a5ef690c502eea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015541.733303:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015541.733351:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015541.734081:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280630528 00000100:00100000:3.0:1786015541.734096:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280630528 00010000:00010000:3.0:1786015541.734164:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000888f0864/0xb1a5ef690c502eab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ec3 expref: 11 pid: 6591 timeout: 876 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015541.734211:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280630400 00000100:00100000:3.0:1786015541.734215:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280630400 00000100:00080000:1.0:1786015541.734299:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015541.734449:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 418 00000100:00100000:0.0:1786015541.734467:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280630528:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015541.734490:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015541.734524:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000888f0864/0xb1a5ef690c502eab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ec3 expref: 11 pid: 6591 timeout: 876 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015541.734540:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000888f0864/0xb1a5ef690c502eab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ec3 expref: 11 pid: 6591 timeout: 876 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015541.734572:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000888f0864/0xb1a5ef690c502eab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ec3 expref: 11 pid: 6591 timeout: 876 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015541.734596:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015541.734731:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c502ece lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ed1 expref: 18 pid: 14547 timeout: 876 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015541.734784:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 419 00000100:00100000:3.0:1786015541.734791:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280630400:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015541.734801:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015541.734812:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c502ece lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ed1 expref: 18 pid: 14547 timeout: 876 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015541.734825:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c502ece lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ed1 expref: 18 pid: 14547 timeout: 876 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015541.734840:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c502ece lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ed1 expref: 18 pid: 14547 timeout: 876 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015541.734855:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015541.734860:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015541.734867:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004e3b593d/0xb1a5ef690c502eea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015541.734878:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e3b593d/0xb1a5ef690c502eea lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015541.734912:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015541.734974:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280630528:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 513us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015541.734983:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 418 00000100:00100000:3.0:1786015541.741891:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280630400:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 7082us (8521us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015541.741910:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 419 00010000:00010000:3.0:1786015541.741985:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004e3b593d/0xb1a5ef690c502eea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015541.742002:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e3b593d/0xb1a5ef690c502eea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015541.742061:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e3b593d/0xb1a5ef690c502eea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015541.742071:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e3b593d/0xb1a5ef690c502eea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015541.742081:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e3b593d/0xb1a5ef690c502eea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015541.742089:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6a00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015541.742094:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e3b593d/0xb1a5ef690c502eea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015541.742104:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e3b593d/0xb1a5ef690c502eea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015541.742133:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e3b593d/0xb1a5ef690c502eea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015541.742141:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e3b593d/0xb1a5ef690c502eea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015541.742269:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2351:x1872772280630272:12345-192.168.202.56@tcp:1:lfs.0 Request processed in 18910us (21513us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015541.742279:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 395 00000100:00100000:0.0:1786015541.753794:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015541.754501:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280630784 00000100:00100000:1.0:1786015541.754516:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280630784 00000100:00100000:1.0:1786015541.754616:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 282 00000100:00100000:1.0:1786015541.754628:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916ac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+107:32121:x1872772280630784:12345-192.168.202.56@tcp:35:lfs.0 00000004:00010000:1.0:1786015541.754711:0:5797:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x2a:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502edc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ed8 expref: 107 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786015541.755046:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968227 00000001:00080000:1.0:1786015541.756344:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968228 00010000:00010000:1.0:1786015541.756536:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ef1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.756562:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502e3b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e8b expref: 54 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.756577:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502e6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ea0 expref: 110 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.756588:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ef1 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.756639:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502e6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ea0 expref: 110 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.756658:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502e6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ea0 expref: 110 pid: 7673 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015541.756679:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af069880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304455424:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015541.756854:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502e3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e8b expref: 54 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.756864:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502e3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e8b expref: 54 pid: 5795 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015541.756875:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304455552:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015541.756904:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74aa53bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015541.762703:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015541.762734:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015541.763536:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280630912 00000100:00100000:1.0:1786015541.763551:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280630912 00010000:00010000:1.0:1786015541.763610:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502e6c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ea0 expref: 111 pid: 7673 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015541.763656:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280631040 00000100:00100000:1.0:1786015541.763660:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280631040 00010000:00010000:1.0:1786015541.763676:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502e3b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e8b expref: 55 pid: 5795 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015541.763702:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 420 00000100:00100000:1.0:1786015541.763713:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+111:2354:x1872772280630912:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015541.763734:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015541.763741:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502e6c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ea0 expref: 111 pid: 7673 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.763758:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502e6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ea0 expref: 111 pid: 7673 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.763806:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b748f194800) 00010000:00010000:1.0:1786015541.763812:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ef1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.763822:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ef1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.763830:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015541.763907:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+111:2354:x1872772280630912:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 196us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015541.763916:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 420 00000100:00100000:1.0:1786015541.763937:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 421 00000100:00100000:1.0:1786015541.763944:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+55:2354:x1872772280631040:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015541.763953:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015541.763958:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502e3b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e8b expref: 55 pid: 5795 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.763967:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502e3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e8b expref: 55 pid: 5795 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.763980:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b748f194800) 00010000:00010000:1.0:1786015541.763983:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ef1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.763991:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ef1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.763999:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ef1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.764019:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015541.764052:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+55:2354:x1872772280631040:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 108us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015541.764059:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 421 00010000:00010000:3.0:1786015541.765616:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c502e6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ea0 expref: 110 pid: 7673 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015541.765644:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af069880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304455424:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015541.765661:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c502e3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e8b expref: 54 pid: 5795 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015541.765672:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1872772304455552:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015541.765703:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ef1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015541.765714:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ef1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015541.765720:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ef1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786015541.765925:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968229 00000001:00080000:3.0:1786015541.766193:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968230 00000001:00080000:3.0:1786015541.766260:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968231 00000100:00100000:3.0:1786015541.766371:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381940000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304455680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1786015541.767525:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015541.767580:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7381ffb600 going to sleep for 11 seconds 00000100:00100000:1.0:1786015541.767729:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304455680 00000100:00100000:1.0:1786015541.767739:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304455680 00000100:00100000:1.0:1786015541.768000:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786015541.768012:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1872772304455680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1786015541.768153:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1872772304455680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 143us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015541.768166:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786015541.774920:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381940000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304455680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1786015541.775728:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968232 00000100:00100000:1.0:1786015541.775902:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304455808:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1786015541.775998:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015541.776057:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7381ffb780 going to sleep for 11 seconds 00000100:00100000:3.0:1786015541.776177:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304455808 00000100:00100000:3.0:1786015541.776186:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304455808 00000100:00100000:3.0:1786015541.776266:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1786015541.776277:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1872772304455808:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1786015541.776556:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5797:x1872772304455808:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 280us (557us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1786015541.776565:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1786015541.776893:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1872772304455808:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:1.0:1786015541.776926:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ef1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.776938:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ef1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.776947:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ef1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.776954:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015541.776960:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ef1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.776969:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ef1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.776989:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b748f194800) 00010000:00010000:1.0:1786015541.776992:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1786015541.776999:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ef1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015541.777005:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502ef1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786015541.777662:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x50:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1786015541.777958:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].13, 64 off9048 00000004:00080000:1.0:1786015541.777974:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777029212100ns, next at 778029208380ns, rc = 0 00000001:00080000:1.0:1786015541.777986:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968233 00010000:00010000:1.0:1786015541.778059:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b748f194800) 00010000:00010000:1.0:1786015541.778064:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786015541.778076:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c502edc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ed8 expref: 114 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015541.778699:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916ac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+113:32121:x1872772280630784:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 24070us (24936us total) trans 4294968234 rc 0/0 00000100:00100000:1.0:1786015541.778715:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 282 00000020:00080000:1.0:1786015541.778723:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:2.0:1786015541.932389:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304455936:0@lo:400:kworker.0 00000100:00100000:2.0:1786015541.932494:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015541.932565:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304456448:0@lo:400:kworker.0 00000100:00100000:2.0:1786015541.932611:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015541.932651:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786015541.932660:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304456064:0@lo:400:kworker.0 00000100:00100000:2.0:1786015541.932693:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015541.932733:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304456192:0@lo:400:kworker.0 00000100:00100000:2.0:1786015541.932820:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015541.932849:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786015541.932857:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304456320:0@lo:400:kworker.0 00000100:00100000:2.0:1786015541.932886:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015541.933202:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304456064 00000100:00100000:0.0:1786015541.933213:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304456064 00000100:00100000:0.0:1786015541.933271:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304456192 00000100:00100000:0.0:1786015541.933275:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304456192 00000100:00100000:0.0:1786015541.933305:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304456320 00000100:00100000:0.0:1786015541.933308:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304456320 00000100:00100000:0.0:1786015541.933328:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:0.0:1786015541.933336:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304456064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015541.933407:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304456064:12345-0@lo:400:kworker.0 Request processed in 72us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015541.933415:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:0.0:1786015541.933434:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:0.0:1786015541.933440:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304456192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015541.933468:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304456192:12345-0@lo:400:kworker.0 Request processed in 29us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015541.933475:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:0.0:1786015541.933486:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1786015541.933492:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304456320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015541.933525:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304456320:12345-0@lo:400:kworker.0 Request processed in 34us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015541.933530:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00080000:0.0:1786015541.933571:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015541.936999:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304456320:0@lo:400:kworker.0 00000100:00100000:2.0:1786015541.937024:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304456192:0@lo:400:kworker.0 00000100:00100000:2.0:1786015541.937121:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304455936 00000100:00100000:2.0:1786015541.937130:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304455936 00000100:00100000:2.0:1786015541.937208:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:2.0:1786015541.937218:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304455936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015541.937321:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304455936:12345-0@lo:400:kworker.0 Request processed in 105us (4827us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015541.937329:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:2.0:1786015541.937373:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304456448 00000100:00100000:2.0:1786015541.937377:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304456448 00000100:00100000:2.0:1786015541.937419:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:2.0:1786015541.937425:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304456448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015541.937463:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304456448:12345-0@lo:400:kworker.0 Request processed in 37us (4860us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015541.937469:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00080000:0.0:1786015541.938181:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015541.939440:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304456064:0@lo:400:kworker.0 00000100:00100000:0.0:1786015541.939461:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304455936:0@lo:400:kworker.0 00000100:00100000:0.0:1786015541.939475:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304456448:0@lo:400:kworker.0 00000001:00080000:0.0:1786015542.061971:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968222 is committed 00000001:00080000:0.0:1786015542.061995:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968220 is committed 00000001:00080000:0.0:1786015542.062005:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968234 is committed 00000004:00080000:0.0:1786015542.062011:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 15 committed 00000020:00080000:0.0:1786015542.062046:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b74aa53bcc0 refcount 2 committed 0 result 0 batchid 33 00000020:00080000:0.0:1786015542.062052:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b73813bb700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b74aa53b240 00000020:00080000:0.0:1786015542.062055:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b73813bb100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74ae8b6c00 00000020:00080000:3.0:1786015542.062094:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 33 committed batchid 31 00000020:00080000:3.0:1786015542.062384:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 31 00000100:00100000:3.0:1786015542.062751:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304456576:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786015542.062863:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1786015542.063024:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968225 is committed 00000020:00080000:0.0:1786015542.063059:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 32 batchid updated 00000100:00100000:2.0:1786015542.063146:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304456576 00000100:00100000:2.0:1786015542.063157:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304456576 00000100:00100000:2.0:1786015542.063349:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1786015542.063361:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304456576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1786015542.063399:0:6591:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:27 count 1 00002000:00010000:2.0:1786015542.063449:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 158, mtime: 0x6a746f34, atime: 0x0, ctime: 0x6a746f34, blocks: 0x1 00010000:00010000:2.0:1786015542.063459:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502ef8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015542.063480:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=777s v=(0 0) 00010000:00010000:2.0:1786015542.063487:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015542.063495:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502ef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015542.063514:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502ef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015542.063527:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502ef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015542.063536:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502ef8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015542.063552:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1786015542.064250:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786015542.064268:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786015542.064277:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502ef8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015542.064288:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061e00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015542.064294:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502ef8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015542.064305:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502ef8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015542.064328:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502ef8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015542.064336:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c502ef8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015542.064363:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015542.064365:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015542.064367:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015542.065099:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1872772304456576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1734us (2229us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1786015542.065110:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000004:00080000:3.0:1786015542.067916:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b74aee5b800/2, rc 0, transno 4294967373 00000100:00100000:3.0:1786015542.067936:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304456576:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1786015542.125877:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015542.444380:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304456704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015542.444490:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015542.444641:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304456704 00000100:00100000:0.0:1786015542.444651:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304456704 00000100:00100000:0.0:1786015542.444726:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1786015542.444737:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304456704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015542.444810:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015542.457672:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304456704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12920us (13166us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015542.457693:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1786015542.460891:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304456704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015542.728553:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015542.728598:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280631296 00000100:00100000:1.0:1786015542.728608:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280631296 00000100:00100000:1.0:1786015542.728665:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1398 00000100:00100000:1.0:1786015542.728675:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+103:32131:x1872772280631296:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:1.0:1786015542.728701:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015542.728725:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502eff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8edf expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.729578:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f06 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.729596:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.729613:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.729628:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.729634:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.729640:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.730374:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502f14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.730385:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502f14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.730393:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502f14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015542.730403:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00010000:00010000:1.0:1786015542.730519:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.730526:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.730533:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.730539:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015542.730544:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.730551:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.730563:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:1.0:1786015542.730566:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015542.730570:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.730576:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.730589:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.730595:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.730600:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.730606:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015542.730609:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.730615:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.730622:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff8b748f194800) 00010000:00010000:1.0:1786015542.730624:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015542.730627:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.730632:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.731408:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502eff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8edf expref: 106 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.731436:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502f14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8edf expref: 105 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015542.731443:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b748f194b00) 00010000:00010000:1.0:1786015542.731446:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015542.731448:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921400, rc 0) 00000100:00100000:1.0:1786015542.731532:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+105:32131:x1872772280631296:12345-192.168.202.56@tcp:101:cat.0 Request processed in 2857us (2987us total) trans 4294968235 rc 0/0 00000100:00100000:1.0:1786015542.731542:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1398 00000100:00100000:0.0:1786015542.738004:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015542.738305:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280631552 00000100:00100000:3.0:1786015542.738317:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280631552 00000100:00100000:3.0:1786015542.738389:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 67 00000100:00100000:3.0:1786015542.738399:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabf6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+105:32131:x1872772280631552:12345-192.168.202.56@tcp:103:cat.0 00010000:00010000:3.0:1786015542.738415:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015542.738440:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502f14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8edf expref: 105 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.738460:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b748f194b00) 00010000:00010000:3.0:1786015542.738472:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015542.738536:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabf6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+104:32131:x1872772280631552:12345-192.168.202.56@tcp:103:cat.0 Request processed in 139us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015542.738544:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 67 00000100:00100000:2.0:1786015542.751613:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015542.751839:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015542.754212:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280631936 00000100:00100000:3.0:1786015542.754233:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280631936 00000100:00100000:3.0:1786015542.754317:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280631808 00000100:00100000:3.0:1786015542.754321:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280631808 00000100:00100000:1.0:1786015542.754338:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1399 00000100:00100000:1.0:1786015542.754352:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+105:32131:x1872772280631936:12345-192.168.202.56@tcp:58:cat.0 00000004:00020000:1.0:1786015542.754450:0:5796:0:(mdt_hsm_cdt_client.c:349:mdt_hsm_register_hal()) cfs_race id 18b sleeping 00000100:00100000:3.0:1786015542.757244:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1400 00000100:00100000:3.0:1786015542.757271:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+105:32130:x1872772280631808:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:3.0:1786015542.757294:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015542.757319:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502f22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ee6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.757396:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502f29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.757411:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502f29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.757423:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502f29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.757439:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502f30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.757446:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502f30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.757452:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502f30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.758035:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502f37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.758046:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502f37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.758055:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502f37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015542.758066:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00010000:00010000:3.0:1786015542.758162:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502f29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.758170:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502f29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.758177:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502f29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.758183:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015542.758187:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502f29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.758194:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502f29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.758207:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:3.0:1786015542.758210:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015542.758214:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502f29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.758224:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502f29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.758237:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502f30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.758243:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502f30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.758248:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502f30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.758253:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015542.758255:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502f30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.758260:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502f30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.758267:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff8b74a04b5b00) 00010000:00010000:3.0:1786015542.758269:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015542.758272:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502f30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.758278:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502f30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.758320:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c502f22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ee6 expref: 108 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.758339:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502f37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ee6 expref: 107 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015542.758347:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:3.0:1786015542.758349:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015542.758352:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbde00, rc 0) 00000100:00100000:3.0:1786015542.758427:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+107:32130:x1872772280631808:12345-192.168.202.56@tcp:101:cat.0 Request processed in 1169us (6588us total) trans 4294968236 rc 0/0 00000100:00100000:3.0:1786015542.758435:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1400 00000100:00100000:3.0:1786015542.769955:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015542.770081:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280632192 00000100:00100000:1.0:1786015542.770092:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280632192 00000100:00100000:1.0:1786015542.770302:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 283 00000100:00100000:1.0:1786015542.770313:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+107:32130:x1872772280632192:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:1.0:1786015542.770558:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+108:32130:x1872772280632192:12345-192.168.202.56@tcp:35:cat.0 Request processed in 245us (607us total) trans 4294968237 rc 0/0 00000100:00100000:1.0:1786015542.770569:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 283 00010000:00010000:1.0:1786015543.148033:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015544.173084:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015544.897627:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015544.897744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015544.897829:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015544.897867:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015544.897891:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015544.897910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015544.897948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015544.897982:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280632576 00000100:00100000:2.0:1786015544.897992:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280632576 00000100:00100000:2.0:1786015544.898065:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280633088 00000100:00100000:2.0:1786015544.898069:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280633088 00000100:00100000:2.0:1786015544.898086:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280632704 00000100:00100000:2.0:1786015544.898088:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280632704 00000100:00100000:2.0:1786015544.898100:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280632960 00000100:00100000:2.0:1786015544.898102:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280632960 00000100:00100000:2.0:1786015544.898121:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 540 00000100:00100000:2.0:1786015544.898131:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280632576:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015544.898207:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280632576:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 76us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015544.898214:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 540 00000100:00100000:2.0:1786015544.898243:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 541 00000100:00100000:2.0:1786015544.898250:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280633088:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015544.898276:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280633088:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015544.898282:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 541 00000100:00100000:2.0:1786015544.898294:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 542 00000100:00100000:2.0:1786015544.898299:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+15:2354:x1872772280632704:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015544.898322:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+15:2354:x1872772280632704:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015544.898328:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 542 00000100:00100000:2.0:1786015544.898337:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 543 00000100:00100000:2.0:1786015544.898343:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280632960:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015544.898362:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280632960:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015544.898371:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 543 00000100:00100000:2.0:1786015544.898403:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280632832 00000100:00100000:2.0:1786015544.898407:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280632832 00000100:00100000:2.0:1786015544.898430:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280632448 00000100:00100000:2.0:1786015544.898434:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280632448 00000100:00100000:2.0:1786015544.898464:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 540 00000100:00100000:2.0:1786015544.898471:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+49:2354:x1872772280632832:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015544.898503:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+49:2354:x1872772280632832:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015544.898509:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 540 00000100:00100000:2.0:1786015544.898522:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 541 00000100:00100000:2.0:1786015544.898528:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+108:2354:x1872772280632448:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015544.901510:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+108:2354:x1872772280632448:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 2969us (3605us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015544.901525:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 541 00000100:00080000:0.0:1786015544.901688:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015544.901696:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015544.901699:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015544.906518:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280632320 00000100:00100000:1.0:1786015544.906534:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280632320 00000100:00100000:1.0:1786015544.906608:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 632 00000100:00100000:1.0:1786015544.906619:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280632320:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015544.907691:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280632320:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 1067us (10149us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015544.907703:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 632 00010000:00010000:0.0:1786015545.196178:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015545.516138:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786015545.516179:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304456832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015545.516282:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015545.517510:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304456832 00000100:00100000:3.0:1786015545.517525:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304456832 00000100:00100000:3.0:1786015545.517608:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1786015545.517621:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304456832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015545.517672:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 93519872 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015545.517816:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304456832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 198us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015545.517824:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:3.0:1786015545.517855:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015545.517907:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304456832:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1786015545.658148:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967373 is committed 00000001:00080000:2.0:1786015545.658193:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967371 is committed 00000040:00080000:1.0:1786015546.093241:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015546.093252:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015546.095283:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 42 count 2 00000040:00080000:1.0:1786015546.095298:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786015546.221136:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015547.053308:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304457088:0@lo:400:kworker.0 00000100:00100000:3.0:1786015547.053353:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304457216:0@lo:400:kworker.0 00000100:00100000:1.0:1786015547.053710:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b748825b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304457344:0@lo:400:kworker.0 00000100:00100000:0.0:1786015547.053781:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304456960:0@lo:400:kworker.0 00000100:00100000:2.0:1786015547.057853:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015547.057941:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304457600:0@lo:400:kworker.0 00000100:00100000:2.0:1786015547.058001:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015547.058046:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304457088 00000100:00100000:2.0:1786015547.058054:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304457088 00000100:00100000:2.0:1786015547.058104:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:2.0:1786015547.058115:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304457088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015547.058134:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015547.058184:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304457088:12345-0@lo:400:kworker.0 Request processed in 70us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015547.058193:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1786015547.058207:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304457600 00000100:00100000:3.0:1786015547.058212:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304457600 00000100:00100000:2.0:1786015547.058213:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304457216 00000100:00100000:2.0:1786015547.058218:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304457216 00000100:00100000:3.0:1786015547.058254:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1786015547.058262:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304457600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015547.058289:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015547.058306:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304457600:12345-0@lo:400:kworker.0 Request processed in 45us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015547.058315:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1786015547.058331:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304457344 00000100:00100000:3.0:1786015547.058335:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304457344 00000100:00100000:1.0:1786015547.059138:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304457600:0@lo:400:kworker.0 00000100:00100000:1.0:1786015547.059153:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304457088:0@lo:400:kworker.0 00000100:00100000:2.0:1786015547.063362:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:2.0:1786015547.063383:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304457216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015547.063490:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1872772304457216:12345-0@lo:400:kworker.0 Request processed in 114us (5356us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015547.063497:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:2.0:1786015547.065275:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1872772304457216:0@lo:400:kworker.0 00000100:00100000:0.0:1786015547.070599:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015547.070646:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304456960 00000100:00100000:0.0:1786015547.070655:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304456960 00000100:00100000:0.0:1786015547.070707:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:0.0:1786015547.070716:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304456960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015547.070789:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3314:x1872772304456960:12345-0@lo:400:kworker.0 Request processed in 74us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015547.070797:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:0.0:1786015547.070975:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3314:1872772304456960:0@lo:400:kworker.0 00000100:00100000:0.0:1786015547.070996:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304457472:0@lo:400:kworker.0 00000100:00100000:0.0:1786015547.071029:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015547.071054:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304457472 00000100:00100000:0.0:1786015547.071058:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304457472 00000100:00100000:0.0:1786015547.071091:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:0.0:1786015547.071098:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304457472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015547.071130:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872772304457472:12345-0@lo:400:kworker.0 Request processed in 32us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015547.071136:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:0.0:1786015547.071166:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1872772304457472:0@lo:400:kworker.0 00000100:00080000:1.0:1786015547.073071:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015547.073097:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015547.073101:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015547.073146:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:3.0:1786015547.073161:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304457344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015547.073264:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304457344:12345-0@lo:400:kworker.0 Request processed in 107us (14976us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015547.073271:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:1.0:1786015547.073426:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967373 gen 2 00000004:00080000:1.0:1786015547.073435:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967372 committed transno 4294967373 00000004:00080000:1.0:1786015547.073459:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b74aee5b800, transno 4294967373 00000100:00100000:1.0:1786015547.073483:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b748825b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304457344:0@lo:400:kworker.0 00000001:00080000:3.0:1786015547.178307:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968237 is committed 00000020:00080000:3.0:1786015547.178337:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 33 batchid updated 00000020:00080000:0.0:1786015547.178649:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 33 00000020:00080000:0.0:1786015547.178680:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 33 00010000:00010000:1.0:1786015547.244216:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015547.564012:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786015547.565311:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304457728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015547.565709:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015547.566188:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304457728 00000100:00100000:0.0:1786015547.566197:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304457728 00000100:00100000:0.0:1786015547.566251:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1786015547.566260:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304457728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015547.566295:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015547.566511:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304457728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 242us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015547.566519:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1786015547.566686:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304457728:0@lo:13:osp-pre-1-0.0 00000004:00020000:1.0:1786015548.075883:0:5796:0:(mdt_hsm_cdt_client.c:349:mdt_hsm_register_hal()) cfs_fail_race id 18b awake: rc=0 00010000:00010000:1.0:1786015548.085049:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502f45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.085075:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502f37 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ee6 expref: 104 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.085084:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502f45 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.085129:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502f37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ee6 expref: 104 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.085146:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502f37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ee6 expref: 104 pid: 5794 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015548.085174:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304457856:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015548.085372:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7485a7ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015548.113693:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304457856:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015548.113723:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502f45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015548.114991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015548.115269:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280633216 00000100:00100000:1.0:1786015548.115280:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280633216 00010000:00010000:1.0:1786015548.115343:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502f37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ee6 expref: 105 pid: 5794 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015548.115386:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 422 00000100:00100000:1.0:1786015548.115397:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+105:2353:x1872772280633216:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015548.115414:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015548.115421:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502f37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ee6 expref: 105 pid: 5794 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.115434:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502f37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ee6 expref: 105 pid: 5794 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.115458:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c502f37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ee6 expref: 105 pid: 5794 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.115475:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:1.0:1786015548.115480:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502f45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.115490:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502f45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.115498:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502f45 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.115523:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015548.115585:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+104:2353:x1872772280633216:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 190us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015548.115593:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 422 00010000:00010000:2.0:1786015548.115601:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502f45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.115612:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502f45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786015548.116237:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].42, 136 off13904 00000100:00100000:2.0:1786015548.116366:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+103:32131:x1872772280631936:12345-192.168.202.56@tcp:58:cat.0 Request processed in 5362016us (5364763us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015548.116377:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1399 00000100:00080000:3.0:1786015548.117057:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015548.120178:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015548.120400:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280633344 00000100:00100000:3.0:1786015548.120412:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280633344 00000100:00100000:3.0:1786015548.120476:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1401 00000100:00100000:3.0:1786015548.120486:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+103:32131:x1872772280633344:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:3.0:1786015548.120510:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015548.120534:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502f4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8eed expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.120593:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502f45 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.120606:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502f4c lrc: 4/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eed expref: 104 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.120630:0:5794:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502f45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.120642:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502f4c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eed expref: 104 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.120656:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:3.0:1786015548.120659:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015548.120663:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502f4c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eed expref: 104 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.120671:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc400, rc 0) 00000100:00100000:3.0:1786015548.120733:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+104:32131:x1872772280633344:12345-192.168.202.56@tcp:101:cat.0 Request processed in 248us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015548.120740:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1401 00000040:00080000:1.0:1786015548.140048:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015548.140058:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015548.140114:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 43 count 3 00000040:00080000:1.0:1786015548.140122:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015548.140269:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304457984:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015548.140369:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7485a7ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1786015548.145887:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304457984:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786015548.148699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015548.148943:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280633472 00000100:00100000:1.0:1786015548.148954:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280633472 00000100:00100000:1.0:1786015548.149047:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1402 00000100:00100000:1.0:1786015548.149058:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32133:x1872772280633472:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000100:00080000:3.0:1786015548.149120:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:1.0:1786015548.149331:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x2a:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786015548.149449:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32133:x1872772280633472:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 392us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015548.149458:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1402 00000100:00100000:2.0:1786015548.153186:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015548.153246:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280633600 00000100:00100000:1.0:1786015548.153256:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280633600 00000100:00100000:1.0:1786015548.153321:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1403 00000100:00100000:1.0:1786015548.153328:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32133:x1872772280633600:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1786015548.153407:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f53 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.153422:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f53 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.153431:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f53 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.153610:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f5a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.153616:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f5a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.153621:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f5a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.153640:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502f61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.153645:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.153649:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015548.153681:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00000004:00200000:1.0:1786015548.153685:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015548.153699:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.153717:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f53 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.153723:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f53 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.153730:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f53 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.154025:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015548.154029:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f53 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.154034:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f53 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.154044:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:1.0:1786015548.154046:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015548.154049:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f53 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.154053:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502f53 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.154063:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f5a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.154069:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f5a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.154074:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f5a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.154078:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015548.154081:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f5a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.154087:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f5a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.154098:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x98b61b69 (ffff8b748f194800) 00010000:00010000:1.0:1786015548.154100:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015548.154103:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f5a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.154109:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f5a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.154123:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.154127:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502f61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.154130:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502f61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.154133:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015548.154134:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502f61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.154138:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502f61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.154142:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:1.0:1786015548.154143:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015548.154145:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502f61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.154148:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502f61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015548.154275:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32133:x1872772280633600:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 945us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015548.154282:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1403 00000100:00100000:3.0:1786015548.163104:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015548.164022:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280633856 00000100:00100000:2.0:1786015548.164035:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280633856 00000100:00100000:2.0:1786015548.164120:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1404 00000100:00100000:2.0:1786015548.164135:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32133:x1872772280633856:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015548.164162:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015548.164190:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502f68 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ef4 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.164308:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.164324:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.164336:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015548.164349:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00010000:00010000:2.0:1786015548.164484:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.164492:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.164499:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.164505:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015548.164509:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.164516:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.164528:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:2.0:1786015548.164531:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015548.164536:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.164542:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.164584:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502f68 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ef4 expref: 51 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.164595:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:2.0:1786015548.164597:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786015548.164601:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502f68 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ef4 expref: 51 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.164610:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488060200, rc 0) 00000100:00100000:2.0:1786015548.164680:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+50:32133:x1872772280633856:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 548us (1585us total) trans 4294968238 rc 301/301 00000100:00100000:2.0:1786015548.164687:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1404 00000100:00100000:0.0:1786015548.171743:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015548.172172:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280633984 00000100:00100000:1.0:1786015548.172183:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280633984 00000100:00100000:1.0:1786015548.172313:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1405 00000100:00100000:1.0:1786015548.172325:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:32133:x1872772280633984:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786015548.172365:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x2a:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786015548.172474:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+50:32133:x1872772280633984:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 151us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015548.172482:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1405 00000100:00100000:3.0:1786015548.176806:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015548.179397:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280634240 00000100:00100000:1.0:1786015548.179413:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280634240 00000100:00100000:1.0:1786015548.179488:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1406 00000100:00100000:1.0:1786015548.179499:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+50:32133:x1872772280634240:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015548.179520:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015548.179542:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502f7d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8efb expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.184499:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.184529:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.184543:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015548.184560:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2b:0x0]: returning size 0 00010000:00010000:0.0:1786015548.185262:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502f7d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8efb expref: 53 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.185289:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8efb expref: 52 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.185297:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8b748f194800) 00010000:00010000:0.0:1786015548.185300:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015548.185304:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921000, rc 0) 00000100:00100000:0.0:1786015548.185444:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+52:32133:x1872772280634240:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 5945us (8683us total) trans 4294968239 rc 0/0 00000100:00100000:0.0:1786015548.185453:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1406 00000100:00100000:0.0:1786015548.190016:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015548.190110:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280634496 00000100:00100000:2.0:1786015548.190122:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280634496 00000100:00100000:2.0:1786015548.190195:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1407 00000100:00100000:2.0:1786015548.190206:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+52:32133:x1872772280634496:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786015548.190272:0:7673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015548.190302:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502f84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8efb expref: 52 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.190323:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8b748f194800) 00010000:00010000:2.0:1786015548.190335:0:7673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015548.190361:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502f92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.190376:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502e81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eae expref: 103 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.190386:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502f92 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.190418:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502e81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eae expref: 103 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.190431:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502e81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eae expref: 103 pid: 12526 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015548.190445:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304458112:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015548.190532:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74aa53bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015548.195708:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015548.195898:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304458112:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015548.195932:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502f92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015548.196011:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280634624 00000100:00100000:1.0:1786015548.196020:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280634624 00010000:00010000:1.0:1786015548.196061:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502e81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eae expref: 104 pid: 12526 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015548.196108:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 423 00000100:00100000:1.0:1786015548.196118:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+104:2353:x1872772280634624:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015548.196135:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015548.196143:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502e81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eae expref: 104 pid: 12526 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.196167:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502e81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eae expref: 104 pid: 12526 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.196191:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c502e81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eae expref: 104 pid: 12526 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.196207:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:1.0:1786015548.196212:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502f92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.196222:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502f92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.196230:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502f92 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.196265:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015548.196322:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+103:2353:x1872772280634624:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 204us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015548.196330:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 423 00010000:00010000:2.0:1786015548.196384:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502f92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.196392:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502f92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.196417:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x84325eaa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.196427:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x84325eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.196434:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x84325eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.196712:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502f92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.196721:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502f92 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.196727:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502f92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.196732:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488060200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015548.196737:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502f92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.196744:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502f92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.196753:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:2.0:1786015548.196755:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015548.196804:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502f92 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.196811:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c502f92 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.196820:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x84325eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.196826:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x84325eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.196831:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x84325eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.196836:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015548.196838:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x84325eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.196844:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f99 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x84325eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.196851:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x84325eaa (ffff8b7487f06100) 00010000:00010000:2.0:1786015548.196854:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015548.196857:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f99 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x84325eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.196862:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502f99 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x84325eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015548.196922:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+51:32133:x1872772280634496:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 6716us (6917us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786015548.196931:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1407 00000100:00100000:0.0:1786015548.200432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015548.200510:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280634752 00000100:00100000:1.0:1786015548.200521:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280634752 00000100:00100000:1.0:1786015548.200580:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1408 00000100:00100000:1.0:1786015548.200591:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+51:32133:x1872772280634752:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015548.200613:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015548.200639:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502fa0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f02 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.200694:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502fa7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.200708:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.200718:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.201052:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502fa0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f02 expref: 53 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.201070:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f02 expref: 52 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.201078:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8b748f194b00) 00010000:00010000:1.0:1786015548.201081:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015548.201085:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921000, rc 0) 00000100:00100000:1.0:1786015548.201189:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+52:32133:x1872772280634752:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 599us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015548.201197:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1408 00000100:00100000:0.0:1786015548.209811:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015548.210614:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280635008 00000100:00100000:1.0:1786015548.210627:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280635008 00000100:00100000:1.0:1786015548.210700:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1409 00000100:00100000:1.0:1786015548.210710:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+52:32133:x1872772280635008:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786015548.210814:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502fae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.210832:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502fae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.210845:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502fae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786015548.211387:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cf18eb18 reply state 000000002aa2f939 transno 4294968240 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502fae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015548.211399:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786015548.211515:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32133:x1872772280635008:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 805us (1753us total) trans 4294968240 rc 0/0 00000100:00100000:1.0:1786015548.211524:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1409 00000100:00100000:3.0:1786015548.216582:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015548.216656:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280635136 00000100:00100000:2.0:1786015548.216666:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280635136 00000100:00100000:2.0:1786015548.216732:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1410 00000100:00100000:2.0:1786015548.216743:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32133:x1872772280635136:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015548.216812:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015548.216834:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502fb5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f09 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.216896:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f09 expref: 55 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.216911:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f09 expref: 55 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.216921:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8b748f194b00) 00010000:00010000:2.0:1786015548.216924:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015548.216928:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488061c00, rc 0) 00000100:00100000:2.0:1786015548.216989:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+55:32133:x1872772280635136:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 248us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015548.216996:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1410 00010000:00010000:0.0:1786015548.217925:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502fae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.217938:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502fae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.217945:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502fae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.217950:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015548.217955:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502fae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.217962:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502fae lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.217992:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8b748f194b00) 00010000:00010000:0.0:1786015548.217995:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786015548.217999:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502fae lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.218005:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c502fae lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015548.220570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015548.220637:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280635264 00000100:00100000:1.0:1786015548.220647:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280635264 00000100:00100000:1.0:1786015548.220711:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 284 00000100:00100000:1.0:1786015548.220721:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32133:x1872772280635264:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1786015548.220918:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32133:x1872772280635264:12345-192.168.202.56@tcp:49:lhsmtool_posix.0 Request processed in 198us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015548.220926:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 284 00000100:00100000:3.0:1786015548.223815:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015548.223900:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280635520 00000100:00100000:1.0:1786015548.223910:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280635520 00000100:00100000:1.0:1786015548.223967:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 285 00000100:00100000:1.0:1786015548.223986:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32133:x1872772280635520:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015548.224217:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+55:32133:x1872772280635520:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 241us (408us total) trans 4294968241 rc 0/0 00000100:00100000:1.0:1786015548.224224:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 285 00000100:00100000:3.0:1786015548.227368:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015548.227455:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280635776 00000100:00100000:1.0:1786015548.227466:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280635776 00000100:00100000:1.0:1786015548.227527:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1411 00000100:00100000:1.0:1786015548.227537:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+55:32133:x1872772280635776:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786015548.227656:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+55:32133:x1872772280635776:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 119us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015548.227664:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1411 00000100:00100000:0.0:1786015548.231074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015548.231185:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280636032 00000100:00100000:3.0:1786015548.231197:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280636032 00000100:00100000:3.0:1786015548.231259:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1412 00000100:00100000:3.0:1786015548.231268:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+55:32133:x1872772280636032:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015548.231292:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015548.231315:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502fbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f10 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.231420:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502fc3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.231437:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502fb5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f09 expref: 56 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.231445:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502fc3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.231478:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f09 expref: 56 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.231493:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502fb5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f09 expref: 56 pid: 7673 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015548.231505:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304458240:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015548.231691:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748f268e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786015548.235646:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304458240:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015548.235676:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502fc3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015548.237921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015548.238023:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280636160 00000100:00100000:1.0:1786015548.238034:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280636160 00010000:00010000:1.0:1786015548.238084:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502fb5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f09 expref: 57 pid: 7673 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015548.238130:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 424 00000100:00100000:1.0:1786015548.238140:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+57:2353:x1872772280636160:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015548.238165:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015548.238174:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502fb5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f09 expref: 57 pid: 7673 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.238187:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f09 expref: 57 pid: 7673 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.238209:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c502fb5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f09 expref: 57 pid: 7673 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.238225:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8b748f194b00) 00010000:00010000:1.0:1786015548.238231:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502fc3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.238242:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502fc3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.238250:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502fc3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.238286:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015548.238345:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+56:2353:x1872772280636160:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 206us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015548.238353:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 424 00010000:00010000:3.0:1786015548.238527:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502fc3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.238536:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502fc3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015548.238556:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2b:0x0]: returning size 0 00000004:00080000:3.0:1786015548.242530:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e:0x0], index 1: 0 00010000:00010000:3.0:1786015548.242755:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502fc3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.242800:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502fc3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.242806:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502fc3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.242813:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015548.242818:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502fc3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.242826:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502fc3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.242844:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8b748f194b00) 00010000:00010000:3.0:1786015548.242847:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015548.242851:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502fc3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.242857:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c502fc3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.242926:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502fbc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f10 expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.242939:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8b74b0022b00) 00010000:00010000:3.0:1786015548.242942:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786015548.242946:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c502fbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f10 expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.242960:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd600, rc 0) 00000100:00100000:3.0:1786015548.243045:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+55:32133:x1872772280636032:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 11777us (11983us total) trans 4294968242 rc 301/301 00000100:00100000:3.0:1786015548.243054:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1412 00000100:00100000:0.0:1786015548.247886:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015548.248084:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280636416 00000100:00100000:1.0:1786015548.248096:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280636416 00000100:00100000:1.0:1786015548.248177:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 286 00000100:00100000:1.0:1786015548.248189:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+55:32133:x1872772280636416:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015548.248541:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+56:32133:x1872772280636416:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 353us (666us total) trans 4294968243 rc 0/0 00000100:00100000:1.0:1786015548.248552:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 286 00000100:00100000:0.0:1786015548.252033:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015548.252135:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280636544 00000100:00100000:1.0:1786015548.252146:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280636544 00000100:00100000:1.0:1786015548.252216:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1413 00000100:00100000:1.0:1786015548.252226:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+56:32133:x1872772280636544:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015548.252251:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015548.252273:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502fd1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f17 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.252345:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502fd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.252360:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.252372:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015548.252405:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2b:0x0]: returning size 0 00000004:00200000:1.0:1786015548.252409:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015548.252428:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.252452:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c502fd1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f17 expref: 58 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.252470:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f17 expref: 57 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.252484:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8b748f194b00) 00010000:00010000:1.0:1786015548.252488:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786015548.252491:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921400, rc 0) 00000100:00100000:1.0:1786015548.252560:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+57:32133:x1872772280636544:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 334us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015548.252567:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1413 00000100:00100000:0.0:1786015548.260126:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015548.260351:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280636672 00000100:00100000:3.0:1786015548.260361:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280636672 00000100:00100000:3.0:1786015548.260439:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 397 00000100:00100000:3.0:1786015548.260451:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280636672:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015548.260470:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015548.260493:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502fdf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f1e expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015548.260522:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786015548.260543:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=783s v=(0 0) 00010000:00010000:3.0:1786015548.260548:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015548.260557:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502fdf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f1e expref: 11 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.260574:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502fdf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f1e expref: 11 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.260586:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc200, rc 0) 00000100:00100000:3.0:1786015548.260692:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280636672:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 243us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015548.260703:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 397 00000100:00080000:1.0:1786015548.260787:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786015548.267948:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015548.269050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015548.269400:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280636928 00000100:00100000:0.0:1786015548.269411:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280636928 00000100:00100000:0.0:1786015548.269527:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1414 00000100:00100000:0.0:1786015548.269539:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+57:32133:x1872772280636928:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015548.269666:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+57:32133:x1872772280636928:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 128us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015548.269673:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1414 00000100:00100000:2.0:1786015548.274437:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015548.274726:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280637056 00000100:00100000:1.0:1786015548.274736:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280637056 00000100:00100000:1.0:1786015548.274843:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 398 00000100:00100000:1.0:1786015548.274854:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:32133:x1872772280637056:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015548.274878:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015548.274901:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a0dd624/0xb1a5ef690c502fe6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f25 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.274937:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502fdf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f1e expref: 12 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.274947:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015548.274952:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015548.274957:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a0dd624/0xb1a5ef690c502fe6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f25 expref: 12 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.275016:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502fdf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f1e expref: 12 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.275035:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502fdf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f1e expref: 12 pid: 6592 timeout: 883 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015548.275050:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304458368:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015548.275712:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015548.282804:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015548.282957:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280637184 00000100:00100000:2.0:1786015548.282967:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280637184 00010000:00010000:2.0:1786015548.283043:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502fdf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f1e expref: 13 pid: 6592 timeout: 883 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015548.283089:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 425 00000100:00100000:2.0:1786015548.283101:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280637184:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015548.283124:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015548.283161:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502fdf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f1e expref: 13 pid: 6592 timeout: 883 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.283176:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502fdf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f1e expref: 13 pid: 6592 timeout: 883 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.283205:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015548.283210:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015548.283220:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a0dd624/0xb1a5ef690c502fe6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f25 expref: 13 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.283229:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a0dd624/0xb1a5ef690c502fe6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f25 expref: 13 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.283286:0:6607:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009a0dd624/0xb1a5ef690c502fe6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f25 expref: 13 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015548.283301:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6607:1872772304458496:192.168.202.56@tcp:105: 00000100:00100000:2.0:1786015548.283394:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74aa53bcc0 going to sleep for 11 seconds 00010000:00010000:1.0:1786015548.283544:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c502fdf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f1e expref: 13 pid: 6592 timeout: 883 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015548.283562:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304458368:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015548.283587:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a0dd624/0xb1a5ef690c502fe6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f25 expref: 12 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.283597:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921c00, rc 0) 00000100:00100000:1.0:1786015548.283632:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:32133:x1872772280637056:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 8780us (9205us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015548.283640:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 398 00000100:00100000:2.0:1786015548.289728:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6607:1872772304458496:192.168.202.56@tcp:105: 00010000:00010000:2.0:1786015548.289792:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015548.289857:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280637184:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 6758us (7102us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015548.289868:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 425 00000100:00100000:3.0:1786015548.294268:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015548.294377:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280637312 00000100:00100000:0.0:1786015548.294388:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280637312 00002000:00100000:0.0:1786015548.294439:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1e:0x0] (0->157) req@ffff8b7381cc0380 x1872772280637312/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:394/0 lens 648/0 e 0 to 0 dl 1786015559 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015548.294449:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381cc0380 with x1872772280637312 ext(0->157) 00002000:00010000:0.0:1786015548.294455:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7381cc0380 00000100:00100000:0.0:1786015548.294492:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 121 00000100:00100000:0.0:1786015548.294502:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280637312:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1786015548.295287:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2351:x1872772280637312:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 782us (1023us total) trans 4294967383 rc 0/0 00000100:00100000:0.0:1786015548.295297:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 121 00002000:00100000:0.0:1786015548.295305:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1e:0x0] (0->157) req@ffff8b7381cc0380 x1872772280637312/t4294967383(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:394/0 lens 648/448 e 0 to 0 dl 1786015559 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015548.295314:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381cc0380 with x1872772280637312 ext(0->157) 00002000:00010000:0.0:1786015548.295319:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7381cc0380 00000100:00100000:3.0:1786015548.299520:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015548.299632:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280637440 00000100:00100000:2.0:1786015548.299642:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280637440 00000100:00100000:2.0:1786015548.299862:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1415 00000100:00100000:2.0:1786015548.299875:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+57:32133:x1872772280637440:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1786015548.338987:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+57:32133:x1872772280637440:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 39097us (39460us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015548.339002:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1415 00000001:00080000:0.0:1786015548.339376:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968243 is committed 00000100:00100000:3.0:1786015548.342058:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015548.342120:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280637568 00000100:00100000:2.0:1786015548.342130:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280637568 00000100:00100000:2.0:1786015548.342242:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 399 00000100:00100000:2.0:1786015548.342254:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280637568:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1786015548.378560:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280637568:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 36297us (36498us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015548.378575:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 399 00000001:00080000:0.0:1786015548.379841:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967383 is committed 00000100:00100000:3.0:1786015548.383590:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015548.384016:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280637824 00000100:00100000:0.0:1786015548.384027:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280637824 00000100:00100000:0.0:1786015548.384256:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1416 00000100:00100000:0.0:1786015548.384268:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+51:32133:x1872772280637824:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786015548.384324:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015548.384352:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c502fd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f17 expref: 51 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.384371:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8b748f194b00) 00010000:00010000:0.0:1786015548.384376:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015548.384405:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502fed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.384418:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502fed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.384431:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502fed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015548.384628:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085b99d11 reply state 00000000578f28e2 transno 4294968244 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502fed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015548.384637:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015548.384757:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+52:32133:x1872772280637824:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 491us (1177us total) trans 4294968244 rc 0/0 00000100:00100000:0.0:1786015548.384792:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1416 00010000:00010000:3.0:1786015548.389109:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502fed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.389127:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502fed lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.389134:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502fed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.389140:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015548.389145:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502fed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.389163:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502fed lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.389183:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8b748f194b00) 00010000:00010000:3.0:1786015548.389187:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015548.389192:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502fed lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.389198:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c502fed lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015548.392003:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015548.392264:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280637952 00000100:00100000:0.0:1786015548.392275:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280637952 00000100:00100000:0.0:1786015548.392366:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1417 00000100:00100000:0.0:1786015548.392378:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+51:32133:x1872772280637952:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015548.392408:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015548.392433:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502ff4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f2c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.392499:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502ff4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f2c expref: 52 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.392514:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502ff4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f2c expref: 52 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.392533:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8b748f194b00) 00010000:00010000:0.0:1786015548.392536:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015548.392540:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6a00, rc 0) 00000100:00100000:0.0:1786015548.392608:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+52:32133:x1872772280637952:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 232us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015548.392616:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1417 00000100:00100000:3.0:1786015548.398562:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015548.398633:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280638080 00000100:00100000:0.0:1786015548.398644:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280638080 00000100:00100000:0.0:1786015548.398702:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 400 00000100:00100000:0.0:1786015548.398722:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280638080:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1786015548.399026:0:14547:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1786015548.399030:0:14547:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb mtime from disk: 0 -> 1786015540 00002000:00010000:0.0:1786015548.399033:0:14547:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb atime from disk: 0 -> 1786015540 00002000:00010000:0.0:1786015548.399035:0:14547:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb ctime from disk: 0 -> 1786015540 00002000:00010000:0.0:1786015548.399037:0:14547:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1786015548.399113:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2351:x1872772280638080:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 393us (560us total) trans 4294967384 rc 0/0 00000100:00100000:0.0:1786015548.399121:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 400 00000100:00100000:1.0:1786015548.402828:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015548.403325:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280638336 00000100:00100000:2.0:1786015548.403335:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280638336 00000100:00100000:2.0:1786015548.403397:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1418 00000100:00100000:2.0:1786015548.403406:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+52:32133:x1872772280638336:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1786015548.403472:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061800/0xb1a5ef690c502ffb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.403489:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502fa7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f02 expref: 52 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.403499:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061800/0xb1a5ef690c502ffb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.403534:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f02 expref: 52 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.403554:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502fa7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f02 expref: 52 pid: 5795 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015548.403569:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304458624:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015548.403655:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74aa53b240 going to sleep for 11 seconds 00000100:00100000:1.0:1786015548.408051:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015548.408291:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304458624:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015548.408324:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061800/0xb1a5ef690c502ffb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015548.408426:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280638464 00000100:00100000:3.0:1786015548.408433:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280638464 00010000:00010000:3.0:1786015548.408469:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502fa7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f02 expref: 53 pid: 5795 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015548.408503:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 426 00000100:00100000:3.0:1786015548.408512:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280638464:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015548.408528:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015548.408534:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502fa7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f02 expref: 53 pid: 5795 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.408547:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f02 expref: 53 pid: 5795 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.408569:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c502fa7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f02 expref: 53 pid: 5795 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.408585:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8b748f194b00) 00010000:00010000:3.0:1786015548.408590:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061800/0xb1a5ef690c502ffb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.408600:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061800/0xb1a5ef690c502ffb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.408609:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061800/0xb1a5ef690c502ffb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.408635:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015548.408682:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+52:2353:x1872772280638464:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 171us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015548.408689:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 426 00010000:00010000:2.0:1786015548.408742:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061800/0xb1a5ef690c502ffb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.408749:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061800/0xb1a5ef690c502ffb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.408805:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061800/0xb1a5ef690c502ffb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.408813:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061800/0xb1a5ef690c502ffb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.408819:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061800/0xb1a5ef690c502ffb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.408825:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015548.408829:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061800/0xb1a5ef690c502ffb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.408841:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061800/0xb1a5ef690c502ffb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.408850:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8b748f194b00) 00010000:00010000:2.0:1786015548.408853:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1786015548.408856:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061800/0xb1a5ef690c502ffb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.408862:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061800/0xb1a5ef690c502ffb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015548.408908:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:32133:x1872772280638336:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 5503us (6090us total) trans 0 rc -22/-22 00000100:00100000:2.0:1786015548.408916:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1418 00000100:00100000:1.0:1786015548.413929:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015548.414371:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280638592 00000100:00100000:3.0:1786015548.414382:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280638592 00000100:00100000:3.0:1786015548.414434:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 401 00000100:00100000:3.0:1786015548.414444:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280638592:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015548.414492:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c503002 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.414512:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a0dd624/0xb1a5ef690c502fe6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f25 expref: 12 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.414521:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015548.414525:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015548.414530:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c503002 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.414565:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a0dd624/0xb1a5ef690c502fe6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f25 expref: 12 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.414579:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a0dd624/0xb1a5ef690c502fe6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f25 expref: 12 pid: 6590 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015548.414595:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304458752:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015548.414674:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748f268a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015548.420854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015548.421023:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280638720 00000100:00100000:2.0:1786015548.421032:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280638720 00010000:00010000:2.0:1786015548.421081:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a0dd624/0xb1a5ef690c502fe6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f25 expref: 13 pid: 6590 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015548.421121:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 427 00000100:00100000:2.0:1786015548.421130:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280638720:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015548.421148:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015548.421182:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a0dd624/0xb1a5ef690c502fe6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f25 expref: 13 pid: 6590 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.421197:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a0dd624/0xb1a5ef690c502fe6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f25 expref: 13 pid: 6590 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.421229:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786015548.421234:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786015548.421240:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c503002 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.421250:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c503002 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.421271:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015548.421327:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280638720:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 197us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015548.421334:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 427 00010000:00010000:3.0:1786015548.423461:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a0dd624/0xb1a5ef690c502fe6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f25 expref: 12 pid: 6590 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015548.423485:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304458752:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015548.423510:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c503002 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.423523:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c503002 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.423529:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c503002 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.423566:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c503002 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.423574:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c503002 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.423581:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c503002 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.423592:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015548.423596:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c503002 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.423604:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c503002 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.423622:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c503002 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015548.423629:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f4ff15f/0xb1a5ef690c503002 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015548.424337:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280638592:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 9890us (10414us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015548.424348:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 401 00000100:00100000:2.0:1786015548.428601:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015548.428705:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280638976 00000100:00100000:0.0:1786015548.428977:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280638976 00000100:00100000:0.0:1786015548.429080:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1419 00000100:00100000:0.0:1786015548.429091:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+51:32133:x1872772280638976:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786015548.429185:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503009 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.429204:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503009 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.429216:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503009 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.429438:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503010 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.429449:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502ff4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f2c expref: 52 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.429457:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503010 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.429494:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502ff4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f2c expref: 52 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.429508:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502ff4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f2c expref: 52 pid: 5796 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015548.429522:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304458880:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015548.429664:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359900 going to sleep for 11 seconds 00000100:00100000:2.0:1786015548.436465:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015548.436601:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280639104 00000100:00100000:1.0:1786015548.436611:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280639104 00010000:00010000:1.0:1786015548.436654:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502ff4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f2c expref: 53 pid: 5796 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015548.436725:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 428 00000100:00100000:1.0:1786015548.436736:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabf7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280639104:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015548.436753:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015548.436776:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502ff4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f2c expref: 53 pid: 5796 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.436792:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502ff4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f2c expref: 53 pid: 5796 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.436815:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8b748f194b00) 00010000:00010000:1.0:1786015548.436820:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503010 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.436830:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503010 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.436837:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503010 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.436854:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015548.437291:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabf7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280639104:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 555us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015548.437299:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 428 00010000:00010000:0.0:1786015548.439305:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c502ff4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f2c expref: 52 pid: 5796 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015548.439334:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304458880:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015548.439362:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503010 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.439372:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503010 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.439377:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503010 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786015548.439591:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968245 00000001:00080000:0.0:1786015548.440023:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968246 00000001:00080000:0.0:1786015548.440084:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968247 00000100:00100000:0.0:1786015548.440184:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304459008:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786015548.440294:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015548.440332:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7482d78780 going to sleep for 11 seconds 00000100:00100000:1.0:1786015548.440535:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304459008 00000100:00100000:1.0:1786015548.440543:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304459008 00000100:00100000:1.0:1786015548.440604:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1786015548.440614:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5795:x1872772304459008:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786015548.440718:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5795:x1872772304459008:12345-0@lo:1000:mdt00_001.0 Request processed in 97us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015548.440727:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1786015548.441033:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304459008:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1786015548.441585:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968248 00000100:00100000:0.0:1786015548.441655:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304459136:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786015548.441695:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015548.441857:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359900 going to sleep for 11 seconds 00000100:00100000:1.0:1786015548.442124:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304459136 00000100:00100000:1.0:1786015548.442131:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304459136 00000100:00100000:1.0:1786015548.442285:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1786015548.442295:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5795:x1872772304459136:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786015548.442483:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5795:x1872772304459136:12345-0@lo:1000:mdt00_001.0 Request processed in 190us (787us total) trans 4294967385 rc 0/0 00000100:00100000:1.0:1786015548.442490:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1786015548.442553:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1872772304459136:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1786015548.442632:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968249 00010000:00010000:0.0:1786015548.442661:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503010 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.442671:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503010 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.442679:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503010 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.442685:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015548.442689:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503010 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.442696:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503010 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.442728:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8b748f194b00) 00010000:00010000:0.0:1786015548.442732:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015548.442736:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503010 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.442742:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503010 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.442806:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502f45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.442812:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502f45 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.442818:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502f45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.442822:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015548.442825:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502f45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.442832:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502f45 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.442840:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:0.0:1786015548.442842:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015548.442850:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502f4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eed expref: 102 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.442861:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502f4c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eed expref: 102 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.442869:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502f4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eed expref: 102 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.442908:0:5795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502f4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eed expref: 102 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015548.442921:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304459264:192.168.202.56@tcp:105: 00000100:00100000:0.0:1786015548.443001:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359900 going to sleep for 11 seconds 00000100:00100000:0.0:1786015548.447967:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304459264:192.168.202.56@tcp:105: 00010000:00010000:0.0:1786015548.448017:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502f45 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.448030:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c502f45 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.448077:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503017 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.448093:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503017 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.448105:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503017 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.448117:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503017 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.448122:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503017 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.448129:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503017 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.448135:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015548.448138:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503017 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.448145:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503017 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.448166:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:0.0:1786015548.448169:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015548.448173:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503017 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.448178:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503017 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.448187:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503009 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.448193:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503009 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.448199:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503009 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.448203:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015548.448205:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503009 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.448214:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503009 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.448221:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:0.0:1786015548.448224:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015548.448227:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503009 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.448233:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503009 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015548.448467:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+56:32133:x1872772280638976:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 19375us (19873us total) trans 4294968250 rc 0/0 00000100:00100000:0.0:1786015548.448478:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1419 00000020:00080000:0.0:1786015548.448486:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:1.0:1786015548.448831:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015548.448836:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015548.449525:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1786015548.449537:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015548.453103:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015548.453353:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280639232 00000100:00100000:1.0:1786015548.453364:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280639232 00000100:00100000:1.0:1786015548.453438:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 287 00000100:00100000:1.0:1786015548.453449:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916af050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+103:32131:x1872772280639232:12345-192.168.202.56@tcp:49:cat.0 00000100:00100000:1.0:1786015548.453597:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916af050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+103:32131:x1872772280639232:12345-192.168.202.56@tcp:49:cat.0 Request processed in 149us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015548.453605:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 287 00000100:00100000:2.0:1786015548.457507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015548.457738:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280639488 00000100:00100000:1.0:1786015548.457752:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280639488 00000100:00100000:1.0:1786015548.457864:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 288 00000100:00100000:1.0:1786015548.457876:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+56:32133:x1872772280639488:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1786015548.458676:0:5798:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x2b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1786015548.458821:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968251 00010000:00010000:1.0:1786015548.458878:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50301e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.458896:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50301e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.458909:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50301e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.458918:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50301e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.458925:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50301e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.458931:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50301e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.458954:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786015548.459071:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+58:32133:x1872772280639488:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1194us (1571us total) trans 4294968252 rc 0/0 00000100:00100000:1.0:1786015548.459080:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 288 00000020:00080000:1.0:1786015548.459086:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1786015548.459379:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786015548.459387:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50301e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.459395:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920c00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015548.459399:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50301e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.459408:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50301e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.459423:0:8308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8b748f194500) 00010000:00010000:0.0:1786015548.459426:0:8308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786015548.459431:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50301e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.459441:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50301e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015548.459456:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015548.459458:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015548.459459:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015548.465998:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015548.466068:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015548.466153:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280639872 00000100:00100000:1.0:1786015548.466175:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280639872 00000100:00100000:1.0:1786015548.466253:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:1.0:1786015548.466265:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+103:32130:x1872772280639872:12345-192.168.202.56@tcp:103:cat.0 00010000:00010000:1.0:1786015548.466285:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015548.466311:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c502f4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8eed expref: 103 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015548.466337:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:1.0:1786015548.466346:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015548.466413:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+102:32130:x1872772280639872:12345-192.168.202.56@tcp:103:cat.0 Request processed in 149us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015548.466421:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:2.0:1786015548.467143:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280639616 00000100:00100000:2.0:1786015548.467163:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280639616 00000100:00100000:2.0:1786015548.467224:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 402 00000100:00100000:2.0:1786015548.467233:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+15:32131:x1872772280639616:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1786015548.467248:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015548.467267:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035bb037c/0xb1a5ef690c503025 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f33 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015548.467297:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 158, mtime: 0x6a746f34, atime: 0x6a746f34, ctime: 0x6a746f34, blocks: 0xb 00010000:00010000:2.0:1786015548.467317:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=783s v=(0 0) 00010000:00010000:2.0:1786015548.467322:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015548.467331:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035bb037c/0xb1a5ef690c503025 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f33 expref: 16 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.467348:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000035bb037c/0xb1a5ef690c503025 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f33 expref: 16 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.467358:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488061800, rc 0) 00000100:00100000:2.0:1786015548.467397:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+16:32131:x1872772280639616:12345-192.168.202.56@tcp:101:cat.0 Request processed in 166us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015548.467403:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 402 00000100:00080000:1.0:1786015548.467993:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015548.476580:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015548.476698:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280640000 00000100:00100000:0.0:1786015548.476715:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280640000 00000100:00100000:0.0:1786015548.476815:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1420 00000100:00100000:0.0:1786015548.476827:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+102:32130:x1872772280640000:12345-192.168.202.56@tcp:58:cat.0 00000100:00100000:0.0:1786015548.476987:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+102:32130:x1872772280640000:12345-192.168.202.56@tcp:58:cat.0 Request processed in 162us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015548.476996:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1420 00000100:00100000:3.0:1786015548.484576:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015548.485225:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280640128 00000100:00100000:2.0:1786015548.485238:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280640128 00000100:00100000:2.0:1786015548.485371:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1421 00000100:00100000:2.0:1786015548.485384:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+102:32130:x1872772280640128:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1786015548.485406:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015548.485434:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c50302c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f3a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.485501:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c50302c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f3a expref: 103 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.485517:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061000/0xb1a5ef690c50302c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f3a expref: 103 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015548.485538:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8b7487f06600) 00010000:00010000:2.0:1786015548.485541:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015548.485545:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488061000, rc 0) 00000100:00100000:2.0:1786015548.485614:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+103:32130:x1872772280640128:12345-192.168.202.56@tcp:101:cat.0 Request processed in 233us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015548.485621:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1421 00000100:00100000:1.0:1786015548.491014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015548.491113:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280640256 00000100:00100000:0.0:1786015548.491126:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280640256 00002000:00100000:0.0:1786015548.491182:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1e:0x0] (0->4095) req@ffff8b748825b800 x1872772280640256/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:394/0 lens 488/0 e 0 to 0 dl 1786015559 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015548.491194:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b748825b800 with x1872772280640256 ext(0->4095) 00002000:00010000:0.0:1786015548.491200:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b748825b800 00000100:00100000:0.0:1786015548.491268:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 122 00000100:00100000:0.0:1786015548.491279:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280640256:12345-192.168.202.56@tcp:3:cat.0 00000100:00100000:0.0:1786015548.491517:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280640256:12345-192.168.202.56@tcp:3:cat.0 Request processed in 239us (513us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786015548.491525:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 122 00002000:00100000:0.0:1786015548.491532:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1e:0x0] (0->4095) req@ffff8b748825b800 x1872772280640256/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:394/0 lens 488/4536 e 0 to 0 dl 1786015559 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015548.491541:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b748825b800 with x1872772280640256 ext(0->4095) 00002000:00010000:0.0:1786015548.491545:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b748825b800 00000100:00100000:3.0:1786015548.502048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015548.503027:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280640512 00000100:00100000:1.0:1786015548.503041:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280640512 00000100:00100000:1.0:1786015548.503865:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 289 00000100:00100000:1.0:1786015548.503900:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+103:32131:x1872772280640512:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:1.0:1786015548.504205:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+104:32131:x1872772280640512:12345-192.168.202.56@tcp:35:cat.0 Request processed in 328us (2165us total) trans 4294968253 rc 0/0 00000100:00100000:1.0:1786015548.504214:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 289 00010000:00010000:2.0:1786015549.293175:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015549.396405:0:21878:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015549.396417:0:21878:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015549.396459:0:21878:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 43 count 3 00000040:00080000:1.0:1786015549.396465:0:21878:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1786015549.484031:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015549.484040:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015549.484528:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1786015549.484537:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015550.021083:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015550.021139:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015550.021192:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015550.021228:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015550.021243:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015550.021270:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015550.021303:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015550.021336:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280640896 00000100:00100000:3.0:1786015550.021347:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280640896 00000100:00100000:0.0:1786015550.021376:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280641408 00000100:00100000:0.0:1786015550.021383:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280641408 00000100:00100000:3.0:1786015550.021412:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280641024 00000100:00100000:3.0:1786015550.021417:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280641024 00000100:00100000:0.0:1786015550.021417:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280641280 00000100:00100000:0.0:1786015550.021424:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280641280 00000100:00100000:3.0:1786015550.021448:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 546 00000100:00100000:3.0:1786015550.021461:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280640896:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015550.021504:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280641152 00000100:00100000:2.0:1786015550.021511:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280641152 00000100:00100000:2.0:1786015550.021544:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280640768 00000100:00100000:3.0:1786015550.021548:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280640896:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 88us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015550.021549:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280640768 00000100:00100000:2.0:1786015550.021596:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 545 00000100:00100000:2.0:1786015550.021607:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+58:2354:x1872772280641152:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015550.021608:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280640640 00000100:00100000:1.0:1786015550.021614:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280640640 00000100:00100000:1.0:1786015550.021645:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 634 00000100:00100000:1.0:1786015550.021653:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280640640:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015550.021674:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+58:2354:x1872772280641152:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 67us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015550.021682:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 545 00000100:00100000:1.0:1786015550.021687:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280640640:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015550.021694:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 634 00000100:00100000:2.0:1786015550.021706:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 546 00000100:00100000:2.0:1786015550.021718:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+104:2354:x1872772280640768:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015550.021754:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+104:2354:x1872772280640768:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015550.021792:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 546 00000100:00080000:2.0:1786015550.021823:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786015550.021828:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015550.021830:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015550.032678:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 547 00000100:00100000:0.0:1786015550.032708:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280641408:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015550.032832:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280641408:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 139us (11603us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015550.032841:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 547 00000100:00100000:0.0:1786015550.032862:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 548 00000100:00100000:0.0:1786015550.032869:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280641024:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015550.032899:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280641024:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (11629us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015550.032906:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 548 00000100:00100000:0.0:1786015550.032919:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 549 00000100:00100000:0.0:1786015550.032928:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280641280:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015550.032940:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 546 00000100:00100000:0.0:1786015550.032967:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280641280:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (11651us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015550.036186:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 549 00010000:00010000:1.0:1786015550.317596:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015550.636611:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304459392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015550.636689:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015550.636859:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304459392 00000100:00100000:1.0:1786015550.636867:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304459392 00000100:00100000:1.0:1786015550.636930:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1786015550.636939:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304459392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015550.636985:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015550.637029:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304459392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015550.637047:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00080000:3.0:1786015550.637151:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015550.637196:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304459392:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786015551.341019:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015552.172404:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304459904:0@lo:400:kworker.0 00000100:00100000:3.0:1786015552.172484:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015552.172684:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786015552.172692:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304459776:0@lo:400:kworker.0 00000100:00100000:3.0:1786015552.172722:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015552.172781:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304459904 00000100:00100000:3.0:1786015552.172788:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304459904 00000100:00100000:3.0:1786015552.172843:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:3.0:1786015552.172853:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304459904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015552.172909:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304459904:12345-0@lo:400:kworker.0 Request processed in 59us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015552.172916:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00080000:3.0:1786015552.172947:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015552.172982:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304459904:0@lo:400:kworker.0 00000100:00100000:2.0:1786015552.173143:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304459776 00000100:00100000:2.0:1786015552.173148:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304459776 00000100:00100000:2.0:1786015552.173192:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:2.0:1786015552.173200:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304459776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015552.173242:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304459776:12345-0@lo:400:kworker.0 Request processed in 45us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015552.173249:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1786015552.173330:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304459648:0@lo:400:kworker.0 00000100:00100000:1.0:1786015552.173388:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015552.173419:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304460160:0@lo:400:kworker.0 00000100:00100000:1.0:1786015552.173442:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015552.173461:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1786015552.173466:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304459520:0@lo:400:kworker.0 00000100:00100000:1.0:1786015552.173493:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015552.173518:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304460032:0@lo:400:kworker.0 00000100:00100000:1.0:1786015552.173540:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015552.173583:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304459520 00000100:00100000:1.0:1786015552.173587:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304459520 00000100:00100000:1.0:1786015552.173614:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:1.0:1786015552.173620:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304459520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015552.173684:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304459520:12345-0@lo:400:kworker.0 Request processed in 64us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015552.173690:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:1.0:1786015552.173747:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304459520:0@lo:400:kworker.0 00000100:00100000:0.0:1786015552.173919:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304460160 00000100:00100000:0.0:1786015552.173924:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304460160 00000100:00100000:0.0:1786015552.173978:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:0.0:1786015552.173985:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304460160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015552.174035:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304460160:12345-0@lo:400:kworker.0 Request processed in 40us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015552.174041:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1786015552.174173:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304459648 00000100:00100000:2.0:1786015552.174177:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304459648 00000100:00100000:2.0:1786015552.174214:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304460032 00000100:00100000:2.0:1786015552.174217:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304460032 00000100:00100000:2.0:1786015552.174240:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:2.0:1786015552.174245:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304459648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015552.174280:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304459648:12345-0@lo:400:kworker.0 Request processed in 34us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015552.174285:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:2.0:1786015552.174296:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:2.0:1786015552.174302:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304460032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015552.174328:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304460032:12345-0@lo:400:kworker.0 Request processed in 26us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015552.174333:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00080000:3.0:1786015552.174820:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015552.174826:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015552.174855:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304459776:0@lo:400:kworker.0 00000100:00100000:1.0:1786015552.175035:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304460032:0@lo:400:kworker.0 00000100:00100000:1.0:1786015552.175051:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304459648:0@lo:400:kworker.0 00000100:00100000:1.0:1786015552.175062:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304460160:0@lo:400:kworker.0 00010000:00010000:0.0:1786015552.364796:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015552.685385:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786015552.685408:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304460288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015552.685476:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015552.685757:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304460288 00000100:00100000:2.0:1786015552.685790:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304460288 00000100:00100000:2.0:1786015552.685855:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1786015552.685865:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304460288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015552.686074:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86704128 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015552.686142:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304460288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 278us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015552.686150:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1786015552.686297:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304460288:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786015553.392656:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786015553.826934:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968250 is committed 00000020:00080000:0.0:1786015553.826952:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b74811cae40 refcount 2 committed 0 result 0 batchid 34 00000020:00080000:0.0:1786015553.826957:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b7491d58000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b74811ca540 00000020:00080000:0.0:1786015553.826961:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b7491d58800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b7491bcfc00 00000001:00080000:0.0:1786015553.826987:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968253 is committed 00000001:00080000:0.0:1786015553.826991:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968252 is committed 00000020:00080000:3.0:1786015553.827269:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 34 committed batchid 33 00000020:00080000:3.0:1786015553.827432:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 33 00000001:00080000:0.0:1786015553.831266:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967384 is committed 00000001:00080000:0.0:1786015553.831286:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967385 is committed 00010000:00010000:1.0:1786015554.412223:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015555.147993:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015555.148026:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015555.148069:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015555.148109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015555.148133:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015555.148154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015555.148179:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015555.148364:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280642048 00000100:00100000:0.0:1786015555.148376:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280642048 00000100:00100000:0.0:1786015555.148436:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280641664 00000100:00100000:0.0:1786015555.148439:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280641664 00000100:00100000:0.0:1786015555.148467:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 550 00000100:00100000:0.0:1786015555.148477:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+49:2353:x1872772280642048:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015555.148558:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+49:2353:x1872772280642048:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 82us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015555.148566:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 550 00000100:00100000:0.0:1786015555.148585:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 551 00000100:00100000:0.0:1786015555.148591:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+103:2353:x1872772280641664:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015555.148613:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+103:2353:x1872772280641664:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015555.148619:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 551 00000100:00100000:0.0:1786015555.148637:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280641792 00000100:00100000:0.0:1786015555.148640:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280641792 00000100:00100000:0.0:1786015555.148665:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280642304 00000100:00100000:0.0:1786015555.148667:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280642304 00000100:00100000:0.0:1786015555.148695:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280641920 00000100:00100000:0.0:1786015555.148698:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280641920 00000100:00100000:0.0:1786015555.148712:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280642176 00000100:00100000:0.0:1786015555.148714:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280642176 00000100:00100000:0.0:1786015555.148729:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 552 00000100:00100000:0.0:1786015555.148735:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280641792:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015555.148817:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280641792:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015555.148825:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 552 00000100:00100000:0.0:1786015555.148839:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 553 00000100:00100000:0.0:1786015555.148846:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280642304:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015555.148874:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280642304:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015555.148879:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 553 00000100:00100000:0.0:1786015555.148890:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 554 00000100:00100000:0.0:1786015555.148896:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280641920:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015555.148928:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280641920:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015555.148935:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 554 00000100:00100000:0.0:1786015555.148946:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 555 00000100:00100000:0.0:1786015555.148952:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280642176:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015555.148975:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280642176:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015555.148981:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 555 00000100:00080000:0.0:1786015555.148997:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015555.149001:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015555.149004:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015555.149807:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280641536 00000100:00100000:1.0:1786015555.149820:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280641536 00000100:00100000:1.0:1786015555.149868:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 636 00000100:00100000:1.0:1786015555.149876:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280641536:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015555.149932:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280641536:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 56us (1949us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015555.149941:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 636 00010000:00010000:0.0:1786015555.438894:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015555.757308:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304460416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015555.757403:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015555.757491:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304460416 00000100:00100000:3.0:1786015555.757631:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304460416 00000100:00100000:3.0:1786015555.757702:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1786015555.757711:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304460416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015555.757751:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015555.757822:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304460416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015555.757829:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:3.0:1786015555.757850:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015555.757893:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304460416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015556.022831:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015556.023935:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280642432 00000100:00100000:0.0:1786015556.023951:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280642432 00000100:00100000:0.0:1786015556.024075:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1422 00000100:00100000:0.0:1786015556.024097:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32103:x1872772280642432:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1786015556.024228:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32103:x1872772280642432:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 134us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015556.024236:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1422 00010000:00010000:0.0:1786015556.460500:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015556.652085:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015556.652097:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015556.653086:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 43 count 2 00000040:00080000:1.0:1786015556.653098:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015557.292984:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304460672:0@lo:400:kworker.0 00000100:00100000:1.0:1786015557.293060:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015557.293119:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304461184:0@lo:400:kworker.0 00000100:00100000:1.0:1786015557.293146:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015557.293170:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1786015557.293176:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304460544:0@lo:400:kworker.0 00000100:00100000:1.0:1786015557.293203:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015557.293356:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304461184 00000100:00100000:0.0:1786015557.293364:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304461184 00000100:00100000:0.0:1786015557.293428:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:0.0:1786015557.293437:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304461184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015557.293487:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304461184:12345-0@lo:400:kworker.0 Request processed in 51us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015557.293495:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00080000:0.0:1786015557.293514:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015557.293710:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304460928:0@lo:400:kworker.0 00000100:00100000:3.0:1786015557.293741:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015557.294914:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304460928 00000100:00100000:0.0:1786015557.294926:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304460928 00000100:00100000:0.0:1786015557.294978:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1786015557.294987:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304460928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015557.295147:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304461056:0@lo:400:kworker.0 00000100:00100000:3.0:1786015557.295354:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786015557.295365:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304460800:0@lo:400:kworker.0 00000100:00100000:0.0:1786015557.295865:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304460928:12345-0@lo:400:kworker.0 Request processed in 878us (2121us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015557.295876:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00080000:0.0:1786015557.295913:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015557.299238:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304460544 00000100:00100000:2.0:1786015557.299257:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304460544 00000100:00100000:2.0:1786015557.299325:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:2.0:1786015557.299334:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304460544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015557.299429:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3315:x1872772304460544:12345-0@lo:400:kworker.0 Request processed in 96us (6224us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015557.299438:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:2.0:1786015557.299475:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304460672 00000100:00100000:2.0:1786015557.299479:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304460672 00000100:00100000:2.0:1786015557.299507:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1786015557.299514:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304460672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015557.299547:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872772304460672:12345-0@lo:400:kworker.0 Request processed in 33us (6487us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015557.299553:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1786015557.307256:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015557.307358:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872772304460672:0@lo:400:kworker.0 00000100:00100000:1.0:1786015557.307373:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967385 gen 2 00000004:00080000:1.0:1786015557.307379:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967385 committed transno 4294967385 00000100:00100000:1.0:1786015557.307416:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304461184:0@lo:400:kworker.0 00000100:00100000:1.0:1786015557.307443:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3315:1872772304460544:0@lo:400:kworker.0 00000100:00100000:0.0:1786015557.307585:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304461056 00000100:00100000:0.0:1786015557.307592:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304461056 00000100:00100000:0.0:1786015557.307667:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:0.0:1786015557.307677:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304461056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015557.307743:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872772304461056:12345-0@lo:400:kworker.0 Request processed in 67us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015557.307750:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00080000:1.0:1786015557.308259:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015557.308288:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1872772304461056:0@lo:400:kworker.0 00000100:00100000:3.0:1786015557.308462:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015557.308509:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304460928:0@lo:400:kworker.0 00000100:00100000:3.0:1786015557.308533:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304460800 00000100:00100000:3.0:1786015557.308537:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304460800 00000100:00100000:3.0:1786015557.308587:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:3.0:1786015557.308593:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304460800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015557.308637:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1872772304460800:12345-0@lo:400:kworker.0 Request processed in 43us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015557.308643:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00080000:3.0:1786015557.308659:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015557.308679:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1872772304460800:0@lo:400:kworker.0 00010000:00010000:0.0:1786015557.488816:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015557.804094:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738374ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304461312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015557.804182:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015557.804382:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304461312 00000100:00100000:0.0:1786015557.804391:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304461312 00000100:00100000:0.0:1786015557.804450:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1786015557.804461:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304461312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015557.804500:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86704128 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015557.813117:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304461312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8649us (8926us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015557.813132:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1786015557.824177:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738374ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304461312:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1786015558.176818:0:22077:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12t: Multiple parallel reads for a HSM imported file ========================================================== 07:25:56 (1786015556) 00010000:00010000:1.0:1786015558.508867:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015558.556333:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015558.556458:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280642560 00000100:00100000:2.0:1786015558.556469:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280642560 00000100:00100000:2.0:1786015558.556567:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1423 00000100:00100000:2.0:1786015558.556582:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32746:x1872772280642560:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1786015558.556713:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32746:x1872772280642560:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 135us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015558.556725:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1423 00000100:00080000:3.0:1786015558.557644:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015558.608841:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015558.608965:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280642688 00000100:00100000:0.0:1786015558.608976:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280642688 00000100:00100000:0.0:1786015558.609065:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1424 00000100:00100000:0.0:1786015558.609076:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+103:32747:x1872772280642688:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015558.609098:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1786015558.611032:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786015558.620573:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503033 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f41 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.620670:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c50303a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.620685:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c50303a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.620698:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c50303a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.620733:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503041 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.620741:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.620749:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.622636:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c50303a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.622653:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c50303a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.622661:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c50303a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.622667:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015558.622672:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c50303a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.622685:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c50303a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.622703:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ac00) 00010000:00010000:0.0:1786015558.622707:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015558.622712:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c50303a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.622719:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c50303a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.622734:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.622740:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503041 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.622747:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503041 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.622752:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015558.622755:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503041 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.623065:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503041 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.623075:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef4d5f1f (ffff8b748f24ab00) 00010000:00010000:0.0:1786015558.623078:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015558.623081:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503041 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.623092:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503041 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.623151:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503033 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f41 expref: 104 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.623163:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ac00) 00010000:00010000:0.0:1786015558.623175:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015558.623179:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503033 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f41 expref: 104 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.623189:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6200, rc 0) 00000100:00100000:0.0:1786015558.628036:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+103:32747:x1872772280642688:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 18947us (19188us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015558.628050:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1424 00000100:00100000:1.0:1786015558.633556:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015558.633679:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280642944 00000100:00100000:3.0:1786015558.633691:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280642944 00000100:00100000:3.0:1786015558.634211:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1425 00000100:00100000:3.0:1786015558.634223:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916a1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+103:32747:x1872772280642944:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:3.0:1786015558.634285:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015558.634313:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c502d70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e4c expref: 103 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.634333:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ac00) 00010000:00010000:3.0:1786015558.634339:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015558.634670:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503048 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.634687:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502daf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e61 expref: 48 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.634696:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503048 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.634732:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502daf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e61 expref: 48 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.635928:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502daf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e61 expref: 48 pid: 7673 timeout: 893 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015558.635946:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f19500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304461440:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015558.636077:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b89d2480 going to sleep for 11 seconds 00000100:00100000:2.0:1786015558.639985:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f19500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304461440:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015558.640028:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503048 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015558.647539:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015558.649575:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280643072 00000100:00100000:2.0:1786015558.649591:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280643072 00010000:00010000:2.0:1786015558.649660:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502daf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e61 expref: 49 pid: 7673 timeout: 893 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015558.649705:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 429 00000100:00100000:2.0:1786015558.649715:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+49:2354:x1872772280643072:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015558.649731:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015558.649738:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502daf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e61 expref: 49 pid: 7673 timeout: 893 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.649751:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502daf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e61 expref: 49 pid: 7673 timeout: 893 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.649798:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c502daf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8e61 expref: 49 pid: 7673 timeout: 893 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.649815:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ac00) 00010000:00010000:2.0:1786015558.649821:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503048 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.649832:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503048 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.649840:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503048 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.649882:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015558.649942:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+48:2354:x1872772280643072:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 228us (2414us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015558.649949:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 429 00010000:00010000:3.0:1786015558.650041:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503048 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.650050:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503048 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.650084:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50304f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.650095:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50304f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.650105:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50304f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015558.651233:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x51:0x0]: returning size 512 00010000:00010000:3.0:1786015558.651250:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503048 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.651260:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503048 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.651267:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503048 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.651274:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015558.651278:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503048 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.651286:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503048 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.651299:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b748f24ac00) 00010000:00010000:3.0:1786015558.651302:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015558.651307:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503048 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.651313:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503048 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015558.651332:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001d8ea1a7 reply state 00000000e2fe66e2 transno 4294968254 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50304f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015558.651342:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015558.651442:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916a1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+104:32747:x1872772280642944:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 17219us (17892us total) trans 4294968254 rc 0/0 00000100:00100000:3.0:1786015558.651453:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1425 00010000:00010000:0.0:1786015558.660690:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50304f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.660712:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50304f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.660720:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50304f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.660725:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015558.660731:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50304f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.660738:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50304f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.660756:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef4d5f1f (ffff8b74b0022600) 00010000:00010000:0.0:1786015558.660798:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015558.660803:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50304f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.660808:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50304f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015558.671520:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015558.671850:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280643200 00000100:00100000:2.0:1786015558.671861:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280643200 00000100:00100000:2.0:1786015558.671932:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1426 00000100:00100000:2.0:1786015558.671942:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+103:32748:x1872772280643200:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1786015558.671969:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015558.671997:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c503056 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f48 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.672077:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c50305d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.672091:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c50305d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.672102:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c50305d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015558.672160:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1786015558.672164:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 34 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015558.672186:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c50305d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.672212:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c503056 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f48 expref: 105 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.672229:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c50305d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f48 expref: 104 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.672238:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06300) 00010000:00010000:2.0:1786015558.672241:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015558.672244:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488060200, rc 0) 00000100:00100000:2.0:1786015558.672305:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+104:32748:x1872772280643200:12345-192.168.202.56@tcp:101:bash.0 Request processed in 364us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015558.672313:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1426 00000100:00100000:1.0:1786015558.679937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015558.680184:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280643328 00000100:00100000:0.0:1786015558.680195:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280643328 00000100:00100000:0.0:1786015558.680259:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1427 00000100:00100000:0.0:1786015558.680270:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+104:32748:x1872772280643328:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1786015558.680294:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015558.680318:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503064 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f4f expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680384:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50306b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680402:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50306b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680415:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50306b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680541:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503072 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680549:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503072 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680557:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503072 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680735:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c503079 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680744:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c503079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680751:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c503079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015558.680834:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x51:0x0]: returning size 512 00000004:00200000:0.0:1786015558.680838:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015558.680863:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c503079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680886:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50306b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680894:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50306b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680901:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50306b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680907:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015558.680912:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50306b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680920:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50306b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680936:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06300) 00010000:00010000:0.0:1786015558.680939:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015558.680944:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50306b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680951:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50306b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680963:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503072 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680970:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503072 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680975:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503072 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680980:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015558.680984:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503072 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680989:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503072 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.680996:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef4d5f1f (ffff8b748f24ab00) 00010000:00010000:0.0:1786015558.680999:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015558.681962:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503072 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.681973:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503072 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.682036:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503064 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f4f expref: 106 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.682051:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7e00/0xb1a5ef690c503079 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f4f expref: 105 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.682058:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015558.682061:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786015558.682063:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7e00, rc 0) 00000100:00100000:1.0:1786015558.682213:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+105:32748:x1872772280643328:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1941us (2283us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015558.682225:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1427 00000100:00100000:0.0:1786015558.685928:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015558.686143:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280643456 00000100:00100000:3.0:1786015558.686157:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280643456 00000100:00100000:3.0:1786015558.686219:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1428 00000100:00100000:3.0:1786015558.686230:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+105:32748:x1872772280643456:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1786015558.686253:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015558.686277:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503080 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f56 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.686353:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503087 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.686369:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503087 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.686381:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503087 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.686438:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50308e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.686447:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50308e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.686454:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50308e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.686544:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503087 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.686556:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503087 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.686563:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503087 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.686569:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015558.686574:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503087 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.686581:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503087 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.686593:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:3.0:1786015558.686597:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015558.686601:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503087 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.686608:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503087 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.686621:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50308e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.686627:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50308e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.686633:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50308e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.686638:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015558.686642:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50308e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.686648:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50308e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.686655:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b74b0022c00) 00010000:00010000:3.0:1786015558.686658:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015558.687775:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50308e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.687786:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50308e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.687840:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503080 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f56 expref: 106 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.687851:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:3.0:1786015558.687853:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015558.687857:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503080 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f56 expref: 106 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.687865:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbce00, rc 0) 00000100:00100000:3.0:1786015558.688020:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+105:32748:x1872772280643456:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1791us (2100us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015558.688029:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1428 00000040:00080000:1.0:1786015558.700035:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015558.700044:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015558.700082:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 43 count 2 00000040:00080000:1.0:1786015558.700088:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015558.719301:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015558.721948:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280643584 00000100:00100000:3.0:1786015558.722141:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280643584 00000100:00100000:3.0:1786015558.722255:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1429 00000100:00100000:3.0:1786015558.722266:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+48:32749:x1872772280643584:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015558.722289:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015558.722312:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503095 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f5d expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.722383:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50309c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.722396:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50309c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.722407:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50309c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015558.722466:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1786015558.722470:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 34 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015558.722495:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50309c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.722519:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503095 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f5d expref: 50 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.722537:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50309c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f5d expref: 49 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.722546:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06300) 00010000:00010000:3.0:1786015558.722549:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015558.722553:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc200, rc 0) 00000100:00100000:3.0:1786015558.722625:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32749:x1872772280643584:12345-192.168.202.56@tcp:101:rm.0 Request processed in 361us (3334us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015558.722633:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1429 00000100:00100000:1.0:1786015558.734713:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015558.734903:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280643712 00000100:00100000:2.0:1786015558.734915:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280643712 00000100:00100000:2.0:1786015558.734987:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1430 00000100:00100000:2.0:1786015558.734999:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+49:32749:x1872772280643712:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015558.735023:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015558.735048:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c5030a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f64 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735134:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c5030aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735149:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c5030aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735159:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c5030aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735175:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c5030b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735182:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c5030b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735188:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c5030b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735319:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c5030b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735329:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c5030b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735336:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c5030b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015558.735368:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x51:0x0]: returning size 512 00000004:00200000:2.0:1786015558.735372:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015558.735394:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c5030b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735405:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c5030aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735412:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c5030aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735418:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c5030aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735428:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015558.735432:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c5030aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735440:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c5030aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735452:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06300) 00010000:00010000:2.0:1786015558.735455:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015558.735460:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c5030aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735466:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c5030aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735480:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c5030b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735486:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c5030b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735492:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c5030b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735498:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015558.735500:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c5030b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735506:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c5030b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735518:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef4d5f1f (ffff8b7487f06000) 00010000:00010000:2.0:1786015558.735520:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015558.735523:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c5030b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735529:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c5030b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735560:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c5030a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f64 expref: 51 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735574:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061400/0xb1a5ef690c5030b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f64 expref: 50 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.735581:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:2.0:1786015558.735583:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786015558.735586:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488061400, rc 0) 00000100:00100000:2.0:1786015558.735656:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+50:32749:x1872772280643712:12345-192.168.202.56@tcp:101:rm.0 Request processed in 658us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015558.735675:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1430 00000100:00100000:0.0:1786015558.743339:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015558.743456:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280643840 00000100:00100000:3.0:1786015558.743467:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280643840 00000100:00100000:3.0:1786015558.743542:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1431 00000100:00100000:3.0:1786015558.743552:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+50:32749:x1872772280643840:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015558.743577:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015558.743602:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5030bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f6b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743689:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5030c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743707:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5030c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743720:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5030c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743735:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5030cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743742:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5030cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743748:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5030cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743842:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5030c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743849:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5030c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743859:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5030c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743866:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015558.743884:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5030c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743893:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5030c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743904:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:3.0:1786015558.743907:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015558.743912:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5030c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743918:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5030c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743930:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5030cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743936:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5030cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743941:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5030cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743947:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbdc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015558.743950:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5030cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743967:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5030cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743976:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b74b0022c00) 00010000:00010000:3.0:1786015558.743979:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015558.743982:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5030cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.743987:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c5030cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.744021:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5030bf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f6b expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.744031:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:3.0:1786015558.744033:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015558.744037:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5030bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f6b expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.744047:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbce00, rc 0) 00000100:00100000:3.0:1786015558.745027:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+50:32749:x1872772280643840:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1469us (1690us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015558.745037:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1431 00000100:00100000:1.0:1786015558.750210:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015558.750292:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280643968 00000100:00100000:3.0:1786015558.750303:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280643968 00000100:00100000:3.0:1786015558.750366:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1432 00000100:00100000:3.0:1786015558.750377:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+50:32749:x1872772280643968:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015558.750404:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015558.750429:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5030d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f72 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.750503:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5030db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.750519:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5030db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.750530:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5030db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.750545:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5030e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.750552:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5030e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.750558:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5030e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.750626:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5030db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.750633:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5030db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.750640:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5030db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.750646:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015558.750651:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5030db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.750658:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5030db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.750892:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:3.0:1786015558.750896:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015558.750901:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5030db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.750908:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c5030db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.750922:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5030e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.750928:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5030e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.750934:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5030e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.750939:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73829f9400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015558.750942:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5030e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.750948:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5030e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.750955:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b74b0022500) 00010000:00010000:3.0:1786015558.751190:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015558.751196:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5030e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.751202:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5030e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.751242:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5030d4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f72 expref: 51 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.751255:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:3.0:1786015558.751258:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015558.751261:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c5030d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f72 expref: 51 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.751272:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc400, rc 0) 00000100:00100000:3.0:1786015558.751381:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+50:32749:x1872772280643968:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1005us (1181us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015558.751388:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1432 00000100:00100000:1.0:1786015558.775973:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015558.776203:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280644096 00000100:00100000:0.0:1786015558.776218:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280644096 00000100:00100000:0.0:1786015558.776286:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1433 00000100:00100000:0.0:1786015558.776298:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+50:32750:x1872772280644096:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015558.776323:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015558.776351:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c5030e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f79 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776426:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5030f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776441:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5030f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776454:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5030f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776470:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5030f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776477:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5030f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776482:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5030f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776549:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5030f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776556:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5030f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776563:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5030f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776570:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015558.776575:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5030f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776582:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5030f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776598:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015558.776601:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015558.776606:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5030f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776612:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5030f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776624:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5030f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776629:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5030f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776634:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5030f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776640:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015558.776642:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5030f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776648:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5030f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776654:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b748f24ab00) 00010000:00010000:0.0:1786015558.776657:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015558.776672:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5030f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776678:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5030f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776716:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c5030e9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f79 expref: 51 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776726:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015558.776729:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015558.776733:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c5030e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f79 expref: 51 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.776744:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6800, rc 0) 00000100:00100000:0.0:1786015558.776885:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+50:32750:x1872772280644096:12345-192.168.202.56@tcp:101:cp.0 Request processed in 588us (926us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015558.776893:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1433 00000100:00100000:0.0:1786015558.785599:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015558.785891:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280644224 00000100:00100000:3.0:1786015558.785903:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280644224 00000100:00100000:3.0:1786015558.785972:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1434 00000100:00100000:3.0:1786015558.785984:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+50:32750:x1872772280644224:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015558.786010:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015558.786033:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c5030fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f80 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786119:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503105 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786138:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503105 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786149:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503105 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786164:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50310c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786171:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50310c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786177:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50310c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786243:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503105 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786250:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503105 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786255:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503105 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786262:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73829f9400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015558.786265:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503105 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786272:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503105 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786284:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:3.0:1786015558.786287:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015558.786291:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503105 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786296:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503105 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786307:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50310c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786311:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50310c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786317:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50310c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786321:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015558.786323:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50310c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786328:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50310c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786334:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b74b0022500) 00010000:00010000:3.0:1786015558.786336:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015558.786338:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50310c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786343:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c50310c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786377:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c5030fe lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f80 expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786387:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:3.0:1786015558.786389:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015558.786392:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c5030fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f80 expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015558.786400:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73829f9600, rc 0) 00000100:00100000:3.0:1786015558.786470:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+50:32750:x1872772280644224:12345-192.168.202.56@tcp:101:cp.0 Request processed in 490us (884us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015558.786478:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1434 00000100:00100000:3.0:1786015558.797298:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015558.797411:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280644480 00000100:00100000:2.0:1786015558.797424:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280644480 00000100:00100000:2.0:1786015558.797487:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1435 00000100:00100000:2.0:1786015558.797496:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+50:32750:x1872772280644480:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015558.797518:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015558.797540:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c503113 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f87 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.797701:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c50311a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.797717:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c50311a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.797730:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c50311a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.797745:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c503121 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.797752:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c503121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.797758:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c503121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786015558.798515:0:7673:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c:0x0], index 0: 0 00010000:00010000:2.0:1786015558.798703:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c503128 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.798715:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c503128 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.798724:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c503128 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.798795:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c50311a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.798807:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c50311a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.798814:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c50311a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.798819:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015558.798823:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c50311a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.798830:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c50311a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.798842:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:2.0:1786015558.798845:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015558.798850:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c50311a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.798856:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c50311a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015558.798882:0:7673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ce22cf78 reply state 0000000039e757c2 transno 4294968255 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c503121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015558.798892:0:7673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786015558.798929:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c503113 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f87 expref: 53 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.798944:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c503128 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f87 expref: 52 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.798957:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:2.0:1786015558.798960:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015558.798963:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488060a00, rc 0) 00000100:00100000:2.0:1786015558.799065:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:32750:x1872772280644480:12345-192.168.202.56@tcp:101:cp.0 Request processed in 1569us (1777us total) trans 4294968255 rc 0/0 00000100:00100000:2.0:1786015558.799075:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1435 00010000:00010000:0.0:1786015558.807939:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c503121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.807962:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c503121 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.807971:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c503121 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.807978:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015558.807983:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c503121 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.807991:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c503121 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.808011:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b7487f06000) 00010000:00010000:0.0:1786015558.808015:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015558.808020:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c503121 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.808027:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c503121 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015558.810542:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015558.811173:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280644608 00000100:00100000:2.0:1786015558.811185:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280644608 00000100:00100000:2.0:1786015558.811260:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 403 00000100:00100000:2.0:1786015558.811271:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2351:x1872772280644608:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015558.811290:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015558.811312:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ffc11f1/0xb1a5ef690c503136 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f8e expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015558.811340:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786015558.811361:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=794s v=(0 0) 00010000:00010000:2.0:1786015558.811366:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015558.811375:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ffc11f1/0xb1a5ef690c503136 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f8e expref: 9 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.811394:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007ffc11f1/0xb1a5ef690c503136 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f8e expref: 9 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.811408:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488061c00, rc 0) 00000100:00100000:2.0:1786015558.811478:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280644608:12345-192.168.202.56@tcp:101:cp.0 Request processed in 210us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015558.811486:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 403 00000100:00080000:1.0:1786015558.813608:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015558.818463:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015558.821626:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280644736 00000100:00100000:0.0:1786015558.821647:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280644736 00000100:00100000:2.0:1786015558.826724:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 404 00000100:00100000:2.0:1786015558.826740:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:32750:x1872772280644736:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015558.826786:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015558.826807:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c50313d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f95 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.826843:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007ffc11f1/0xb1a5ef690c503136 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f8e expref: 10 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.826853:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015558.826857:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015558.826863:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c50313d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f95 expref: 10 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.826912:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007ffc11f1/0xb1a5ef690c503136 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f8e expref: 10 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.826928:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007ffc11f1/0xb1a5ef690c503136 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f8e expref: 10 pid: 11384 timeout: 894 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015558.826943:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304461568:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015558.827048:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382ce0600 going to sleep for 11 seconds 00000100:00100000:1.0:1786015558.844636:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015558.844679:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280644864 00000100:00100000:1.0:1786015558.845879:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280644864 00010000:00010000:1.0:1786015558.845952:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007ffc11f1/0xb1a5ef690c503136 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f8e expref: 11 pid: 11384 timeout: 894 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015558.846385:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 430 00000100:00100000:1.0:1786015558.846397:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280644864:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015558.846417:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015558.846452:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007ffc11f1/0xb1a5ef690c503136 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f8e expref: 11 pid: 11384 timeout: 894 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015558.846472:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007ffc11f1/0xb1a5ef690c503136 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f8e expref: 11 pid: 11384 timeout: 894 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015558.846509:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015558.846515:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015558.846527:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c50313d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f95 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015558.846538:0:17038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c50313d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f95 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015558.846586:0:17038:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c50313d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f95 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015558.846604:0:17038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738374b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:17038:1872772304461696:192.168.202.56@tcp:105: 00010000:00010000:2.0:1786015558.846731:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ffc11f1/0xb1a5ef690c503136 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f8e expref: 11 pid: 11384 timeout: 894 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015558.846777:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304461568:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015558.846808:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c50313d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f95 expref: 10 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.846824:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488061e00, rc 0) 00000100:00100000:2.0:1786015558.847013:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:32750:x1872772280644736:12345-192.168.202.56@tcp:101:cp.0 Request processed in 20276us (28560us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015558.847023:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 404 00000100:00100000:1.0:1786015558.848636:0:17038:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74865406c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015558.857594:0:17038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738374b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:17038:1872772304461696:192.168.202.56@tcp:105: 00010000:00010000:0.0:1786015558.857624:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015558.857700:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280644864:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 11304us (13078us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015558.857712:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 430 00000100:00100000:0.0:1786015558.858405:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015558.858462:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280645120 00000100:00100000:1.0:1786015558.858469:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280645120 00000100:00100000:1.0:1786015558.858523:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 290 00000100:00100000:1.0:1786015558.858531:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+52:32750:x1872772280645120:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:1.0:1786015558.858963:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+53:32750:x1872772280645120:12345-192.168.202.56@tcp:35:cp.0 Request processed in 431us (558us total) trans 4294968256 rc 0/0 00000100:00100000:1.0:1786015558.858969:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 290 00000100:00100000:1.0:1786015558.947623:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015558.947731:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280645248 00000100:00100000:2.0:1786015558.947742:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280645248 00000100:00100000:2.0:1786015558.947832:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1436 00000100:00100000:2.0:1786015558.947841:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+105:32753:x1872772280645248:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015558.947864:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015558.947896:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c503144 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8f9c expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.947970:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c50314b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.947984:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c50314b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.947995:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c50314b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948011:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503152 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948019:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948026:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948430:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503159 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948441:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948449:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015558.948482:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2c:0x0]: returning size 158 00000004:00200000:2.0:1786015558.948487:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015558.948506:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948518:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948526:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c50314b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948533:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c50314b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948538:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c50314b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948547:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015558.948551:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c50314b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948559:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c50314b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948570:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:2.0:1786015558.948573:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015558.948578:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c50314b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948583:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c50314b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948594:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948599:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503152 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948604:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948608:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481664a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015558.948611:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948616:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503152 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948625:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b7487f06e00) 00010000:00010000:2.0:1786015558.948627:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015558.948629:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503152 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948634:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503152 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948664:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061c00/0xb1a5ef690c503144 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f9c expref: 107 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948677:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503159 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f9c expref: 106 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015558.948683:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:2.0:1786015558.948686:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015558.948688:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481664c00, rc 0) 00000100:00100000:2.0:1786015558.948753:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+106:32753:x1872772280645248:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 913us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015558.948795:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1436 00000001:00080000:1.0:1786015558.954178:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968255 is committed 00000001:00080000:1.0:1786015558.954203:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968254 is committed 00000020:00080000:1.0:1786015558.954211:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 34 batchid updated 00000020:00080000:1.0:1786015558.954237:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 34 00000020:00080000:1.0:1786015558.954251:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 34 00000100:00100000:2.0:1786015558.957530:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015558.961340:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280645376 00000100:00100000:1.0:1786015558.961358:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280645376 00000100:00100000:1.0:1786015558.961454:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 405 00000100:00100000:1.0:1786015558.961465:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280645376:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015558.961484:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015558.961503:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c503160 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8fa3 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015558.961566:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383748700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304461824:192.168.202.56@tcp:106: 00000100:00100000:1.0:1786015558.961666:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486540780 going to sleep for 11 seconds 00000100:00080000:2.0:1786015558.961989:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1786015558.969426:0:6592:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1786015558.969435:0:6592:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb mtime: 0 -> 1786015559 00002000:00010000:1.0:1786015558.969438:0:6592:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb atime: 0 -> 1786015559 00002000:00010000:1.0:1786015558.969440:0:6592:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb ctime: 0 -> 1786015559 00000100:00100000:1.0:1786015558.969466:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383748700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304461824:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015558.969504:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c503160 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fa3 expref: 17 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015558.969530:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c503160 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fa3 expref: 17 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015558.969543:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920000, rc 0) 00000100:00100000:1.0:1786015558.969618:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280645376:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 8154us (12094us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015558.969626:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 405 00000100:00100000:2.0:1786015558.977399:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015558.981572:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280645504 00000100:00100000:1.0:1786015558.981589:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280645504 00000100:00100000:0.0:1786015558.984324:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1437 00000100:00100000:0.0:1786015558.984339:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+105:32753:x1872772280645504:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015558.984362:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015558.984385:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503167 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8faa expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.984453:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c50316e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.984469:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c50316e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.984480:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c50316e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015558.984673:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x51:0x0]: returning size 7680 00000004:00200000:0.0:1786015558.984678:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015558.984753:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c50316e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.987226:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503167 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8faa expref: 107 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.987258:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c50316e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8faa expref: 106 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015558.987269:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015558.987272:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015558.987276:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6000, rc 0) 00000100:00100000:0.0:1786015558.987441:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+106:32753:x1872772280645504:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3103us (10049us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015558.987451:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1437 00000100:00100000:2.0:1786015558.999310:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015558.999796:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280645632 00000100:00100000:0.0:1786015558.999807:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280645632 00000100:00100000:0.0:1786015558.999879:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 406 00000100:00100000:0.0:1786015558.999890:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280645632:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015558.999908:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015558.999926:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008028fc27/0xb1a5ef690c503175 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8fb1 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015558.999998:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304461952:192.168.202.56@tcp:106: 00000100:00100000:0.0:1786015559.000324:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015559.007386:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304461952:192.168.202.56@tcp:106: 00010000:00010000:0.0:1786015559.007432:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008028fc27/0xb1a5ef690c503175 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fb1 expref: 17 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.007462:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008028fc27/0xb1a5ef690c503175 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fb1 expref: 17 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.007475:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6c00, rc 0) 00000100:00100000:0.0:1786015559.007600:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280645632:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 7711us (8301us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015559.007609:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 406 00000100:00100000:1.0:1786015559.030519:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015559.030645:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280645888 00000100:00100000:0.0:1786015559.030658:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280645888 00000100:00100000:0.0:1786015559.030726:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1438 00000100:00100000:0.0:1786015559.030736:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+106:32753:x1872772280645888:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:0.0:1786015559.031185:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].43, 136 off14040 00000100:00100000:0.0:1786015559.031279:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+106:32753:x1872772280645888:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 543us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015559.031288:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1438 00010000:00010000:0.0:1786015559.536409:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015559.725026:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015559.725205:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015559.725262:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 44 count 3 00000040:00080000:1.0:1786015559.725269:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015559.725633:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738374b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304462080:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015559.725801:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74865409c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015559.732275:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738374b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304462080:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015559.750037:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015559.750252:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280646016 00000100:00100000:0.0:1786015559.750267:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280646016 00000100:00100000:0.0:1786015559.750347:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1439 00000100:00100000:0.0:1786015559.750359:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+52:32763:x1872772280646016:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015559.750422:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x2c:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015559.750580:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+52:32763:x1872772280646016:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 222us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015559.750589:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1439 00000100:00100000:0.0:1786015559.758815:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015559.760394:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280646272 00000100:00100000:2.0:1786015559.760416:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280646272 00000100:00100000:2.0:1786015559.760496:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1440 00000100:00100000:2.0:1786015559.760510:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+52:32763:x1872772280646272:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015559.760543:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015559.760575:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c50317c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8fb8 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015559.760726:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503183 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015559.760746:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015559.762099:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015559.762141:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2c:0x0]: returning size 158 00010000:00010000:2.0:1786015559.762386:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c50317c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fb8 expref: 55 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015559.762413:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503183 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fb8 expref: 54 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015559.762425:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:2.0:1786015559.762428:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015559.762433:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481664a00, rc 0) 00000100:00100000:2.0:1786015559.762549:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32763:x1872772280646272:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 2040us (3758us total) trans 4294968257 rc 0/0 00000100:00100000:2.0:1786015559.762559:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1440 00000100:00100000:1.0:1786015559.782535:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015559.784303:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280646400 00000100:00100000:0.0:1786015559.784338:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280646400 00000100:00100000:0.0:1786015559.784443:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 407 00000100:00100000:0.0:1786015559.784457:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280646400:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786015559.784525:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c503191 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.784552:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c50313d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f95 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.784563:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1c:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786015559.784568:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015559.784573:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c503191 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.784624:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c50313d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f95 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.784643:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c50313d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f95 expref: 9 pid: 6590 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015559.784662:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304462208:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015559.784828:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74866b59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015559.796033:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015559.796164:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304462208:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015559.796209:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c503191 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015559.796360:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280646528 00000100:00100000:1.0:1786015559.796371:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280646528 00000100:00100000:1.0:1786015559.796464:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:1.0:1786015559.796476:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+54:2351:x1872772280646528:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015559.796498:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015559.796532:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503183 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fb8 expref: 54 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.796564:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:1.0:1786015559.796572:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015559.796642:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2351:x1872772280646528:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 168us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015559.796651:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:1.0:1786015559.807549:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015559.807848:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280646656 00000100:00100000:0.0:1786015559.807860:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280646656 00002000:00100000:0.0:1786015559.807928:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1c:0x0] (0->157) req@ffff8b7383749c00 x1872772280646656/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:405/0 lens 648/0 e 0 to 0 dl 1786015570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015559.807941:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7383749c00 with x1872772280646656 ext(0->157) 00010000:00010000:0.0:1786015559.807952:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c50313d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f95 expref: 10 pid: 6590 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.807978:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c50313d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f95 expref: 10 pid: 6590 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015559.807988:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b7383749c00 00000100:00100000:0.0:1786015559.808025:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:0.0:1786015559.808037:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280646656:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:0.0:1786015559.814191:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280646656:12345-192.168.202.56@tcp:4:cp.0 Request processed in 6065us (6562us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1786015559.814207:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 15 00002000:00100000:0.0:1786015559.814222:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1c:0x0] (0->157) req@ffff8b7383749c00 x1872772280646656/t4294967374(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:405/0 lens 648/448 e 0 to 0 dl 1786015570 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015559.814232:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7383749c00 with x1872772280646656 ext(0->157) 00010000:00010000:0.0:1786015559.814244:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c50313d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f95 expref: 12 pid: 6590 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.814273:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c50313d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f95 expref: 12 pid: 6590 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015559.814283:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b7383749c00 00000100:00100000:0.0:1786015559.819507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015559.820781:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280646784 00000100:00100000:1.0:1786015559.820794:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280646784 00010000:00010000:1.0:1786015559.820841:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c50313d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f95 expref: 12 pid: 6590 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015559.820897:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 431 00000100:00100000:1.0:1786015559.820907:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2352:x1872772280646784:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015559.820923:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015559.820949:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c50313d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f95 expref: 12 pid: 6590 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.820965:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c50313d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f95 expref: 12 pid: 6590 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.820996:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082a32647/0xb1a5ef690c50313d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f95 expref: 12 pid: 6590 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.821015:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015559.821020:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015559.821026:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c503191 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.821038:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c503191 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.821066:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015559.821124:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280646784:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 218us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015559.821132:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 431 00010000:00010000:0.0:1786015559.821735:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c503191 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.821747:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c503191 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.821800:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c503191 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.821809:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c503191 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.821818:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c503191 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.821825:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7400 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015559.821830:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c503191 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.821838:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c503191 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.821852:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c503191 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.821859:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c503191 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015559.827992:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280646400:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 43524us (45458us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015559.828009:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 407 00000100:00100000:0.0:1786015559.841228:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015559.841991:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280647040 00000100:00100000:2.0:1786015559.842005:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280647040 00000100:00100000:2.0:1786015559.842084:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1441 00000100:00100000:2.0:1786015559.842095:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+53:32763:x1872772280647040:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015559.842217:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+53:32763:x1872772280647040:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 123us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015559.842225:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1441 00000100:00100000:1.0:1786015559.863931:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015559.864039:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280647168 00000100:00100000:2.0:1786015559.864051:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280647168 00000100:00100000:2.0:1786015559.864111:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 408 00000100:00100000:2.0:1786015559.864123:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2351:x1872772280647168:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015559.864141:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015559.864163:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024d079da/0xb1a5ef690c503198 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8fbf expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015559.864191:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 158, mtime: 0x6a746f47, atime: 0x0, ctime: 0x6a746f47, blocks: 0x1 00010000:00010000:2.0:1786015559.864214:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=795s v=(0 0) 00010000:00010000:2.0:1786015559.864220:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015559.864230:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024d079da/0xb1a5ef690c503198 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fbf expref: 11 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015559.864249:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024d079da/0xb1a5ef690c503198 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fbf expref: 11 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015559.864263:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481665200, rc 0) 00000100:00100000:2.0:1786015559.864336:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280647168:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 215us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015559.864343:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 408 00000100:00100000:2.0:1786015559.870985:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015559.871072:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280647424 00000100:00100000:1.0:1786015559.871082:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280647424 00000100:00100000:1.0:1786015559.871142:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1442 00000100:00100000:1.0:1786015559.871152:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:32763:x1872772280647424:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786015559.871272:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:32763:x1872772280647424:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 121us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015559.871280:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1442 00000100:00100000:0.0:1786015559.887159:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015559.887381:0:17969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280647552 00000100:00100000:1.0:1786015559.887393:0:17969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280647552 00002000:00100000:1.0:1786015559.887451:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1c:0x0] (0->4095) req@ffff8b74b8c5ea00 x1872772280647552/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:405/0 lens 488/0 e 0 to 0 dl 1786015570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015559.887463:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74b8c5ea00 with x1872772280647552 ext(0->4095) 00002000:00010000:1.0:1786015559.887469:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74b8c5ea00 00000100:00100000:1.0:1786015559.887506:0:17969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 123 00000100:00100000:1.0:1786015559.887517:0:17969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280647552:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1786015559.887748:0:17969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280647552:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 232us (601us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786015559.887757:0:17969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 123 00002000:00100000:1.0:1786015559.887793:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1c:0x0] (0->4095) req@ffff8b74b8c5ea00 x1872772280647552/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:405/0 lens 488/4536 e 0 to 0 dl 1786015570 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015559.887802:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74b8c5ea00 with x1872772280647552 ext(0->4095) 00002000:00010000:1.0:1786015559.887806:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74b8c5ea00 00000100:00100000:1.0:1786015559.899354:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015559.899469:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280647680 00000100:00100000:0.0:1786015559.899480:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280647680 00000100:00100000:0.0:1786015559.899542:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1443 00000100:00100000:0.0:1786015559.899552:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+53:32763:x1872772280647680:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015559.899574:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015559.899597:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c50319f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8fc6 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.899643:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c5031a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.899657:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c5031a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.899669:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c5031a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.899798:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c50319f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fc6 expref: 55 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.899818:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c5031a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fc6 expref: 54 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015559.899827:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:0.0:1786015559.899830:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015559.899833:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6600, rc 0) 00000100:00100000:0.0:1786015559.899908:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32763:x1872772280647680:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 357us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015559.899915:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1443 00000100:00100000:1.0:1786015559.911607:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015559.912842:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280647808 00000100:00100000:2.0:1786015559.912857:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280647808 00000100:00100000:2.0:1786015559.912936:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1444 00000100:00100000:2.0:1786015559.912947:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32763:x1872772280647808:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015559.912985:0:7673:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x2c:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015559.913101:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32763:x1872772280647808:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 155us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015559.913108:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1444 00000100:00100000:0.0:1786015559.921988:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015559.922110:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280647936 00000100:00100000:1.0:1786015559.922131:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280647936 00000100:00100000:1.0:1786015559.922223:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 409 00000100:00100000:1.0:1786015559.922237:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280647936:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015559.922314:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c5031ad lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.922338:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015559.922344:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015559.922354:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c5031ad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.922372:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c5031ad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.922421:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c5031ad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.922431:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c5031ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.922442:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c5031ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.922451:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920000 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015559.922456:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c5031ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.922467:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c5031ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.922493:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c5031ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.922502:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016001ac6/0xb1a5ef690c5031ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015559.922617:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280647936:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 383us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015559.922626:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 409 00000100:00100000:2.0:1786015559.932603:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015559.933087:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280648192 00000100:00100000:1.0:1786015559.933105:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280648192 00000100:00100000:1.0:1786015559.933181:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1445 00000100:00100000:1.0:1786015559.933192:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32763:x1872772280648192:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786015559.933301:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.933323:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c5031a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fc6 expref: 54 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.933333:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031b4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.933379:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c5031a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fc6 expref: 54 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.933395:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c5031a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fc6 expref: 54 pid: 12526 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015559.933413:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383749880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304462336:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015559.933623:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74865400c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015559.944530:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015559.944580:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280648320 00000100:00100000:3.0:1786015559.944590:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280648320 00010000:00010000:3.0:1786015559.944645:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c5031a6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fc6 expref: 55 pid: 12526 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015559.944702:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 432 00000100:00100000:3.0:1786015559.944712:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+55:2353:x1872772280648320:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015559.944732:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015559.944739:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c5031a6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fc6 expref: 55 pid: 12526 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015559.944784:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c5031a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fc6 expref: 55 pid: 12526 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015559.945280:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383749880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304462336:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015559.946193:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c5031a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fc6 expref: 55 pid: 12526 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.951480:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015559.951648:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:3.0:1786015559.951657:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015559.951671:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015559.951679:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031b4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015559.951743:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015559.952477:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.952489:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015559.953504:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+55:2353:x1872772280648320:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 8779us (8973us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015559.953523:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 432 00010000:00010000:1.0:1786015559.954711:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.954730:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031b4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.954738:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031b4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.954745:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015559.954752:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031b4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.955420:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031b4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.955449:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:1.0:1786015559.955453:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015559.955460:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031b4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015559.955468:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031b4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015559.957406:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32763:x1872772280648192:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 24202us (24797us total) trans 4294968258 rc 0/0 00000100:00100000:1.0:1786015559.957424:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1445 00000040:00080000:3.0:1786015559.957723:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015559.957730:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015559.958474:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1786015559.958489:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015559.966984:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015559.967750:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280648576 00000100:00100000:0.0:1786015559.967788:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280648576 00000100:00100000:0.0:1786015559.967903:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 291 00000100:00100000:0.0:1786015559.967916:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32763:x1872772280648576:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786015559.968196:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+55:32763:x1872772280648576:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 282us (1228us total) trans 4294968259 rc 0/0 00000100:00100000:0.0:1786015559.968205:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 291 00000040:00080000:1.0:1786015560.239219:0:22127:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015560.239234:0:22127:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015560.239289:0:22127:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 44 count 3 00000040:00080000:1.0:1786015560.239296:0:22127:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015560.255070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015560.255113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015560.255146:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015560.255167:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015560.255187:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015560.255204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015560.255229:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015560.255269:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280648960 00000100:00100000:2.0:1786015560.255282:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280648960 00000100:00100000:2.0:1786015560.255371:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280649472 00000100:00100000:2.0:1786015560.255375:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280649472 00000100:00100000:2.0:1786015560.255394:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280649088 00000100:00100000:2.0:1786015560.255396:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280649088 00000100:00100000:2.0:1786015560.255410:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280649344 00000100:00100000:2.0:1786015560.255412:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280649344 00000100:00100000:2.0:1786015560.255431:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 558 00000100:00100000:2.0:1786015560.255443:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2352:x1872772280648960:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015560.255540:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2352:x1872772280648960:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 99us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015560.255550:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 558 00000100:00100000:2.0:1786015560.255568:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 559 00000100:00100000:2.0:1786015560.255575:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2352:x1872772280649472:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015560.255603:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2352:x1872772280649472:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015560.255609:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 559 00000100:00100000:2.0:1786015560.255622:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 560 00000100:00100000:2.0:1786015560.255628:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2352:x1872772280649088:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015560.255655:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2352:x1872772280649088:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015560.255662:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 560 00000100:00100000:2.0:1786015560.255673:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 561 00000100:00100000:2.0:1786015560.255679:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280649344:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015560.255700:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280649344:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015560.255707:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 561 00000100:00100000:2.0:1786015560.255727:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280649216 00000100:00100000:2.0:1786015560.255731:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280649216 00000100:00100000:2.0:1786015560.255792:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280648832 00000100:00100000:2.0:1786015560.256372:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280648832 00000100:00100000:2.0:1786015560.256414:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 555 00000100:00100000:2.0:1786015560.256422:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+55:2352:x1872772280649216:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015560.256467:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+55:2352:x1872772280649216:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 47us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015560.256475:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 555 00000100:00100000:2.0:1786015560.256486:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 556 00000100:00100000:2.0:1786015560.256492:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+106:2352:x1872772280648832:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015560.256512:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+106:2352:x1872772280648832:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015560.256517:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 556 00000100:00080000:2.0:1786015560.256547:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786015560.256552:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015560.256554:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015560.258947:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280648704 00000100:00100000:1.0:1786015560.258968:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280648704 00000100:00100000:1.0:1786015560.259129:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 638 00000100:00100000:1.0:1786015560.259142:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280648704:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015560.259265:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280648704:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 125us (4209us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015560.259274:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 638 00000100:00100000:3.0:1786015560.310340:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015560.316597:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280649600 00000100:00100000:0.0:1786015560.316617:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280649600 00000100:00100000:0.0:1786015560.316706:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 410 00000100:00100000:0.0:1786015560.316718:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2351:x1872772280649600:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:0.0:1786015560.316744:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015560.316788:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c5031bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8fcd expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.316824:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015560.316829:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015560.316839:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c5031bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fcd expref: 17 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.316872:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c5031bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fcd expref: 17 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.316892:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7400, rc 0) 00000100:00100000:0.0:1786015560.316983:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280649600:12345-192.168.202.56@tcp:101:rm.0 Request processed in 267us (7278us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015560.316991:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 410 00000100:00100000:3.0:1786015560.326843:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015560.326954:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280649856 00000100:00100000:1.0:1786015560.326969:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280649856 00000100:00100000:1.0:1786015560.327057:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1446 00000100:00100000:1.0:1786015560.327069:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+106:32765:x1872772280649856:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:1.0:1786015560.327150:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1786015560.327190:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503159 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f9c expref: 106 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.327221:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:1.0:1786015560.327234:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c50316e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8faa expref: 105 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.327244:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:1.0:1786015560.327247:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015560.327283:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.327299:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.327311:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.327330:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5031c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.327337:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5031c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.327344:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5031c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.327829:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5031d0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.327845:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c503128 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f87 expref: 54 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.327871:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5031d0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.327920:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c503128 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f87 expref: 54 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.327939:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c503128 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f87 expref: 54 pid: 7673 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015560.327957:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383749880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304462464:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015560.328089:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74865400c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015560.332435:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015560.335062:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383749880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304462464:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015560.335105:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5031d0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015560.341546:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280649984 00000100:00100000:3.0:1786015560.341569:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280649984 00010000:00010000:3.0:1786015560.341640:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c503128 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f87 expref: 55 pid: 7673 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015560.341697:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 433 00000100:00100000:3.0:1786015560.341708:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+55:2353:x1872772280649984:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015560.341730:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015560.341739:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c503128 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f87 expref: 55 pid: 7673 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.341755:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c503128 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f87 expref: 55 pid: 7673 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.341819:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c503128 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f87 expref: 55 pid: 7673 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.341840:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:3.0:1786015560.341847:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5031d0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.341868:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5031d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.341878:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5031d0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.341917:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015560.342277:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5031d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.342288:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5031d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786015560.343733:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].14, 64 off9112 00000004:00080000:0.0:1786015560.343749:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795594986537ns, next at 796594983182ns, rc = 0 00000100:00100000:3.0:1786015560.344533:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+54:2353:x1872772280649984:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 2814us (12102us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015560.344553:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 433 00010000:00010000:0.0:1786015560.347324:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.347357:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.347376:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.347386:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031d7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.347392:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031d7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.347398:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031d7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.347429:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786015560.347458:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5031d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.347465:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5031d0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.347471:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5031d0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.347478:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.347482:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5031d0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.347491:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5031d0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.347504:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:0.0:1786015560.347508:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786015560.347515:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5031d0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.347521:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5031d0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.347544:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.347550:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.347555:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.347561:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.347563:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.347570:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.347578:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015560.347581:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015560.347584:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.347589:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5031c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015560.347601:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002f96c2b6 reply state 00000000c20193e6 transno 4294968260 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5031c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015560.347618:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015560.347745:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+106:32765:x1872772280649856:12345-192.168.202.56@tcp:36:rm.0 Request processed in 20673us (20911us total) trans 4294968260 rc 0/0 00000100:00100000:0.0:1786015560.347755:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1446 00010000:00010000:1.0:1786015560.348407:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786015560.348420:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031d7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.348429:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7800 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015560.348432:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031d7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.348440:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031d7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.348452:0:8308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:1.0:1786015560.348455:0:8308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786015560.348459:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031d7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.348464:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031d7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.348487:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015560.348489:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015560.348490:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015560.359723:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5031c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.359746:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5031c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.359755:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5031c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.359792:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015560.359798:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5031c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.359806:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5031c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.359827:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b748f194c00) 00010000:00010000:1.0:1786015560.359830:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015560.359835:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5031c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.359840:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5031c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015560.522968:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015560.523155:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280650112 00000100:00100000:2.0:1786015560.523169:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280650112 00000100:00100000:2.0:1786015560.523270:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1447 00000100:00100000:2.0:1786015560.523282:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+105:32781:x1872772280650112:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:2.0:1786015560.523317:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015560.523348:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c5031de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8fd4 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.523443:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c5031e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.523463:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c5031e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.523477:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c5031e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015560.523581:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x51:0x0]: returning size 7680 00000004:00200000:2.0:1786015560.523587:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015560.523617:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c5031e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.523650:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c5031de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fd4 expref: 107 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.523671:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c5031e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fd4 expref: 106 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.523682:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:2.0:1786015560.523686:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015560.523690:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481665600, rc 0) 00000100:00100000:2.0:1786015560.523802:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+106:32781:x1872772280650112:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 522us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015560.523809:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1447 00010000:00010000:0.0:1786015560.558392:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015560.573668:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015560.575893:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280650240 00000100:00100000:2.0:1786015560.575920:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280650240 00000100:00100000:2.0:1786015560.576031:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1448 00000100:00100000:2.0:1786015560.576044:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32787:x1872772280650240:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015560.576077:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015560.576113:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c5031ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8fdb expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.576356:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c5031ec lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fdb expref: 55 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.576375:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:2.0:1786015560.576379:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015560.576385:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c5031ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fdb expref: 55 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.576408:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481665400, rc 0) 00000100:00100000:2.0:1786015560.576523:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32787:x1872772280650240:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 481us (2870us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015560.576532:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1448 00000100:00100000:3.0:1786015560.587900:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015560.588186:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280650496 00000100:00100000:0.0:1786015560.588201:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280650496 00000100:00100000:0.0:1786015560.588277:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1449 00000100:00100000:0.0:1786015560.588290:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+106:32787:x1872772280650496:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015560.588319:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015560.588323:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786015560.588361:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c5031e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fd4 expref: 106 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.588386:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015560.588392:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015560.588410:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c5031f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8fe2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.588750:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.589622:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.589640:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.589664:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c503201 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.589671:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c503201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.589677:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c503201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.590710:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503208 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.590724:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.590733:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015560.590747:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 0 00010000:00010000:0.0:1786015560.590811:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.590820:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031fa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.590828:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.590834:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.590839:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.590867:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.590882:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015560.590885:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015560.590891:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.590897:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5031fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015560.590912:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005c35d994 reply state 00000000f005dd5d transno 4294968261 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c503201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015560.590921:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786015560.590964:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c5031f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fe2 expref: 108 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.590980:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503208 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fe2 expref: 107 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.590988:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:0.0:1786015560.590990:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015560.590992:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7000, rc 0) 00000100:00100000:0.0:1786015560.591115:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+108:32787:x1872772280650496:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 2827us (3230us total) trans 4294968261 rc 0/0 00000100:00100000:0.0:1786015560.591126:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1449 00010000:00010000:0.0:1786015560.595315:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c503201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.595341:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c503201 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.595350:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c503201 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.595357:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.595363:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c503201 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.595372:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c503201 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.595394:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b748f24ab00) 00010000:00010000:0.0:1786015560.595397:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015560.595403:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c503201 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.595409:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c503201 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015560.600736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015560.601076:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280650752 00000100:00100000:0.0:1786015560.601091:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280650752 00000100:00100000:0.0:1786015560.601178:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1450 00000100:00100000:0.0:1786015560.601190:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+107:32787:x1872772280650752:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015560.601229:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015560.601263:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503216 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8fe9 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.601408:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50321d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.601429:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503208 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fe2 expref: 108 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.601439:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50321d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.601487:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503208 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fe2 expref: 108 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.601504:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503208 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fe2 expref: 108 pid: 5794 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015560.601522:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304462592:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015560.601661:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b01b0600 going to sleep for 11 seconds 00000100:00100000:0.0:1786015560.608505:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304462592:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015560.608547:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50321d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015560.613719:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015560.613928:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280650880 00000100:00100000:0.0:1786015560.613951:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280650880 00010000:00010000:1.0:1786015560.614112:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503208 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fe2 expref: 109 pid: 5794 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015560.614185:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 434 00000100:00100000:1.0:1786015560.614202:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+109:2353:x1872772280650880:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015560.614225:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015560.614235:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503208 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fe2 expref: 109 pid: 5794 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.614252:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503208 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fe2 expref: 109 pid: 5794 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.614286:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503208 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fe2 expref: 109 pid: 5794 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.614310:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:1.0:1786015560.614317:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50321d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.614332:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50321d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.614340:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50321d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.614381:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015560.614468:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280650880:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 270us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015560.614477:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 434 00010000:00010000:0.0:1786015560.614552:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50321d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.614562:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50321d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015560.614593:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 0 00010000:00010000:0.0:1786015560.615024:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50321d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.615035:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50321d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.615043:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50321d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.615050:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.615055:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50321d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.615064:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50321d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.615075:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b748f24a100) 00010000:00010000:0.0:1786015560.615079:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015560.615082:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50321d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.615088:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50321d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.615173:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503216 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fe9 expref: 108 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.615185:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015560.615188:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015560.615192:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503216 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fe9 expref: 108 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.615202:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7c00, rc 0) 00000100:00100000:0.0:1786015560.615252:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+107:32787:x1872772280650752:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 14064us (14532us total) trans 4294968262 rc 301/301 00000100:00100000:0.0:1786015560.615261:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1450 00000100:00100000:1.0:1786015560.622232:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015560.622574:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280651136 00000100:00100000:2.0:1786015560.622600:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280651136 00000100:00100000:2.0:1786015560.622696:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 292 00000100:00100000:2.0:1786015560.622709:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+107:32787:x1872772280651136:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015560.623270:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+108:32787:x1872772280651136:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 561us (1051us total) trans 4294968263 rc 0/0 00000100:00100000:2.0:1786015560.623280:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 292 00000100:00100000:3.0:1786015560.629628:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015560.630255:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280651264 00000100:00100000:2.0:1786015560.630270:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280651264 00000100:00100000:2.0:1786015560.630436:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1451 00000100:00100000:2.0:1786015560.630449:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+108:32787:x1872772280651264:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015560.630488:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015560.630521:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c50322b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ff0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.630609:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c50322b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ff0 expref: 109 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.631017:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c50322b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ff0 expref: 109 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.631111:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:2.0:1786015560.631115:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786015560.631120:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481665400, rc 0) 00000100:00100000:2.0:1786015560.631274:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+109:32787:x1872772280651264:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 826us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015560.631283:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1451 00000100:00100000:3.0:1786015560.643926:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015560.644122:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280651520 00000100:00100000:0.0:1786015560.644135:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280651520 00000100:00100000:0.0:1786015560.644203:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1452 00000100:00100000:0.0:1786015560.644216:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+109:32787:x1872772280651520:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1786015560.644307:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503232 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.644328:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503232 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.644343:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503232 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.644619:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503232 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.644626:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503232 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.644632:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503232 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.644638:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.644645:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503232 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.644653:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503232 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.644668:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:0.0:1786015560.644672:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1786015560.644678:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503232 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.644685:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503232 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015560.645074:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+110:32787:x1872772280651520:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 550us (1003us total) trans 4294968264 rc 0/0 00000100:00100000:0.0:1786015560.645089:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1452 00000100:00100000:1.0:1786015560.647346:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015560.647398:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280651776 00000100:00100000:0.0:1786015560.647412:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280651776 00000100:00100000:0.0:1786015560.647641:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1453 00000100:00100000:0.0:1786015560.647653:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+110:32787:x1872772280651776:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786015560.648106:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503239 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.648127:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503239 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.648142:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503239 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786015560.648224:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968265 00000004:00010000:0.0:1786015560.648262:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008169a950 reply state 000000002fd85e95 transno 4294968266 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503239 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015560.648269:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015560.648381:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+113:32787:x1872772280651776:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 729us (1046us total) trans 4294968266 rc 0/0 00000100:00100000:0.0:1786015560.648390:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1453 00000020:00080000:0.0:1786015560.648396:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786015560.650993:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503239 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.651018:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503239 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.651027:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503239 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.651044:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015560.651051:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503239 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.651059:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503239 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.651078:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:1.0:1786015560.651081:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786015560.651085:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503239 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.651090:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503239 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015560.651382:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015560.651439:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280652032 00000100:00100000:0.0:1786015560.651454:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280652032 00000100:00100000:0.0:1786015560.651540:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 293 00000100:00100000:0.0:1786015560.651553:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916ac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+112:32787:x1872772280652032:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786015560.652341:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916ac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+113:32787:x1872772280652032:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 786us (958us total) trans 4294968267 rc 0/0 00000100:00100000:0.0:1786015560.652351:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 293 00000100:00100000:3.0:1786015560.712218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015560.724849:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280652288 00000100:00100000:2.0:1786015560.724884:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280652288 00000100:00100000:2.0:1786015560.724983:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1454 00000100:00100000:2.0:1786015560.724999:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+113:32790:x1872772280652288:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015560.725050:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015560.725087:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503240 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ff7 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.725197:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503247 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.725217:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503247 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.725232:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503247 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.725252:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c50324e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.725258:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c50324e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.725266:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c50324e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.726004:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503255 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.726016:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.726026:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015560.726050:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1786015560.726180:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503247 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.726190:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503247 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.726197:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503247 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.726204:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481665000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015560.726210:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503247 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.726218:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503247 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.726232:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:2.0:1786015560.726235:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015560.726242:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503247 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.726248:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503247 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.726265:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c50324e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.726271:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c50324e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.726275:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c50324e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.726281:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481665600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015560.726283:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c50324e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.726289:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c50324e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.726601:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b7487f06700) 00010000:00010000:2.0:1786015560.726605:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015560.726609:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c50324e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.726615:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c50324e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.726756:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503240 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ff7 expref: 116 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.729024:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503255 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ff7 expref: 115 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.730992:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:2.0:1786015560.731005:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015560.731011:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481664a00, rc 0) 00000100:00100000:2.0:1786015560.731157:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+115:32790:x1872772280652288:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 6156us (18948us total) trans 4294968268 rc 0/0 00000100:00100000:2.0:1786015560.731171:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1454 00000100:00100000:2.0:1786015560.736419:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015560.736601:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280652416 00000100:00100000:1.0:1786015560.736616:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280652416 00000100:00100000:1.0:1786015560.736701:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1455 00000100:00100000:1.0:1786015560.736714:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+115:32790:x1872772280652416:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:1.0:1786015560.736865:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c503263 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.736889:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c503263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.736903:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c503263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.736944:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c503263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.736951:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c503263 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.736958:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c503263 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.736965:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015560.736970:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c503263 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.736979:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c503263 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.736992:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:1.0:1786015560.736996:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786015560.737002:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c503263 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.737013:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c503263 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015560.737127:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+115:32790:x1872772280652416:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 414us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015560.737136:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1455 00000100:00100000:2.0:1786015560.749985:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015560.750075:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280652672 00000100:00100000:3.0:1786015560.750090:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280652672 00000100:00100000:3.0:1786015560.750184:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 294 00000100:00100000:3.0:1786015560.750196:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+115:32790:x1872772280652672:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:3.0:1786015560.750668:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+116:32790:x1872772280652672:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 473us (697us total) trans 4294968269 rc 0/0 00000100:00100000:3.0:1786015560.750678:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 294 00000100:00100000:1.0:1786015560.797395:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015560.797846:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280652928 00000100:00100000:0.0:1786015560.797871:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280652928 00000100:00100000:0.0:1786015560.797945:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1456 00000100:00100000:0.0:1786015560.797957:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+116:32796:x1872772280652928:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1786015560.797995:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015560.798027:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c50326a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e8ffe expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.798865:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503271 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.798888:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503271 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.798911:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503271 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015560.798927:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1786015560.799798:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c50326a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ffe expref: 119 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.799829:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503271 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ffe expref: 118 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.799842:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:0.0:1786015560.799846:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00000100:00100000:2.0:1786015560.799996:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015560.800283:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280653184 00000100:00100000:3.0:1786015560.800296:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280653184 00010000:00010000:0.0:1786015560.800396:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6a00, rc 0) 00000100:00100000:0.0:1786015560.800492:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+119:32796:x1872772280652928:12345-192.168.202.56@tcp:101:cat.0 Request processed in 2536us (3111us total) trans 4294968270 rc 0/0 00000100:00100000:0.0:1786015560.800503:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1456 00000100:00100000:0.0:1786015560.800537:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1457 00000100:00100000:0.0:1786015560.800547:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+118:32795:x1872772280653184:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1786015560.800572:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015560.800593:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c50327f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9005 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.801365:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503286 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.801386:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503286 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.801406:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503286 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015560.801421:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1786015560.801609:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c50327f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9005 expref: 121 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.801630:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503286 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9005 expref: 120 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.801649:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:0.0:1786015560.801653:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1786015560.801657:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7200, rc 0) 00000100:00100000:0.0:1786015560.801708:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+120:32795:x1872772280653184:12345-192.168.202.56@tcp:101:cat.0 Request processed in 1162us (1712us total) trans 4294968271 rc 0/0 00000100:00100000:0.0:1786015560.801718:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1457 00000100:00100000:1.0:1786015560.806584:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015560.806649:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015560.806688:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015560.806745:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280653824 00000100:00100000:0.0:1786015560.806785:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280653824 00000100:00100000:0.0:1786015560.806877:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00100000:0.0:1786015560.806889:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+120:32795:x1872772280653824:12345-192.168.202.56@tcp:103:cat.0 00010000:00010000:0.0:1786015560.806911:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1786015560.806946:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503255 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ff7 expref: 120 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.806974:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503286 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9005 expref: 119 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.806995:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c50322b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ff0 expref: 118 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.807008:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:0.0:1786015560.807014:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015560.807088:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+117:32795:x1872772280653824:12345-192.168.202.56@tcp:103:cat.0 Request processed in 201us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015560.807110:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00100000:3.0:1786015560.807427:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280653696 00000100:00100000:3.0:1786015560.807435:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280653696 00000100:00100000:3.0:1786015560.807497:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 295 00000100:00100000:3.0:1786015560.807507:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+117:32796:x1872772280653696:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:3.0:1786015560.807868:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+118:32796:x1872772280653696:12345-192.168.202.56@tcp:35:cat.0 Request processed in 349us (1286us total) trans 4294968272 rc 0/0 00000100:00100000:3.0:1786015560.807876:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 295 00000100:00100000:2.0:1786015560.809292:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280653440 00000100:00100000:2.0:1786015560.809312:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280653440 00000100:00100000:2.0:1786015560.809401:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1458 00000100:00100000:2.0:1786015560.809414:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+118:32797:x1872772280653440:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1786015560.809445:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015560.809479:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503294 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e900c expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.809605:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c50329b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.809622:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c50329b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.809636:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c50329b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015560.809688:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00000004:00200000:2.0:1786015560.809693:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015560.809719:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c50329b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.809755:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503294 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e900c expref: 120 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.809821:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c50329b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e900c expref: 119 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.809832:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:2.0:1786015560.809836:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015560.809841:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481664c00, rc 0) 00000100:00100000:2.0:1786015560.809932:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+119:32797:x1872772280653440:12345-192.168.202.56@tcp:101:cat.0 Request processed in 521us (3242us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015560.809941:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1458 00000100:00100000:3.0:1786015560.811400:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015560.811533:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280654080 00000100:00100000:1.0:1786015560.811546:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280654080 00000100:00100000:1.0:1786015560.811647:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1459 00000100:00100000:1.0:1786015560.811659:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+119:32798:x1872772280654080:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:1.0:1786015560.811689:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015560.811718:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5032a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9013 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.811844:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5032a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.811871:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5032a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.811884:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5032a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.811902:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5032b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.811910:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5032b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.811916:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5032b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.812325:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c5032b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.812336:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c5032b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.812344:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c5032b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015560.812358:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:1.0:1786015560.812709:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5032a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.812720:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5032a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.812727:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5032a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.812734:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015560.812739:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5032a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.812748:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5032a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.812795:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:1.0:1786015560.812798:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015560.812804:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5032a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.812810:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5032a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.812828:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5032b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.812834:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5032b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.812841:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5032b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.812847:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015560.812860:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5032b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.812867:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5032b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.812876:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b748f194c00) 00010000:00010000:1.0:1786015560.812878:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015560.812881:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5032b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.812886:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5032b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.813213:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5032a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9013 expref: 122 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.813233:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c5032b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9013 expref: 121 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.813241:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:1.0:1786015560.813243:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015560.813247:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921200, rc 0) 00000100:00100000:1.0:1786015560.813378:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+121:32798:x1872772280654080:12345-192.168.202.56@tcp:101:cat.0 Request processed in 1720us (1987us total) trans 4294968273 rc 0/0 00000100:00100000:1.0:1786015560.813389:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1459 00000100:00100000:2.0:1786015560.813911:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015560.818005:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015560.818416:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280654208 00000100:00100000:0.0:1786015560.818431:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280654208 00000100:00100000:0.0:1786015560.820795:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1460 00000100:00100000:0.0:1786015560.820830:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+121:32795:x1872772280654208:12345-192.168.202.56@tcp:58:cat.0 00010000:00010000:0.0:1786015560.821022:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.821158:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503271 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ffe expref: 121 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.821171:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c50329b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e900c expref: 121 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.821180:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c5032b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9013 expref: 121 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.821190:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 6/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.821248:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c5032b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9013 expref: 121 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.821267:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c5032b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9013 expref: 121 pid: 5794 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015560.821285:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304462720:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015560.821728:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c50329b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e900c expref: 121 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.821741:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c50329b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e900c expref: 121 pid: 7673 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015560.821752:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304462848:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015560.821826:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503271 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ffe expref: 121 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.821836:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503271 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ffe expref: 121 pid: 5796 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015560.821845:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304462976:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015560.821883:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b01b0840 going to sleep for 11 seconds 00000100:00100000:1.0:1786015560.833833:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280654336 00000100:00100000:1.0:1786015560.833866:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280654336 00000100:00100000:2.0:1786015560.833925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015560.833934:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1461 00000100:00100000:1.0:1786015560.833957:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+122:32796:x1872772280654336:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:1.0:1786015560.833988:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015560.834019:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5032cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e901a expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015560.834041:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015560.834069:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280654720 00000100:00100000:2.0:1786015560.834074:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280654720 00010000:00010000:2.0:1786015560.834100:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c5032b7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9013 expref: 124 pid: 5794 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015560.834127:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 435 00000100:00100000:2.0:1786015560.834134:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+124:2354:x1872772280654720:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015560.834145:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015560.834152:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c5032b7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9013 expref: 124 pid: 5794 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.834169:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c5032b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9013 expref: 124 pid: 5794 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.834206:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:2.0:1786015560.834213:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.834225:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015560.834290:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+124:2354:x1872772280654720:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 155us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015560.834298:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 435 00000100:00100000:2.0:1786015560.834330:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280654592 00000100:00100000:2.0:1786015560.834334:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280654592 00000100:00100000:2.0:1786015560.834381:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 296 00000100:00100000:2.0:1786015560.834389:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+124:32798:x1872772280654592:12345-192.168.202.56@tcp:35:cat.0 00010000:00010000:1.0:1786015560.834681:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5032d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.834696:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5032d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.834708:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5032d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015560.834745:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00000004:00200000:1.0:1786015560.834750:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015560.834797:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5032d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.834823:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5032cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e901a expref: 126 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.834843:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5032d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e901a expref: 125 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.834861:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:1.0:1786015560.834864:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015560.834867:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920a00, rc 0) 00000100:00100000:1.0:1786015560.834891:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+125:32796:x1872772280654336:12345-192.168.202.56@tcp:101:cat.0 Request processed in 939us (16904us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015560.834898:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1461 00000100:00100000:2.0:1786015560.836785:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+125:32798:x1872772280654592:12345-192.168.202.56@tcp:35:cat.0 Request processed in 250us (720us total) trans 4294968274 rc 0/0 00000100:00100000:2.0:1786015560.836825:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 296 00000100:00100000:3.0:1786015560.859186:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015560.859225:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015560.859266:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015560.859389:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280654976 00000100:00100000:1.0:1786015560.859401:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280654848 00000100:00100000:2.0:1786015560.859403:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280654976 00000100:00100000:1.0:1786015560.859405:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280654848 00010000:00010000:2.0:1786015560.859457:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c50329b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e900c expref: 125 pid: 7673 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015560.859462:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280655104 00000100:00100000:1.0:1786015560.859464:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280655104 00000100:00100000:1.0:1786015560.859486:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1462 00000100:00100000:2.0:1786015560.859491:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 436 00000100:00100000:2.0:1786015560.859500:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+126:2353:x1872772280654976:12345-192.168.202.56@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1786015560.859501:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+126:32799:x1872772280654848:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1786015560.859519:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015560.859524:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015560.859527:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c50329b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e900c expref: 126 pid: 7673 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.859542:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c50329b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e900c expref: 126 pid: 7673 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.859545:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5032da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9021 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.859570:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:2.0:1786015560.859575:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.859586:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015560.859631:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5032e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.859644:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5032e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.859655:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5032e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015560.859664:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+127:2353:x1872772280654976:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 166us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015560.859672:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 436 00000004:00200000:1.0:1786015560.859707:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00000004:00200000:1.0:1786015560.859713:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015560.859737:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5032e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.859749:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5032e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.859795:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5032da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9021 expref: 127 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.859815:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5032e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9021 expref: 126 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015560.859816:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1463 00000100:00100000:2.0:1786015560.859823:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+126:32800:x1872772280655104:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:1.0:1786015560.859823:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:1.0:1786015560.859826:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015560.859828:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920000, rc 0) 00010000:00010000:2.0:1786015560.859832:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015560.859841:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c5032e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9028 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015560.859873:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+127:32799:x1872772280654848:12345-192.168.202.56@tcp:101:cat.0 Request processed in 370us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015560.859880:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1462 00010000:00010000:2.0:1786015560.859900:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c5032ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.859915:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c5032ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.859923:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c5032ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015560.859940:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00000004:00200000:2.0:1786015560.859943:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015560.859953:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c5032ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.859973:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c5032e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9028 expref: 127 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.859986:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c5032ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9028 expref: 126 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.859994:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:2.0:1786015560.859996:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015560.859998:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481665400, rc 0) 00000100:00100000:2.0:1786015560.860019:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+126:32800:x1872772280655104:12345-192.168.202.56@tcp:101:cat.0 Request processed in 197us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015560.860025:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1463 00010000:00010000:0.0:1786015560.860322:0:5796:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.56@tcp) returned -22 from blocking AST (req@00000000dd6f60f1 x1872772304462720) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c5032b7 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9013 expref: 125 pid: 5794 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.860347:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c5032b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9013 expref: 125 pid: 5794 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015560.860362:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304462720:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015560.860381:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c50329b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e900c expref: 124 pid: 7673 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015560.860394:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304462848:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015560.860406:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304462976:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015560.860442:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:0.0:1786015560.860447:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.860456:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015560.867899:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015560.868732:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280655232 00000100:00100000:1.0:1786015560.868751:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280655232 00010000:00010000:1.0:1786015560.868833:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503271 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ffe expref: 124 pid: 5796 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015560.868900:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 437 00000100:00100000:1.0:1786015560.868914:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+124:2352:x1872772280655232:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015560.868948:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015560.868957:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503271 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ffe expref: 124 pid: 5796 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.868975:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503271 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ffe expref: 124 pid: 5796 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.869005:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503271 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8ffe expref: 124 pid: 5796 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.869025:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:1.0:1786015560.869042:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.869055:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.869064:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.869104:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015560.869208:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+123:2352:x1872772280655232:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 296us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015560.869217:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 437 00010000:00010000:0.0:1786015560.869683:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.869696:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786015560.869994:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].44, 136 off14176 00000100:00100000:0.0:1786015560.870105:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+122:32795:x1872772280654208:12345-192.168.202.56@tcp:58:cat.0 Request processed in 49290us (56194us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015560.870116:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1460 00000100:00100000:3.0:1786015560.874572:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015560.876219:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280655616 00000100:00100000:0.0:1786015560.876240:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280655616 00000100:00100000:0.0:1786015560.876343:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1464 00000100:00100000:0.0:1786015560.876356:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+122:32811:x1872772280655616:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1786015560.876388:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015560.876432:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5032f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e902f expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.876559:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5032fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.876577:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5032fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.876591:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5032fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.876610:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503304 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.876617:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.876624:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015560.876808:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:0.0:1786015560.876829:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50330b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.876841:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50330b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015560.876848:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280655360 00000100:00100000:2.0:1786015560.876867:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280655360 00010000:00010000:0.0:1786015560.876868:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50330b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015560.876884:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00000100:00100000:2.0:1786015560.876914:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 71 00000100:00100000:2.0:1786015560.876923:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+124:2354:x1872772280655360:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015560.876937:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015560.876959:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c5032ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9028 expref: 124 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.876980:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:2.0:1786015560.876987:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015560.877022:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50330b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877032:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50330b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877040:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50330b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877047:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.877053:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50330b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015560.877061:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+124:2354:x1872772280655360:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 138us (254us total) trans 0 rc 0/0 00010000:00010000:0.0:1786015560.877063:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50330b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015560.877075:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 71 00010000:00010000:0.0:1786015560.877079:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:0.0:1786015560.877084:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015560.877089:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50330b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877095:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50330b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877111:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5032fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877122:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5032fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877129:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5032fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877135:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.877138:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5032fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015560.877146:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:0.0:1786015560.877149:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5032fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877157:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015560.877160:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015560.877163:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5032fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877169:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5032fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877177:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877184:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503304 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877190:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503304 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877196:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.877200:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503304 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877206:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503304 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877213:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b748f24a100) 00010000:00010000:0.0:1786015560.877215:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015560.877218:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503304 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877223:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503304 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877272:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5032f6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e902f expref: 123 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877282:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015560.877285:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015560.877290:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5032f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e902f expref: 123 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877299:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7200, rc 0) 00000100:00100000:0.0:1786015560.877341:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+122:32811:x1872772280655616:12345-192.168.202.56@tcp:101:cat.0 Request processed in 989us (2784us total) trans 4294968275 rc 301/301 00000100:00100000:0.0:1786015560.877349:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1464 00000100:00100000:0.0:1786015560.877377:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280655744 00000100:00100000:0.0:1786015560.877382:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280655744 00000100:00100000:0.0:1786015560.877417:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 72 00000100:00100000:0.0:1786015560.877425:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabf5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+122:2351:x1872772280655744:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015560.877435:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015560.877446:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c5032e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9021 expref: 122 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.877459:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:0.0:1786015560.877462:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015560.877495:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabf5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+121:2351:x1872772280655744:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 71us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015560.877502:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 72 00000100:00100000:0.0:1786015560.878618:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304463104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015560.878684:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015560.878743:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304463104 00000100:00100000:0.0:1786015560.878751:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304463104 00000100:00100000:0.0:1786015560.878838:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1786015560.878847:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304463104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015560.878886:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 95223808 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015560.878930:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304463104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015560.878938:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:0.0:1786015560.878971:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015560.879012:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304463104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015560.890260:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015560.890301:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015560.892367:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015560.892433:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280656128 00000100:00100000:1.0:1786015560.892448:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280656128 00000100:00100000:1.0:1786015560.892541:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 297 00000100:00100000:1.0:1786015560.892553:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+121:32811:x1872772280656128:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:1.0:1786015560.894485:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+122:32811:x1872772280656128:12345-192.168.202.56@tcp:35:cat.0 Request processed in 1919us (2117us total) trans 4294968276 rc 0/0 00000100:00100000:1.0:1786015560.894503:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 297 00000100:00100000:3.0:1786015560.897793:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280655872 00000100:00100000:3.0:1786015560.897822:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280655872 00000100:00100000:3.0:1786015560.897904:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280656384 00000100:00100000:3.0:1786015560.897908:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280656384 00000100:00100000:3.0:1786015560.899133:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1465 00000100:00100000:3.0:1786015560.899158:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+123:32795:x1872772280655872:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:3.0:1786015560.899193:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015560.899225:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503319 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9036 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.900133:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.900155:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503319 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9036 expref: 124 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.900182:0:7673:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.900200:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503319 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9036 expref: 124 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.900219:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:3.0:1786015560.900223:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015560.900227:0:7673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503319 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9036 expref: 124 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.900240:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbdc00, rc 0) 00000100:00100000:3.0:1786015560.900340:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+124:32795:x1872772280655872:12345-192.168.202.56@tcp:101:cat.0 Request processed in 1190us (10096us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015560.902157:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1466 00000100:00100000:2.0:1786015560.902744:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+124:32812:x1872772280656384:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1786015560.902804:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015560.902841:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c503320 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e903d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.903293:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c503327 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.903316:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c503327 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.903332:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c503327 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.903353:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c50332e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.903366:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c50332e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.903374:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c50332e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.903563:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503335 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.903574:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.903582:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015560.903595:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1786015560.904758:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.904793:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503335 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.904802:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503335 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.904809:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386be00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015560.904815:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503335 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.904824:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503335 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.904848:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:2.0:1786015560.904861:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015560.904868:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503335 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.904874:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503335 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.904893:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c503327 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.904900:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c503327 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.904905:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c503327 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.904911:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488061e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015560.904914:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c503327 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.904920:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c503327 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.904926:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:2.0:1786015560.904929:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015560.904932:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c503327 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.905757:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061e00/0xb1a5ef690c503327 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.905878:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c50332e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.905886:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c50332e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.905894:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c50332e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.905900:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7488060a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015560.905905:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c50332e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.905913:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c50332e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.905926:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b7487f06700) 00010000:00010000:2.0:1786015560.905929:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015560.905933:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c50332e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.906401:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060a00/0xb1a5ef690c50332e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.906495:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c503320 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e903d expref: 126 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.906510:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:2.0:1786015560.906513:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786015560.906518:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061200/0xb1a5ef690c503320 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e903d expref: 126 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015560.906529:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7488061200, rc 0) 00000100:00100000:2.0:1786015560.906627:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+125:32812:x1872772280656384:12345-192.168.202.56@tcp:101:cat.0 Request processed in 4450us (16322us total) trans 4294968277 rc 301/301 00000100:00100000:2.0:1786015560.906638:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1466 00000100:00100000:3.0:1786015560.912703:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1465 00000100:00100000:1.0:1786015560.929582:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015560.929638:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280656640 00000100:00100000:1.0:1786015560.929691:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280656640 00000100:00100000:1.0:1786015560.929819:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 298 00000100:00100000:1.0:1786015560.929833:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+124:32812:x1872772280656640:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:1.0:1786015560.930197:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+125:32812:x1872772280656640:12345-192.168.202.56@tcp:35:cat.0 Request processed in 365us (631us total) trans 4294968278 rc 0/0 00000100:00100000:1.0:1786015560.930206:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 298 00000100:00100000:1.0:1786015560.930268:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015560.930690:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280656896 00000100:00100000:3.0:1786015560.930699:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280656896 00000100:00100000:3.0:1786015560.930746:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1467 00000100:00100000:3.0:1786015560.930755:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+125:32813:x1872772280656896:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:3.0:1786015560.930801:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015560.930834:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c503343 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9044 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.930939:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50334a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.930958:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50334a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.930973:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50334a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.930991:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503351 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.930999:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503351 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.931005:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503351 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.931162:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503358 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.931173:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.931515:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015560.931530:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:3.0:1786015560.931889:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.931898:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503358 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.931906:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503358 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.931912:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015560.931918:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503358 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.931927:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503358 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.931942:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:3.0:1786015560.931946:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015560.931953:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503358 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.931964:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503358 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.931984:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50334a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.931990:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50334a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.931996:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50334a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.932001:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015560.932005:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50334a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.932012:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50334a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.932019:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:3.0:1786015560.932021:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015560.932024:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50334a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.932030:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c50334a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.932039:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503351 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.932046:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503351 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.932053:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503351 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.932058:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015560.932061:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503351 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.932067:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503351 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.932074:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b74b0022500) 00010000:00010000:3.0:1786015560.932077:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015560.932079:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503351 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.932085:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503351 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.932144:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c503343 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9044 expref: 127 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.932158:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:3.0:1786015560.932161:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786015560.932164:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c503343 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9044 expref: 127 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.932175:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc400, rc 0) 00000100:00100000:3.0:1786015560.932255:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+126:32813:x1872772280656896:12345-192.168.202.56@tcp:101:cat.0 Request processed in 1500us (1985us total) trans 4294968279 rc 301/301 00000100:00100000:3.0:1786015560.932269:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1467 00000100:00100000:3.0:1786015560.938122:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015560.938195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015560.938235:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280657408 00000100:00100000:3.0:1786015560.938249:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280657408 00000100:00100000:3.0:1786015560.938317:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1468 00000100:00100000:3.0:1786015560.938328:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+126:32817:x1872772280657408:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:3.0:1786015560.938366:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015560.938397:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503366 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e904b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.938521:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c50336d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.938540:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c50336d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.938554:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c50336d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.938572:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503374 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.938580:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.938585:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.938751:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50337b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.938786:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50337b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.938793:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50337b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015560.938806:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:3.0:1786015560.938936:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50337b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.938945:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50337b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.938953:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50337b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.938959:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015560.938964:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50337b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.938972:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50337b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.938987:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:3.0:1786015560.938990:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015560.938996:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50337b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.939003:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50337b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.939025:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c50336d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.939032:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c50336d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.939039:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c50336d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.939044:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73829f9600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015560.939047:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c50336d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.939053:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c50336d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.939061:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:3.0:1786015560.939064:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015560.939067:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c50336d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.939073:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c50336d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.939082:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.939090:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503374 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.939096:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503374 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.939102:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015560.939106:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503374 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.939112:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503374 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.939119:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b74b0022600) 00010000:00010000:3.0:1786015560.939121:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015560.939124:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503374 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.939130:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503374 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.939180:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503366 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e904b expref: 128 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.939191:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:3.0:1786015560.939194:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786015560.939197:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503366 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e904b expref: 128 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015560.939207:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73829f9400, rc 0) 00000100:00100000:3.0:1786015560.939295:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+127:32817:x1872772280657408:12345-192.168.202.56@tcp:101:cat.0 Request processed in 968us (1099us total) trans 4294968280 rc 301/301 00000100:00100000:3.0:1786015560.939304:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1468 00000100:00100000:2.0:1786015560.940045:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280657152 00000100:00100000:2.0:1786015560.940058:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280657152 00000100:00100000:2.0:1786015560.940136:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 299 00000100:00100000:2.0:1786015560.940146:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916ae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+127:32813:x1872772280657152:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:2.0:1786015560.940398:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916ae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+128:32813:x1872772280657152:12345-192.168.202.56@tcp:35:cat.0 Request processed in 252us (2291us total) trans 4294968281 rc 0/0 00000100:00100000:2.0:1786015560.940407:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 299 00000100:00100000:3.0:1786015560.950284:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015560.950387:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015560.950522:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280657664 00000100:00100000:1.0:1786015560.950538:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280657664 00000100:00100000:1.0:1786015560.950663:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 300 00000100:00100000:1.0:1786015560.950677:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+128:32817:x1872772280657664:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:0.0:1786015560.950687:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280657920 00000100:00100000:0.0:1786015560.950692:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280657920 00000100:00100000:0.0:1786015560.950730:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1469 00000100:00100000:0.0:1786015560.950736:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+129:32826:x1872772280657920:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1786015560.950751:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015560.950805:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503389 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9052 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.950911:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503390 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.950929:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503390 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.950943:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503390 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.950959:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503397 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.950966:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.950973:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015560.951076:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+131:32817:x1872772280657664:12345-192.168.202.56@tcp:35:cat.0 Request processed in 402us (807us total) trans 4294968282 rc 0/0 00000100:00100000:1.0:1786015560.951084:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 300 00010000:00010000:0.0:1786015560.951114:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c50339e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951130:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c50339e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951137:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c50339e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015560.951150:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1786015560.951217:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c50339e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951227:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c50339e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951234:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c50339e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951242:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.951248:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c50339e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951256:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c50339e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951273:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:0.0:1786015560.951277:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015560.951284:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c50339e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951365:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c50339e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951384:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503390 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951389:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503390 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951395:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503390 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951404:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.951407:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503390 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951412:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503390 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951420:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015560.951423:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015560.951427:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503390 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951432:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503390 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951441:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951447:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503397 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951453:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503397 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951458:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.951461:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503397 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951468:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503397 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951480:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b748f24a100) 00010000:00010000:0.0:1786015560.951482:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015560.951485:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503397 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951673:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c503397 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951724:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503389 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9052 expref: 131 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951735:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015560.951738:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015560.951741:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503389 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9052 expref: 131 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.951750:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6c00, rc 0) 00000100:00100000:0.0:1786015560.951830:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+130:32826:x1872772280657920:12345-192.168.202.56@tcp:101:cat.0 Request processed in 1093us (1442us total) trans 4294968283 rc 301/301 00000100:00100000:0.0:1786015560.951932:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1469 00000100:00100000:1.0:1786015560.954218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015560.954278:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015560.954317:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280658304 00000100:00100000:1.0:1786015560.954330:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280658304 00000100:00100000:0.0:1786015560.954398:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280658432 00000100:00100000:0.0:1786015560.954403:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280658432 00000100:00100000:1.0:1786015560.954406:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1470 00000100:00100000:1.0:1786015560.954428:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+131:32822:x1872772280658304:12345-192.168.202.56@tcp:101:cat.0 00000100:00100000:0.0:1786015560.954453:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 301 00000100:00100000:0.0:1786015560.954459:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+131:32826:x1872772280658432:12345-192.168.202.56@tcp:35:cat.0 00010000:00010000:1.0:1786015560.954466:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015560.954508:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5033ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9059 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.954595:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5033b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.954612:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5033b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.954628:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5033b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.954645:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5033ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.954651:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5033ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.954657:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5033ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015560.954801:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+133:32826:x1872772280658432:12345-192.168.202.56@tcp:35:cat.0 Request processed in 341us (597us total) trans 4294968284 rc 0/0 00000100:00100000:0.0:1786015560.954809:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 301 00010000:00010000:1.0:1786015560.954823:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5033c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.954834:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5033c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.954842:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5033c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015560.954864:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:1.0:1786015560.954925:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5033c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.954933:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5033c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.954940:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5033c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.954948:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015560.954953:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5033c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.954961:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5033c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.954976:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:1.0:1786015560.954980:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015560.954986:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5033c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.954993:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5033c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.955014:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5033b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.955020:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5033b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.955026:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5033b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.955031:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015560.955034:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5033b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.955041:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5033b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.955048:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:1.0:1786015560.955051:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015560.955054:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5033b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.955061:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5033b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.955070:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5033ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.955075:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5033ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.955081:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5033ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.955087:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015560.955090:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5033ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.955096:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5033ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.955102:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b748f194c00) 00010000:00010000:1.0:1786015560.955105:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015560.955107:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5033ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.955113:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5033ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.955155:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5033ac lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9059 expref: 133 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.955168:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:1.0:1786015560.955170:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786015560.955173:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5033ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9059 expref: 133 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.955182:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920200, rc 0) 00000100:00100000:1.0:1786015560.955209:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+132:32822:x1872772280658304:12345-192.168.202.56@tcp:101:cat.0 Request processed in 795us (930us total) trans 4294968285 rc 301/301 00000100:00100000:1.0:1786015560.955216:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1470 00000100:00100000:1.0:1786015560.960490:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015560.960796:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280658688 00000100:00100000:0.0:1786015560.960811:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280658688 00000100:00100000:0.0:1786015560.960896:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1471 00000100:00100000:0.0:1786015560.960908:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+132:32816:x1872772280658688:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1786015560.960954:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015560.960990:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5033cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9060 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961105:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c5033d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961123:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c5033d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961137:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c5033d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961153:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5033dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961160:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5033dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961167:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5033dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961364:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5033e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961375:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5033e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961388:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5033e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015560.961400:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1786015560.961524:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5033e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961532:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5033e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961539:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5033e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961545:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.961550:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5033e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961557:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5033e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961571:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:0.0:1786015560.961574:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015560.961580:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5033e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961586:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5033e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961600:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c5033d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961612:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c5033d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961619:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c5033d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961624:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.961627:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c5033d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961634:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c5033d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961641:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015560.961644:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015560.961647:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c5033d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961653:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c5033d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961661:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5033dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961667:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5033dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961674:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5033dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961679:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.961682:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5033dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961689:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5033dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961696:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b748f24a100) 00010000:00010000:0.0:1786015560.961698:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015560.961701:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5033dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961707:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c5033dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961798:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5033cf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9060 expref: 134 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961811:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015560.961813:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015560.961817:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5033cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9060 expref: 134 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.961828:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6c00, rc 0) 00000100:00100000:0.0:1786015560.961922:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+133:32816:x1872772280658688:12345-192.168.202.56@tcp:101:cat.0 Request processed in 1017us (1449us total) trans 4294968286 rc 301/301 00000100:00100000:0.0:1786015560.961932:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1471 00000100:00100000:1.0:1786015560.962997:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015560.963312:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280658944 00000100:00100000:0.0:1786015560.963327:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280658944 00000100:00100000:0.0:1786015560.963457:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 302 00000100:00100000:0.0:1786015560.963470:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+133:32822:x1872772280658944:12345-192.168.202.56@tcp:35:cat.0 00000001:00080000:2.0:1786015560.964546:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967374 is committed 00000100:00100000:0.0:1786015560.969079:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+134:32822:x1872772280658944:12345-192.168.202.56@tcp:35:cat.0 Request processed in 5588us (6062us total) trans 4294968287 rc 0/0 00000100:00100000:0.0:1786015560.969099:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 302 00000100:00100000:2.0:1786015560.969249:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015560.969754:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280659200 00000100:00100000:0.0:1786015560.969848:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280659200 00000100:00100000:0.0:1786015560.970024:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1472 00000100:00100000:0.0:1786015560.970047:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+134:32814:x1872772280659200:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1786015560.970084:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015560.970116:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c5033f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9067 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970238:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5033f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970258:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5033f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970273:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5033f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970293:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503400 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970300:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970307:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970505:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503407 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970516:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970524:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015560.970537:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1786015560.970660:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970668:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503407 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970674:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503407 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970681:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.970686:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503407 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970694:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503407 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970708:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:0.0:1786015560.970711:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015560.970717:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503407 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970724:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503407 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970747:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5033f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970754:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5033f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970792:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5033f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970799:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.970801:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5033f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970809:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5033f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970816:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015560.970819:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015560.970823:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5033f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970829:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5033f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970839:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970846:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503400 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970863:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503400 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970869:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.970872:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503400 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970878:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503400 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970887:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b748f24ab00) 00010000:00010000:0.0:1786015560.970890:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015560.970893:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503400 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970899:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503400 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970963:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c5033f2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9067 expref: 136 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970975:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015560.970977:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015560.970981:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c5033f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9067 expref: 136 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.970993:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6400, rc 0) 00000100:00100000:0.0:1786015560.971089:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+135:32814:x1872772280659200:12345-192.168.202.56@tcp:101:cat.0 Request processed in 1055us (1840us total) trans 4294968288 rc 301/301 00000100:00100000:0.0:1786015560.971099:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1472 00000100:00100000:2.0:1786015560.975676:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015560.975734:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015560.975859:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280659456 00000100:00100000:1.0:1786015560.975873:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280659456 00000100:00100000:1.0:1786015560.975965:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 303 00000100:00100000:1.0:1786015560.975976:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+135:32816:x1872772280659456:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:1.0:1786015560.976320:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+136:32816:x1872772280659456:12345-192.168.202.56@tcp:35:cat.0 Request processed in 344us (659us total) trans 4294968289 rc 0/0 00000100:00100000:1.0:1786015560.976328:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 303 00000100:00100000:0.0:1786015560.976490:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280659712 00000100:00100000:0.0:1786015560.976495:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280659712 00000100:00100000:0.0:1786015560.976537:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1473 00000100:00100000:0.0:1786015560.976545:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+136:32819:x1872772280659712:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1786015560.976561:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015560.976588:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503415 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e906e expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.976667:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50341c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.976685:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50341c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.976700:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50341c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.976716:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.976724:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.976731:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.976930:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50342a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.976941:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50342a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.976949:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50342a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015560.976963:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1786015560.977043:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50342a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977052:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50342a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977060:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50342a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977067:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.977073:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50342a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977082:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50342a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977097:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:0.0:1786015560.977100:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015560.977106:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50342a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977113:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50342a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977131:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50341c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977137:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50341c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977148:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50341c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977153:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.977157:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50341c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977164:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50341c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977172:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015560.977174:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015560.977178:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50341c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977184:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c50341c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977193:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977200:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503423 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977206:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977211:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.977214:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977224:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503423 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977232:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b748f24a100) 00010000:00010000:0.0:1786015560.977234:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015560.977237:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503423 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977242:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503423 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977287:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503415 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e906e expref: 138 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977298:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015560.977301:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015560.977304:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503415 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e906e expref: 138 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.977314:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7800, rc 0) 00000100:00100000:0.0:1786015560.977378:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+137:32819:x1872772280659712:12345-192.168.202.56@tcp:101:cat.0 Request processed in 833us (1643us total) trans 4294968290 rc 301/301 00000100:00100000:0.0:1786015560.977386:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1473 00000100:00100000:3.0:1786015560.979925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015560.980049:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280659968 00000100:00100000:0.0:1786015560.980063:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280659968 00000100:00100000:0.0:1786015560.980143:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1474 00000100:00100000:0.0:1786015560.980156:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+137:32810:x1872772280659968:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1786015560.980191:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015560.980218:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503438 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9075 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980324:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c50343f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980342:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c50343f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980355:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c50343f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980375:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503446 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980382:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980390:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980592:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c50344d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980604:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c50344d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980611:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c50344d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015560.980626:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1786015560.980814:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c50344d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980823:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c50344d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980831:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c50344d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980838:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.980843:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c50344d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980862:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c50344d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980878:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:0.0:1786015560.980882:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015560.980889:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c50344d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980896:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c50344d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980918:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c50343f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980924:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c50343f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980930:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c50343f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980940:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.980944:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c50343f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980950:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c50343f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980957:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015560.980960:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015560.980963:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c50343f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980968:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c50343f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980977:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980983:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503446 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980990:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503446 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.980996:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015560.980999:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503446 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.981006:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503446 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.981018:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b748f24ac00) 00010000:00010000:0.0:1786015560.981020:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015560.981023:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503446 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.981029:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503446 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.981084:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503438 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9075 expref: 139 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.981096:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:0.0:1786015560.981098:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786015560.981102:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503438 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9075 expref: 139 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015560.981112:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6c00, rc 0) 00000100:00100000:0.0:1786015560.981199:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+138:32810:x1872772280659968:12345-192.168.202.56@tcp:101:cat.0 Request processed in 1046us (1289us total) trans 4294968291 rc 301/301 00000100:00100000:0.0:1786015560.981208:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1474 00000100:00100000:3.0:1786015560.986886:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015560.986958:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280660224 00000100:00100000:2.0:1786015560.986973:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280660224 00000100:00100000:1.0:1786015560.987068:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015560.987081:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 304 00000100:00100000:2.0:1786015560.987093:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+138:32814:x1872772280660224:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:1.0:1786015560.987098:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280660480 00000100:00100000:1.0:1786015560.987101:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280660480 00000100:00100000:1.0:1786015560.987134:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1475 00000100:00100000:1.0:1786015560.987141:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+139:32820:x1872772280660480:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:1.0:1786015560.987153:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015560.987181:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50345b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e907c expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987264:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c503462 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987281:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c503462 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987294:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c503462 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987308:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503469 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987318:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987325:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015560.987424:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+141:32814:x1872772280660224:12345-192.168.202.56@tcp:35:cat.0 Request processed in 321us (545us total) trans 4294968292 rc 0/0 00000100:00100000:2.0:1786015560.987432:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 304 00010000:00010000:1.0:1786015560.987467:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c503470 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987477:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c503470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987484:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c503470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015560.987496:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:1.0:1786015560.987557:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c503470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987565:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c503470 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987572:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c503470 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987580:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015560.987584:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c503470 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987592:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c503470 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987611:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:1.0:1786015560.987615:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015560.987621:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c503470 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987628:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c503470 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987643:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c503462 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987649:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c503462 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987655:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c503462 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987661:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015560.987664:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c503462 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987671:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c503462 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987678:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:1.0:1786015560.987681:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015560.987684:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c503462 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987690:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c503462 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987703:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987710:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503469 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987717:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503469 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987722:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015560.987725:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503469 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987731:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503469 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987739:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b748f194c00) 00010000:00010000:1.0:1786015560.987741:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015560.987744:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503469 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987750:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503469 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987863:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50345b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e907c expref: 141 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987877:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:1.0:1786015560.987880:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786015560.987884:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50345b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e907c expref: 141 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.987895:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920200, rc 0) 00000100:00100000:1.0:1786015560.987936:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+140:32820:x1872772280660480:12345-192.168.202.56@tcp:101:cat.0 Request processed in 795us (869us total) trans 4294968293 rc 301/301 00000100:00100000:1.0:1786015560.987943:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1475 00000100:00100000:2.0:1786015560.991224:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015560.991405:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280660736 00000100:00100000:1.0:1786015560.991420:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280660736 00000100:00100000:1.0:1786015560.991679:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 305 00000100:00100000:1.0:1786015560.991693:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916af850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+140:32819:x1872772280660736:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:1.0:1786015560.992447:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916af850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+141:32819:x1872772280660736:12345-192.168.202.56@tcp:35:cat.0 Request processed in 751us (1234us total) trans 4294968294 rc 0/0 00000100:00100000:1.0:1786015560.992459:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 305 00000100:00100000:3.0:1786015560.994156:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015560.994277:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280660992 00000100:00100000:1.0:1786015560.994362:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280660992 00000100:00100000:1.0:1786015560.994470:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1476 00000100:00100000:1.0:1786015560.994484:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+141:32821:x1872772280660992:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:1.0:1786015560.994541:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015560.994572:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c50347e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9083 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.994681:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503485 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.994702:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503485 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.994721:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503485 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.994738:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50348c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.994745:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50348c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.994752:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50348c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.994978:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503493 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.994990:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.994998:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015560.995013:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:1.0:1786015560.995426:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995435:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503493 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995441:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995448:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015560.995453:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995462:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503493 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995477:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:1.0:1786015560.995481:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015560.995486:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503493 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995503:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503493 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995525:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503485 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995532:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503485 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995537:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503485 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995543:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015560.995546:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503485 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995552:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503485 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995560:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:1.0:1786015560.995563:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015560.995567:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503485 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995573:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503485 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995582:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50348c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995588:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50348c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995594:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50348c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995600:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015560.995603:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50348c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995609:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50348c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995616:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b748f194700) 00010000:00010000:1.0:1786015560.995618:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015560.995621:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50348c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995626:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c50348c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995688:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c50347e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9083 expref: 143 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995706:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:1.0:1786015560.995709:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786015560.995713:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c50347e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9083 expref: 143 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015560.995724:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921a00, rc 0) 00000100:00100000:1.0:1786015560.996212:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+142:32821:x1872772280660992:12345-192.168.202.56@tcp:101:cat.0 Request processed in 1728us (2067us total) trans 4294968295 rc 301/301 00000100:00100000:1.0:1786015560.996224:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1476 00000100:00100000:2.0:1786015560.996673:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015560.996718:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280661248 00000100:00100000:2.0:1786015560.996729:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280661248 00000100:00100000:2.0:1786015560.996827:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 306 00000100:00100000:2.0:1786015560.996839:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+142:32810:x1872772280661248:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:2.0:1786015560.997248:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+143:32810:x1872772280661248:12345-192.168.202.56@tcp:35:cat.0 Request processed in 410us (575us total) trans 4294968296 rc 0/0 00000100:00100000:2.0:1786015560.997256:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 306 00000100:00100000:3.0:1786015561.000417:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015561.001077:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280661504 00000100:00100000:2.0:1786015561.001094:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280661504 00000100:00100000:2.0:1786015561.001210:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1477 00000100:00100000:2.0:1786015561.001222:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+143:32815:x1872772280661504:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1786015561.001257:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015561.001287:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5034a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e908a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.001420:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5034a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.001440:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5034a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.001455:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5034a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.001473:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c5034af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.001481:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c5034af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.001696:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c5034af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.001905:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5034b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.001917:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5034b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.001926:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5034b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015561.002002:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1786015561.002133:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5034b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002142:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5034b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002149:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5034b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002157:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386ae00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015561.002161:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5034b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002169:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5034b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002184:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:2.0:1786015561.002187:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015561.002193:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5034b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002199:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c5034b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002218:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5034a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002225:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5034a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002230:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5034a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002236:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386b400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015561.002239:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5034a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002245:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5034a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002252:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:2.0:1786015561.002255:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015561.002258:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5034a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002264:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c5034a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002273:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c5034af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002279:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c5034af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002286:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c5034af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002355:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386b200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015561.002359:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c5034af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002366:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c5034af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002372:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b7487f06700) 00010000:00010000:2.0:1786015561.002374:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015561.002376:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c5034af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002380:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c5034af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002430:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5034a1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e908a expref: 145 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002441:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:2.0:1786015561.002443:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786015561.002446:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c5034a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e908a expref: 145 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.002457:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386b000, rc 0) 00000100:00100000:2.0:1786015561.002599:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+144:32815:x1872772280661504:12345-192.168.202.56@tcp:101:cat.0 Request processed in 1378us (2197us total) trans 4294968297 rc 301/301 00000100:00100000:2.0:1786015561.002609:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1477 00000100:00100000:3.0:1786015561.003217:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015561.003365:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280661760 00000100:00100000:0.0:1786015561.003377:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280661760 00000100:00100000:0.0:1786015561.003447:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 307 00000100:00100000:0.0:1786015561.003456:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+144:32820:x1872772280661760:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:0.0:1786015561.003750:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+145:32820:x1872772280661760:12345-192.168.202.56@tcp:35:cat.0 Request processed in 294us (535us total) trans 4294968298 rc 0/0 00000100:00100000:0.0:1786015561.003756:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 307 00000040:00080000:1.0:1786015561.004178:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015561.004185:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015561.004233:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 45 count 4 00000040:00080000:1.0:1786015561.004241:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015561.004683:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304463232:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015561.004802:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf8a1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786015561.005953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015561.006030:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280662016 00000100:00100000:1.0:1786015561.006050:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280662016 00000100:00100000:1.0:1786015561.006132:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1478 00000100:00100000:1.0:1786015561.006144:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+145:32808:x1872772280662016:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:1.0:1786015561.006180:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015561.006214:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5034c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9091 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006327:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5034cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006350:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5034cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006364:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5034cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006382:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c5034d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006390:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c5034d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006397:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c5034d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006667:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5034d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006678:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5034d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006686:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5034d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015561.006699:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:1.0:1786015561.006876:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5034d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006885:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5034d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006891:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5034d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006898:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920400 already unused, calling callback (ffffffffc20624f0) 00000100:00100000:2.0:1786015561.006902:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304463232:192.168.202.56@tcp:107:hsm_cdtr.0 00010000:00010000:1.0:1786015561.006903:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5034d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006912:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5034d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006927:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:1.0:1786015561.006930:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015561.006936:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5034d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006949:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920400/0xb1a5ef690c5034d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006970:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5034cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006975:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5034cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006981:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5034cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006987:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015561.006989:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5034cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.006995:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5034cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.007007:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:1.0:1786015561.007009:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015561.007012:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5034cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.007019:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5034cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.007027:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c5034d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.007033:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c5034d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.007039:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c5034d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.007045:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015561.007047:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c5034d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.007053:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c5034d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.007059:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b748f194c00) 00010000:00010000:1.0:1786015561.007061:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015561.007064:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c5034d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.007070:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c5034d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.007128:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5034c4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9091 expref: 147 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.007140:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:1.0:1786015561.007143:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786015561.007146:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5034c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9091 expref: 147 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.007156:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920200, rc 0) 00000100:00100000:1.0:1786015561.007234:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+146:32808:x1872772280662016:12345-192.168.202.56@tcp:101:cat.0 Request processed in 1092us (1286us total) trans 4294968299 rc 301/301 00000100:00100000:1.0:1786015561.007244:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1478 00000100:00100000:3.0:1786015561.008576:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015561.008621:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280662144 00000100:00100000:1.0:1786015561.008633:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280662144 00000100:00100000:0.0:1786015561.008795:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1479 00000100:00100000:0.0:1786015561.008810:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32827:x1872772280662144:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015561.008867:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x52:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015561.009012:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32827:x1872772280662144:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 205us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015561.009023:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1479 00000100:00100000:3.0:1786015561.010701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015561.011389:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280662400 00000100:00100000:2.0:1786015561.011403:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280662400 00000100:00100000:3.0:1786015561.011724:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015561.011789:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015561.011814:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280662528 00000100:00100000:3.0:1786015561.011819:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280662528 00000100:00100000:3.0:1786015561.011885:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280662784 00000100:00100000:3.0:1786015561.011889:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280662784 00000100:00100000:3.0:1786015561.011915:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1480 00000100:00100000:3.0:1786015561.011926:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32827:x1872772280662528:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00000100:00100000:2.0:1786015561.011929:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 308 00000100:00100000:2.0:1786015561.011935:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+147:32821:x1872772280662400:12345-192.168.202.56@tcp:35:cat.0 00010000:00010000:3.0:1786015561.012037:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5034e7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012060:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5034e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012076:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5034e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012096:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5034ee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012103:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5034ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012112:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5034ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012141:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5034f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012150:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5034f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012156:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5034f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015561.012259:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1481 00000100:00100000:1.0:1786015561.012270:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+147:32825:x1872772280662784:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:1.0:1786015561.012283:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015561.012310:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5034fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9098 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.012371:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503503 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.012380:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503503 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.012388:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503503 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.012402:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50350a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015561.012404:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+149:32821:x1872772280662400:12345-192.168.202.56@tcp:35:cat.0 Request processed in 467us (1713us total) trans 4294968300 rc 0/0 00010000:00010000:1.0:1786015561.012410:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50350a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.012416:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50350a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015561.012479:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 308 00010000:00010000:1.0:1786015561.012555:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503511 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.012562:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.012568:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015561.012576:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00000004:00200000:3.0:1786015561.012805:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00000004:00200000:3.0:1786015561.012810:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015561.012824:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5034f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012837:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5034e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012845:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5034e7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012863:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5034e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012870:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015561.012876:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5034e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012884:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5034e7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012900:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:3.0:1786015561.012903:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015561.012909:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5034e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012916:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5034e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012933:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5034ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012939:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5034ee lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012945:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5034ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012950:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015561.012953:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5034ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012959:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5034ee lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012966:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x8138294e (ffff8b74b0022600) 00010000:00010000:3.0:1786015561.012968:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015561.012971:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5034ee lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012977:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5034ee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.012996:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5034f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.013003:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5034f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.013009:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5034f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.013015:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015561.013018:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5034f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.013024:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5034f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.013031:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:3.0:1786015561.013034:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015561.013037:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5034f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.013043:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5034f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015561.013088:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32827:x1872772280662528:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 1163us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015561.013096:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1480 00010000:00010000:1.0:1786015561.013464:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013474:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503511 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013480:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503511 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013485:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015561.013488:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503511 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013499:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503511 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013509:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:1.0:1786015561.013512:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015561.013515:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503511 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013521:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503511 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013536:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503503 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013542:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503503 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013548:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503503 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013553:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015561.013556:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503503 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013647:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503503 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013657:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:1.0:1786015561.013659:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015561.013662:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503503 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013673:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503503 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013685:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50350a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013692:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50350a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013698:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50350a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013703:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015561.013706:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50350a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013713:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50350a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013721:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b748f194700) 00010000:00010000:1.0:1786015561.013723:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015561.013726:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50350a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013732:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50350a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013810:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5034fc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9098 expref: 149 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013827:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:1.0:1786015561.013830:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786015561.013834:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5034fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9098 expref: 149 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.013844:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921a00, rc 0) 00000100:00100000:1.0:1786015561.013901:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+148:32825:x1872772280662784:12345-192.168.202.56@tcp:101:cat.0 Request processed in 1634us (2111us total) trans 4294968301 rc 301/301 00000100:00100000:1.0:1786015561.013909:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1481 00000100:00100000:3.0:1786015561.020351:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015561.020891:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280663040 00000100:00100000:1.0:1786015561.020906:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280663040 00000100:00100000:0.0:1786015561.021023:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015561.021080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015561.021254:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280663552 00000100:00100000:1.0:1786015561.021258:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280663552 00000100:00100000:2.0:1786015561.021313:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280663296 00000100:00100000:2.0:1786015561.021318:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280663296 00000100:00100000:3.0:1786015561.021329:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1482 00000100:00100000:3.0:1786015561.021343:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32827:x1872772280663040:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015561.021375:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1786015561.021378:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 309 00000100:00100000:2.0:1786015561.021385:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+149:32815:x1872772280663296:12345-192.168.202.56@tcp:35:cat.0 00010000:00010000:3.0:1786015561.021402:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50351f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e909f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.021541:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503526 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.021559:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.021572:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015561.021586:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:3.0:1786015561.021641:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.021649:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503526 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.021657:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503526 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.021665:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015561.021671:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503526 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.021679:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503526 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.021693:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:3.0:1786015561.021698:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015561.021703:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503526 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.021710:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503526 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.021779:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50351f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e909f expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.021791:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b7482d4b400) 00010000:00010000:3.0:1786015561.021793:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786015561.021797:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50351f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e909f expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.021809:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afce00, rc 0) 00000100:00100000:3.0:1786015561.021882:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+55:32827:x1872772280663040:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 543us (1547us total) trans 4294968303 rc 301/301 00000100:00100000:3.0:1786015561.021890:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1482 00000100:00100000:2.0:1786015561.021893:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+150:32815:x1872772280663296:12345-192.168.202.56@tcp:35:cat.0 Request processed in 510us (874us total) trans 4294968302 rc 0/0 00000100:00100000:2.0:1786015561.021900:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 309 00000100:00100000:3.0:1786015561.021915:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1483 00000100:00100000:3.0:1786015561.021922:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+149:32824:x1872772280663552:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:3.0:1786015561.021932:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015561.021952:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503534 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e90a6 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.021998:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50353b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022008:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50353b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022017:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50353b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022030:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c503542 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022038:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c503542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022045:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c503542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022183:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503549 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022190:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022194:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015561.022200:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:3.0:1786015561.022234:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022239:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503549 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022243:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022246:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015561.022249:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022254:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503549 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022259:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:3.0:1786015561.022260:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015561.022262:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503549 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022266:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503549 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022273:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50353b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022278:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50353b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022281:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50353b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022284:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afcc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015561.022285:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50353b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022288:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50353b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022292:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:3.0:1786015561.022293:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015561.022296:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50353b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022300:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50353b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022305:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c503542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022308:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c503542 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022311:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c503542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022313:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015561.022315:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c503542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022318:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c503542 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022321:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b74b0022c00) 00010000:00010000:3.0:1786015561.022322:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015561.022324:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c503542 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022327:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c503542 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022347:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503534 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90a6 expref: 151 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022356:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:3.0:1786015561.022358:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786015561.022360:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503534 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90a6 expref: 151 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.022365:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc200, rc 0) 00000100:00100000:3.0:1786015561.022383:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+150:32824:x1872772280663552:12345-192.168.202.56@tcp:101:cat.0 Request processed in 463us (1305us total) trans 4294968304 rc 301/301 00000100:00100000:3.0:1786015561.022387:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1483 00000100:00100000:3.0:1786015561.025565:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015561.025672:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280663936 00000100:00100000:1.0:1786015561.025686:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280663936 00000100:00100000:0.0:1786015561.025843:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015561.025953:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015561.026316:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1484 00000100:00100000:1.0:1786015561.026329:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+150:32823:x1872772280663936:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:1.0:1786015561.026356:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015561.026382:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503557 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e90ad expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026476:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50355e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026493:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50355e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026504:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50355e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026518:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503565 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026523:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026527:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026678:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50356c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026688:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50356c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026695:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50356c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015561.026706:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:1.0:1786015561.026867:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50356c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026873:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50356c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026878:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50356c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026882:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015561.026886:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50356c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026896:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50356c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026908:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:1.0:1786015561.026910:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015561.026914:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50356c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026918:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50356c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026932:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50355e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026936:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50355e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026951:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50355e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026956:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015561.026959:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50355e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026965:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50355e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026972:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:1.0:1786015561.026975:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015561.026978:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50355e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026989:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50355e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.026998:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.027002:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503565 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.027006:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503565 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.027009:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015561.027010:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503565 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.027014:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503565 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.027018:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b748f194700) 00010000:00010000:1.0:1786015561.027019:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015561.027021:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503565 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.027024:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503565 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.027070:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503557 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90ad expref: 152 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.027087:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:1.0:1786015561.027089:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786015561.027092:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503557 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90ad expref: 152 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.027103:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921a00, rc 0) 00000100:00100000:1.0:1786015561.027190:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+151:32823:x1872772280663936:12345-192.168.202.56@tcp:101:cat.0 Request processed in 865us (1640us total) trans 4294968305 rc 301/301 00000100:00100000:1.0:1786015561.027197:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1484 00000100:00100000:1.0:1786015561.027223:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280663680 00000100:00100000:1.0:1786015561.027228:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280663680 00000100:00100000:3.0:1786015561.027727:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1485 00000100:00100000:3.0:1786015561.027742:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+55:32827:x1872772280663680:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015561.027845:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x52:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015561.028052:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280664192 00000100:00100000:2.0:1786015561.028058:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280664192 00000100:00100000:2.0:1786015561.028152:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 310 00000100:00100000:2.0:1786015561.028161:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+151:32808:x1872772280664192:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:3.0:1786015561.028378:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+55:32827:x1872772280663680:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 640us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015561.028386:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1485 00000100:00100000:2.0:1786015561.028566:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+152:32808:x1872772280664192:12345-192.168.202.56@tcp:35:cat.0 Request processed in 406us (2612us total) trans 4294968306 rc 0/0 00000100:00100000:2.0:1786015561.028574:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 310 00000100:00100000:1.0:1786015561.030359:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015561.030722:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280664448 00000100:00100000:2.0:1786015561.030735:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280664448 00000100:00100000:2.0:1786015561.030947:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1486 00000100:00100000:2.0:1786015561.030961:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+152:32818:x1872772280664448:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1786015561.030994:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015561.031024:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c50357a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e90b4 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031131:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503581 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031150:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503581 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031165:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503581 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031182:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c503588 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031189:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c503588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031195:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c503588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031367:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c50358f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031378:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c50358f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031385:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c50358f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015561.031397:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1786015561.031529:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c50358f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031537:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c50358f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031543:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c50358f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031550:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386ae00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015561.031555:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c50358f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031564:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c50358f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031579:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:2.0:1786015561.031583:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015561.031589:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c50358f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031596:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c50358f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031616:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503581 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031621:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503581 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031632:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503581 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031637:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386b200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015561.031640:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503581 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031647:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503581 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031654:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:2.0:1786015561.031657:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015561.031660:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503581 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031665:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503581 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031674:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c503588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031679:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c503588 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031685:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c503588 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031690:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386b400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015561.031692:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c503588 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031702:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c503588 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031709:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8b7487f06700) 00010000:00010000:2.0:1786015561.031711:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015561.031714:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c503588 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.031719:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c503588 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015561.034452:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:2.0:1786015561.034576:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c50357a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90b4 expref: 154 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.034613:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:2.0:1786015561.034617:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786015561.034623:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c50357a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90b4 expref: 154 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.034643:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386b000, rc 0) 00000100:00100000:2.0:1786015561.034749:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+153:32818:x1872772280664448:12345-192.168.202.56@tcp:101:cat.0 Request processed in 3789us (4397us total) trans 4294968307 rc 301/301 00000100:00100000:2.0:1786015561.034778:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1486 00000100:00100000:0.0:1786015561.034904:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015561.035040:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280664960 00000100:00100000:0.0:1786015561.035052:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280664960 00000100:00100000:0.0:1786015561.035146:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 311 00000100:00100000:0.0:1786015561.035157:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916ad850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+153:32825:x1872772280664960:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:0.0:1786015561.035458:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916ad850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+154:32825:x1872772280664960:12345-192.168.202.56@tcp:35:cat.0 Request processed in 303us (553us total) trans 4294968308 rc 0/0 00000100:00100000:0.0:1786015561.035472:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 311 00000100:00100000:2.0:1786015561.041885:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280664704 00000100:00100000:2.0:1786015561.041912:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280664704 00000100:00100000:2.0:1786015561.042443:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1487 00000100:00100000:2.0:1786015561.042459:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+55:32827:x1872772280664704:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015561.042503:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015561.042537:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c50359d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e90bb expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786015561.043747:0:7673:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f:0x0], index 1: 0 00000100:00100000:1.0:1786015561.044513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015561.044553:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280665216 00000100:00100000:1.0:1786015561.044564:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280665216 00000100:00100000:1.0:1786015561.044623:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 312 00000100:00100000:1.0:1786015561.044633:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+154:32824:x1872772280665216:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:1.0:1786015561.044917:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+155:32824:x1872772280665216:12345-192.168.202.56@tcp:35:cat.0 Request processed in 284us (409us total) trans 4294968309 rc 0/0 00000100:00100000:1.0:1786015561.044927:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 312 00010000:00010000:2.0:1786015561.046148:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c5035a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.046174:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c5035a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.046191:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c5035a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.046295:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c50359d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90bb expref: 58 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.046321:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c5035a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90bb expref: 57 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.046332:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8b7487f06500) 00010000:00010000:2.0:1786015561.046336:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015561.046340:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf3b5000, rc 0) 00000100:00100000:2.0:1786015561.046416:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+57:32827:x1872772280664704:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 3961us (11983us total) trans 4294968310 rc 0/0 00000100:00100000:2.0:1786015561.046425:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1487 00000100:00100000:3.0:1786015561.049920:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015561.050033:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280665472 00000100:00100000:1.0:1786015561.050048:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280665472 00000100:00100000:1.0:1786015561.050138:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 313 00000100:00100000:1.0:1786015561.050151:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+155:32823:x1872772280665472:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:1.0:1786015561.050522:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+156:32823:x1872772280665472:12345-192.168.202.56@tcp:35:cat.0 Request processed in 372us (617us total) trans 4294968311 rc 0/0 00000100:00100000:1.0:1786015561.050532:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 313 00000100:00100000:0.0:1786015561.054617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015561.054948:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280665728 00000100:00100000:3.0:1786015561.054962:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280665728 00000100:00100000:3.0:1786015561.055044:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1488 00000100:00100000:3.0:1786015561.055057:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+57:32827:x1872772280665728:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786015561.055146:0:12526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015561.055187:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c5035a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90bb expref: 57 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055222:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8b7487f06500) 00010000:00010000:3.0:1786015561.055237:0:12526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015561.055240:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:3.0:1786015561.055272:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c5035b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055290:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c5035b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055302:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c5035b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055320:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x51:0x0].0x71f52aa0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055329:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x71f52aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055335:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x71f52aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055447:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c5035b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055457:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c5035b2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055464:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c5035b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055472:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73829f9600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015561.055478:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c5035b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055487:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c5035b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055496:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8b748f24a000) 00010000:00010000:3.0:1786015561.055500:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015561.055503:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c5035b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055509:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c5035b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055519:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x71f52aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055524:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x71f52aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055531:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x71f52aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055536:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73829f9400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015561.055539:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x71f52aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055546:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x71f52aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055553:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x71f52aa0 (ffff8b74b0022c00) 00010000:00010000:3.0:1786015561.055556:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015561.055559:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x71f52aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.055565:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x71f52aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015561.055690:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+56:32827:x1872772280665728:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 635us (1089us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786015561.055699:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1488 00000100:00100000:2.0:1786015561.055856:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280665984 00000100:00100000:2.0:1786015561.055864:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280665984 00000100:00100000:2.0:1786015561.055938:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 314 00000100:00100000:2.0:1786015561.055947:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+156:32818:x1872772280665984:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:2.0:1786015561.056196:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+157:32818:x1872772280665984:12345-192.168.202.56@tcp:35:cat.0 Request processed in 249us (955us total) trans 4294968312 rc 0/0 00000100:00100000:2.0:1786015561.056203:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 314 00000100:00100000:3.0:1786015561.059444:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015561.059608:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280666112 00000100:00100000:2.0:1786015561.059620:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280666112 00000100:00100000:2.0:1786015561.059689:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1489 00000100:00100000:2.0:1786015561.059703:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+56:32827:x1872772280666112:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015561.059732:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015561.059804:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c5035c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e90c2 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.059864:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5035c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.059885:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5035c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.059900:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5035c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.060333:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4e00/0xb1a5ef690c5035c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90c2 expref: 58 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.060358:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5035c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90c2 expref: 57 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.060374:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:2.0:1786015561.060378:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015561.060383:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf3b5600, rc 0) 00000100:00100000:2.0:1786015561.060467:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+57:32827:x1872772280666112:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 767us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015561.060474:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1489 00000100:00100000:0.0:1786015561.063165:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015561.063228:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280666368 00000100:00100000:3.0:1786015561.063242:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280666368 00000100:00100000:3.0:1786015561.063573:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1490 00000100:00100000:3.0:1786015561.063587:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+57:32827:x1872772280666368:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786015561.063802:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.063829:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.063846:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786015561.064502:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].19, 88 off9528 00000004:00080000:3.0:1786015561.064515:0:5796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 796315753513ns, next at 797315750321ns, rc = 0 00000004:00010000:3.0:1786015561.064637:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b08e6081 reply state 00000000dec9c2a2 transno 4294968313 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015561.064660:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015561.064842:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+59:32827:x1872772280666368:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 1254us (1686us total) trans 4294968313 rc 0/0 00000100:00100000:3.0:1786015561.064865:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1490 00010000:00010000:3.0:1786015561.066271:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.066584:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035ce lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.066592:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.066599:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73829f9400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015561.066605:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.066615:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035ce lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.066637:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:3.0:1786015561.066710:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786015561.066718:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035ce lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.066725:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035ce lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015561.067372:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015561.067586:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280666496 00000100:00100000:1.0:1786015561.067599:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280666496 00000100:00100000:1.0:1786015561.067667:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1491 00000100:00100000:1.0:1786015561.067678:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+58:32827:x1872772280666496:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015561.067713:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015561.067742:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5035d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e90c9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.068614:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5035d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90c9 expref: 59 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.068638:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5035d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90c9 expref: 59 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.068663:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:0.0:1786015561.068667:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015561.068671:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921a00, rc 0) 00000100:00100000:0.0:1786015561.068886:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+59:32827:x1872772280666496:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1209us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015561.068896:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1491 00000100:00100000:0.0:1786015561.072392:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015561.072499:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280666624 00000100:00100000:2.0:1786015561.072515:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280666624 00000100:00100000:2.0:1786015561.072625:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 411 00000100:00100000:2.0:1786015561.072638:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280666624:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1786015561.073215:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280666624:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 577us (836us total) trans 4294967386 rc 0/0 00000100:00100000:2.0:1786015561.073225:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 411 00000100:00100000:0.0:1786015561.083843:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015561.084174:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280666880 00000100:00100000:2.0:1786015561.084189:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280666880 00000100:00100000:2.0:1786015561.084293:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 315 00000100:00100000:2.0:1786015561.084306:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+59:32827:x1872772280666880:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015561.084647:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+60:32827:x1872772280666880:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 343us (816us total) trans 4294968314 rc 0/0 00000100:00100000:2.0:1786015561.084657:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 315 00000100:00100000:3.0:1786015561.090106:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015561.090357:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280667136 00000100:00100000:2.0:1786015561.090372:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280667136 00000100:00100000:2.0:1786015561.090464:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1492 00000100:00100000:2.0:1786015561.090477:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+60:32827:x1872772280667136:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015561.090646:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+60:32827:x1872772280667136:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 171us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015561.090654:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1492 00000100:00100000:0.0:1786015561.095732:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015561.095927:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280667264 00000100:00100000:3.0:1786015561.095940:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280667264 00000100:00100000:3.0:1786015561.096016:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1493 00000100:00100000:3.0:1786015561.096028:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+60:32827:x1872772280667264:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015561.096124:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015561.096153:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e90d0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.096251:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c5035e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.096270:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c5035e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.096284:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c5035e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015561.096336:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015561.096362:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c5035e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.096395:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c5035dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90d0 expref: 62 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.096417:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c5035e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90d0 expref: 61 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.096427:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:3.0:1786015561.096430:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786015561.096435:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73829f9600, rc 0) 00000100:00100000:3.0:1786015561.096518:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+61:32827:x1872772280667264:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 491us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015561.096526:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1493 00000100:00100000:3.0:1786015561.101598:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015561.102184:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280667392 00000100:00100000:0.0:1786015561.102198:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280667392 00000100:00100000:0.0:1786015561.102267:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 412 00000100:00100000:0.0:1786015561.102289:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280667392:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015561.102532:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015561.102562:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c5035ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e90d7 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015561.102600:0:14547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a746f49, blocks: 0x1 00010000:00010000:0.0:1786015561.102631:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1786015561.103097:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015561.103117:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c5035ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90d7 expref: 12 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.103144:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c5035ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90d7 expref: 12 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.103169:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6400, rc 0) 00000100:00100000:0.0:1786015561.103274:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280667392:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 988us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015561.103720:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 412 00000100:00100000:0.0:1786015561.109131:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015561.109272:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280667648 00000100:00100000:2.0:1786015561.109403:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280667648 00000100:00100000:2.0:1786015561.109864:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1494 00000100:00100000:2.0:1786015561.109878:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+61:32827:x1872772280667648:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015561.110080:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+61:32827:x1872772280667648:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 205us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015561.110090:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1494 00000100:00100000:3.0:1786015561.113259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015561.113383:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280667776 00000100:00100000:1.0:1786015561.113398:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280667776 00000100:00100000:1.0:1786015561.113538:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 413 00000100:00100000:1.0:1786015561.113552:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:32827:x1872772280667776:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015561.113579:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015561.113609:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5035f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e90de expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.113665:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c5035ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90d7 expref: 13 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.113677:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015561.113683:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015561.113688:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5035f1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90de expref: 13 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.113746:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c5035ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90d7 expref: 13 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.113796:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c5035ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90d7 expref: 13 pid: 14547 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015561.113815:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304463360:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015561.113947:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf8a1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015561.117211:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304463360:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015561.117263:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5035f1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90de expref: 13 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.117293:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920e00, rc 0) 00000100:00100000:1.0:1786015561.117377:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+13:32827:x1872772280667776:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 3827us (4133us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015561.117388:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 413 00000100:00100000:3.0:1786015561.120961:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015561.121192:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280667904 00000100:00100000:1.0:1786015561.121206:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280667904 00010000:00010000:1.0:1786015561.121264:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c5035ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90d7 expref: 13 pid: 14547 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015561.121321:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 438 00000100:00100000:1.0:1786015561.121333:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280667904:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015561.121357:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015561.121390:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c5035ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90d7 expref: 13 pid: 14547 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.121406:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c5035ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90d7 expref: 13 pid: 14547 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.121436:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c5035ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90d7 expref: 13 pid: 14547 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.121461:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015561.121466:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015561.121477:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5035f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90de expref: 12 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.121487:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5035f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90de expref: 12 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.121550:0:6607:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5035f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90de expref: 12 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015561.121569:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6607:1872772304463488:192.168.202.56@tcp:105: 00000100:00100000:1.0:1786015561.121693:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf8a1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786015561.126996:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015561.127001:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6607:1872772304463488:192.168.202.56@tcp:105: 00010000:00010000:1.0:1786015561.127036:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015561.127102:0:17970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280668032 00000100:00100000:0.0:1786015561.127112:0:17970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280668032 00000100:00100000:1.0:1786015561.127113:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280667904:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 5781us (6167us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015561.127125:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 438 00002000:00100000:0.0:1786015561.127182:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1f:0x0] (0->157) req@ffff8b748825ad80 x1872772280668032/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:407/0 lens 648/0 e 0 to 0 dl 1786015572 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015561.127194:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b748825ad80 with x1872772280668032 ext(0->157) 00002000:00010000:0.0:1786015561.127201:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b748825ad80 00000100:00100000:0.0:1786015561.127245:0:17970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 124 00000100:00100000:0.0:1786015561.127257:0:17970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280668032:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1786015561.128400:0:17970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2353:x1872772280668032:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 1138us (1414us total) trans 4294967387 rc 0/0 00000100:00100000:0.0:1786015561.128412:0:17970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 124 00002000:00100000:0.0:1786015561.128423:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1f:0x0] (0->157) req@ffff8b748825ad80 x1872772280668032/t4294967387(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:407/0 lens 648/448 e 0 to 0 dl 1786015572 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015561.128434:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b748825ad80 with x1872772280668032 ext(0->157) 00002000:00010000:0.0:1786015561.128537:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b748825ad80 00000100:00100000:3.0:1786015561.140993:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015561.142381:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280668160 00000100:00100000:0.0:1786015561.142404:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280668160 00000100:00100000:0.0:1786015561.142507:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1495 00000100:00100000:0.0:1786015561.142520:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+61:32827:x1872772280668160:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1786015561.244590:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968308 is committed 00000004:00080000:1.0:1786015561.244664:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 16 committed 00000001:00080000:1.0:1786015561.244680:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968259 is committed 00000100:00100000:1.0:1786015561.244896:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304463616:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786015561.245006:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1786015561.245123:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968311 is committed 00000001:00080000:1.0:1786015561.245197:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968314 is committed 00000001:00080000:1.0:1786015561.245206:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968312 is committed 00000100:00100000:2.0:1786015561.245664:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304463616 00000100:00100000:2.0:1786015561.245676:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304463616 00000100:00100000:2.0:1786015561.245748:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1786015561.245777:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304463616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1786015561.245817:0:6591:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:28 count 1 00010000:00010000:2.0:1786015561.245864:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c5035f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.245895:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024d079da/0xb1a5ef690c503198 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fbf expref: 8 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.245907:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c5031bb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fcd expref: 16 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.245916:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786015561.245922:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015561.245927:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c5035f8 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.245977:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c5031bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fcd expref: 16 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.245994:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c5031bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fcd expref: 16 pid: 6590 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015561.246009:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa474000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304463744:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015561.246114:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000024d079da/0xb1a5ef690c503198 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fbf expref: 8 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.246125:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000024d079da/0xb1a5ef690c503198 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fbf expref: 8 pid: 6592 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015561.246136:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa474a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304463872:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015561.246162:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74af54bcc0 going to sleep for 11 seconds 00000004:00080000:1.0:1786015561.247173:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 24 committed 00000100:00100000:3.0:1786015561.250178:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32827:x1872772280668160:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 107639us (109182us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015561.250198:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1495 00000100:00100000:3.0:1786015561.251997:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015561.252029:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304464000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786015561.252124:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015561.252353:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304464000 00000100:00100000:0.0:1786015561.252363:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304464000 00000100:00100000:0.0:1786015561.252445:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1786015561.252456:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304464000:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1786015561.252609:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1786015561.252915:0:14547:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1786015561.252920:0:14547:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb mtime from disk: 0 -> 1786015561 00002000:00010000:0.0:1786015561.252922:0:14547:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786015561.252924:0:14547:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb ctime from disk: 1786015561 -> 1786015561 00002000:00010000:0.0:1786015561.252925:0:14547:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1786015561.253186:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304464000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 728us (1058us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1786015561.253197:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000004:00080000:3.0:1786015561.253307:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b7384fe5500/2, rc 0, transno 4294967388 00000100:00100000:3.0:1786015561.253316:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304464000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786015561.254527:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa474000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304463744:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015561.254547:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa474a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304463872:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015561.254587:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c5035f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015561.256218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015561.256325:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015561.256660:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280668288 00000100:00100000:0.0:1786015561.256673:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280668288 00010000:00010000:0.0:1786015561.256729:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000024d079da/0xb1a5ef690c503198 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fbf expref: 9 pid: 6592 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015561.256812:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280668416 00000100:00100000:0.0:1786015561.256816:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280668416 00010000:00010000:0.0:1786015561.256833:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c5031bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fcd expref: 17 pid: 6590 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015561.256869:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 439 00000100:00100000:0.0:1786015561.256880:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280668288:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015561.256900:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015561.256906:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000024d079da/0xb1a5ef690c503198 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fbf expref: 9 pid: 6592 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.256925:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000024d079da/0xb1a5ef690c503198 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fbf expref: 9 pid: 6592 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.256957:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024d079da/0xb1a5ef690c503198 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fbf expref: 9 pid: 6592 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.256983:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015561.257131:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 440 00000100:00100000:1.0:1786015561.257143:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280668416:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015561.257153:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015561.257159:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c5031bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fcd expref: 17 pid: 6590 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.257171:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c5031bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fcd expref: 17 pid: 6590 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.257188:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b8c0903/0xb1a5ef690c5031bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8fcd expref: 17 pid: 6590 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.257201:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015561.257206:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015561.257214:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c5035f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.257225:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c5035f8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.257253:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015561.257291:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280668416:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 150us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015561.257301:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 440 00000100:00100000:0.0:1786015561.257353:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2353:x1872772280668288:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 474us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015561.257361:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 439 00000100:00100000:3.0:1786015561.257510:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015561.257877:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280668544 00000100:00100000:1.0:1786015561.257885:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280668544 00000100:00100000:1.0:1786015561.257934:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 416 00000100:00100000:1.0:1786015561.257941:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2354:x1872772280668544:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1786015561.258422:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c5035f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.258438:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c5035f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.258450:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c5035f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.258459:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c5035f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.258486:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786015561.259176:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786015561.259184:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c5035f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.259194:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf3b4e00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015561.259200:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c5035f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.259210:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c5035f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.259231:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c5035f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.259237:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076dee14f/0xb1a5ef690c5035f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.259264:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015561.259266:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015561.259268:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015561.259683:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304463616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13922us (14673us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1786015561.259696:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000004:00080000:3.0:1786015561.260437:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b7381cc2300/2, rc 0, transno 4294967375 00000100:00100000:3.0:1786015561.260450:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304463616:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1786015561.311425:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967388 is committed 00000001:00080000:3.0:1786015561.311453:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967387 is committed 00000100:00100000:1.0:1786015561.311882:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280668544:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 53929us (54361us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015561.311899:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 416 00000100:00100000:3.0:1786015561.322720:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015561.325023:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280668800 00000100:00100000:2.0:1786015561.325045:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280668800 00000100:00100000:3.0:1786015561.325194:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1496 00000100:00100000:3.0:1786015561.325205:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+53:32827:x1872772280668800:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786015561.325277:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015561.325327:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c5035e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90d0 expref: 53 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.325356:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:3.0:1786015561.325364:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015561.325410:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5035ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.325428:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5035ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.325438:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5035ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015561.325668:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cc6ecfaf reply state 0000000012707502 transno 4294968315 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5035ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015561.325677:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015561.325837:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+54:32827:x1872772280668800:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 632us (3134us total) trans 4294968315 rc 0/0 00000100:00100000:3.0:1786015561.325856:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1496 00010000:00010000:1.0:1786015561.330463:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5035ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015561.330951:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015561.331044:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280668928 00000100:00100000:0.0:1786015561.331061:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280668928 00000100:00100000:0.0:1786015561.331157:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 417 00000100:00100000:0.0:1786015561.331169:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280668928:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00010000:00010000:1.0:1786015561.331275:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5035ff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.331299:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5035ff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.331309:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015561.331316:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5035ff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.331328:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5035ff lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.331354:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:1.0:1786015561.331358:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015561.331365:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5035ff lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.331372:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c5035ff lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015561.331479:0:11384:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb size from disk: 158 -> 158 00002000:00010000:0.0:1786015561.331484:0:11384:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb mtime from disk: 1786015561 -> 1786015559 00002000:00010000:0.0:1786015561.331487:0:11384:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb atime from disk: 0 -> 1786015559 00002000:00010000:0.0:1786015561.331489:0:11384:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb ctime from disk: 1786015561 -> 1786015560 00002000:00010000:0.0:1786015561.331492:0:11384:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1786015561.331567:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280668928:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 399us (628us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1786015561.331576:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 417 00000100:00100000:3.0:1786015561.333812:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015561.335835:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280669184 00000100:00100000:2.0:1786015561.335864:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280669184 00000100:00100000:2.0:1786015561.335968:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1497 00000100:00100000:2.0:1786015561.335981:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:32827:x1872772280669184:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1786015561.336075:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c503606 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.336095:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5035c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90c2 expref: 53 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.336106:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c503606 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.336151:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5035c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90c2 expref: 53 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.336167:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5035c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90c2 expref: 53 pid: 7673 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015561.336197:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa474a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304464128:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015561.336318:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb4180 going to sleep for 11 seconds 00000100:00100000:2.0:1786015561.340204:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa474a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304464128:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015561.340248:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c503606 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015561.342192:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015561.342378:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280669312 00000100:00100000:1.0:1786015561.342393:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280669312 00010000:00010000:1.0:1786015561.342444:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5035c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90c2 expref: 54 pid: 7673 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015561.342515:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 441 00000100:00100000:1.0:1786015561.342526:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+54:2353:x1872772280669312:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015561.342548:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015561.342558:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5035c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90c2 expref: 54 pid: 7673 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.342574:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5035c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90c2 expref: 54 pid: 7673 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.342604:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5600/0xb1a5ef690c5035c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90c2 expref: 54 pid: 7673 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.342628:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:1.0:1786015561.342635:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c503606 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.342646:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c503606 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.342654:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c503606 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.342685:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015561.342736:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c503606 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.342746:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c503606 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015561.342808:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280669312:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 236us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015561.342816:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 441 00010000:00010000:2.0:1786015561.342820:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c503606 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.342828:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c503606 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.342836:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c503606 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.342844:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf3b5000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015561.342862:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c503606 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.342871:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c503606 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.342882:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:2.0:1786015561.342885:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1786015561.342889:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c503606 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.342897:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5000/0xb1a5ef690c503606 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015561.342959:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+52:32827:x1872772280669184:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 6980us (9203us total) trans 0 rc -22/-22 00000100:00100000:2.0:1786015561.342969:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1497 00000100:00100000:3.0:1786015561.352422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015561.355228:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280669440 00000100:00100000:0.0:1786015561.355255:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280669440 00000100:00100000:0.0:1786015561.355740:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 418 00000100:00100000:0.0:1786015561.355756:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280669440:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786015561.355874:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b7260132/0xb1a5ef690c50360d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.355905:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5035f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90de expref: 12 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.355922:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015561.355927:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015561.355941:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7260132/0xb1a5ef690c50360d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.356000:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5035f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90de expref: 12 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.356016:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5035f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90de expref: 12 pid: 6592 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015561.356037:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738374b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304464256:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015561.356174:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b03123c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015561.363267:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015561.363704:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738374b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304464256:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015561.363744:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b7260132/0xb1a5ef690c50360d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015561.368440:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280669568 00000100:00100000:1.0:1786015561.368465:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280669568 00010000:00010000:0.0:1786015561.369001:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5035f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90de expref: 13 pid: 6592 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015561.369065:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 442 00000100:00100000:0.0:1786015561.369077:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280669568:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015561.369107:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015561.369147:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5035f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90de expref: 13 pid: 6592 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.369166:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5035f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90de expref: 13 pid: 6592 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.369200:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c5035f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90de expref: 13 pid: 6592 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.369224:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015561.369230:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015561.369238:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7260132/0xb1a5ef690c50360d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.369251:0:17038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7260132/0xb1a5ef690c50360d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.369306:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015561.369378:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b7260132/0xb1a5ef690c50360d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.369390:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7260132/0xb1a5ef690c50360d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015561.369399:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280669568:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 323us (6146us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015561.369407:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 442 00010000:00010000:2.0:1786015561.369424:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b7260132/0xb1a5ef690c50360d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.369434:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7260132/0xb1a5ef690c50360d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.369443:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7260132/0xb1a5ef690c50360d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.369452:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015561.369457:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7260132/0xb1a5ef690c50360d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.369466:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7260132/0xb1a5ef690c50360d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.369481:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7260132/0xb1a5ef690c50360d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.369503:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7260132/0xb1a5ef690c50360d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015561.369562:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280669440:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 13811us (17158us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015561.369571:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 418 00000100:00100000:3.0:1786015561.377410:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015561.377484:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280669824 00000100:00100000:0.0:1786015561.377500:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280669824 00000100:00100000:0.0:1786015561.377579:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1498 00000100:00100000:0.0:1786015561.377591:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+52:32827:x1872772280669824:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786015561.377711:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503614 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.377739:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.377753:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.378120:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c50361b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.378135:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5035d5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90c9 expref: 53 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.378145:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c50361b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.378198:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5035d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90c9 expref: 53 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.378215:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5035d5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90c9 expref: 53 pid: 5794 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015561.378233:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738374b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304464384:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015561.378370:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b03123c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015561.391593:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015561.391886:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280669952 00000100:00100000:2.0:1786015561.391904:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280669952 00010000:00010000:2.0:1786015561.391989:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5035d5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90c9 expref: 54 pid: 5794 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015561.392059:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 443 00000100:00100000:2.0:1786015561.392074:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+54:2353:x1872772280669952:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015561.392099:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015561.392109:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5035d5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90c9 expref: 54 pid: 5794 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.392127:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5035d5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90c9 expref: 54 pid: 5794 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.392161:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:2.0:1786015561.392168:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c50361b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.392183:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c50361b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.392193:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c50361b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.392223:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015561.392322:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+54:2353:x1872772280669952:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 251us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015561.392331:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 443 00010000:00010000:0.0:1786015561.392513:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c5035d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90c9 expref: 53 pid: 5794 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015561.392536:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738374b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304464384:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015561.392567:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c50361b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.392578:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c50361b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.392584:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c50361b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786015561.393720:0:12526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968316 00000001:00080000:0.0:1786015561.394131:0:12526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968317 00000001:00080000:0.0:1786015561.394182:0:12526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968318 00000100:00100000:0.0:1786015561.394505:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738374b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12526:1872772304464512:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1786015561.394612:0:12526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015561.394746:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74bf8a1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786015561.396663:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304464512 00000100:00100000:3.0:1786015561.396690:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304464512 00000100:00100000:3.0:1786015561.396898:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1786015561.396913:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12526:x1872772304464512:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786015561.397224:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12526:x1872772304464512:12345-0@lo:1000:mdt00_004.0 Request processed in 314us (2611us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015561.397233:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1786015561.397582:0:12526:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967388 gen 2 00000004:00080000:0.0:1786015561.397592:0:12526:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b7384fe5500, transno 4294967388 00000100:00100000:0.0:1786015561.397619:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738374b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12526:1872772304464512:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1786015561.399147:0:12526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968319 00000100:00100000:0.0:1786015561.399271:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738374b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12526:1872772304464640:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1786015561.399678:0:12526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015561.399729:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b03123c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786015561.399792:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304464640 00000100:00100000:2.0:1786015561.399801:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304464640 00000100:00100000:2.0:1786015561.399867:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1786015561.399878:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12526:x1872772304464640:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1786015561.401558:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12526:x1872772304464640:12345-0@lo:1000:mdt00_004.0 Request processed in 1672us (1870us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1786015561.401576:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1786015561.402531:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738374b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12526:1872772304464640:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1786015561.402596:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c50361b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.402608:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c50361b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.402617:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c50361b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.402624:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015561.402630:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c50361b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.402638:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c50361b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.402659:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8b7487f06700) 00010000:00010000:3.0:1786015561.402662:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015561.402667:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c50361b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.402674:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c50361b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.402716:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.402724:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.402730:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.402735:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015561.402738:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.402744:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.402751:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:3.0:1786015561.402754:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015561.402873:0:12526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503319 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9036 expref: 105 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.402889:0:12526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503319 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9036 expref: 105 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.402900:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503319 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9036 expref: 105 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.402968:0:12526:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503319 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9036 expref: 105 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015561.402987:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304464768:192.168.202.56@tcp:105: 00000100:00100000:3.0:1786015561.403114:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7490fcd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015561.406636:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304464768:192.168.202.56@tcp:105: 00010000:00010000:0.0:1786015561.406680:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.406692:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6000/0xb1a5ef690c5032c5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.406740:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503622 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.406756:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5032d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e901a expref: 105 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.406863:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503622 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.406921:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5032d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e901a expref: 105 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.406940:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5032d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e901a expref: 105 pid: 12526 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015561.406957:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304464896:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015561.407102:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7491d4b780 going to sleep for 11 seconds 00000100:00100000:3.0:1786015561.415719:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015561.416956:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280670080 00000100:00100000:2.0:1786015561.416975:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280670080 00000100:00100000:2.0:1786015561.417079:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 316 00000100:00100000:2.0:1786015561.417090:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+106:32795:x1872772280670080:12345-192.168.202.56@tcp:49:cat.0 00000100:00100000:2.0:1786015561.417316:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+106:32795:x1872772280670080:12345-192.168.202.56@tcp:49:cat.0 Request processed in 226us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015561.417327:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 316 00000100:00100000:3.0:1786015561.423671:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015561.423710:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015561.423799:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304464896:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015561.423832:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:0.0:1786015561.423837:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503622 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015561.423944:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280670208 00000100:00100000:2.0:1786015561.423954:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280670208 00010000:00010000:2.0:1786015561.424007:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5032d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e901a expref: 106 pid: 12526 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015561.424057:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280670592 00000100:00100000:2.0:1786015561.424061:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280670592 00000100:00100000:2.0:1786015561.424092:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 444 00000100:00100000:2.0:1786015561.424102:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabf5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+107:2353:x1872772280670208:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015561.424124:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015561.424134:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5032d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e901a expref: 107 pid: 12526 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.424150:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5032d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e901a expref: 107 pid: 12526 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.424179:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5032d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e901a expref: 107 pid: 12526 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.424199:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:2.0:1786015561.424205:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503622 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.424217:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503622 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.424225:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503622 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.424247:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015561.424319:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabf5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+106:2353:x1872772280670208:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 218us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015561.424328:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 444 00000100:00100000:2.0:1786015561.424391:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 73 00000100:00100000:2.0:1786015561.424400:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+105:32797:x1872772280670592:12345-192.168.202.56@tcp:103:cat.0 00010000:00010000:2.0:1786015561.424407:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1786015561.424414:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280670336 00010000:00010000:2.0:1786015561.424418:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503319 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9036 expref: 105 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015561.424419:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280670336 00010000:00010000:2.0:1786015561.424428:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:2.0:1786015561.424431:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015561.424450:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+104:32797:x1872772280670592:12345-192.168.202.56@tcp:103:cat.0 Request processed in 52us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015561.424451:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 419 00000100:00100000:2.0:1786015561.424456:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 73 00000100:00100000:0.0:1786015561.424457:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:32795:x1872772280670336:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1786015561.424475:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015561.424500:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a35576b5/0xb1a5ef690c503629 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e90e5 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015561.424537:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 158, mtime: 0x6a746f47, atime: 0x6a746f47, ctime: 0x6a746f48, blocks: 0xb 00010000:00010000:0.0:1786015561.424562:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1786015561.424568:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015561.424580:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a35576b5/0xb1a5ef690c503629 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90e5 expref: 17 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.424599:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a35576b5/0xb1a5ef690c503629 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90e5 expref: 17 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.424613:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6000, rc 0) 00010000:00010000:1.0:1786015561.425126:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503622 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.425138:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503622 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.425154:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503622 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.425161:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503622 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.425167:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503622 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.425179:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015561.425184:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503622 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.425192:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503622 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.425203:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:1.0:1786015561.425206:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015561.425210:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503622 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.425215:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503622 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.425228:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.425234:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503614 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.425238:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503614 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.425243:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015561.425246:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503614 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.425253:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503614 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.425265:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b7487f06800) 00010000:00010000:1.0:1786015561.425267:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015561.425270:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503614 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.425276:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503614 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015561.425363:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:32795:x1872772280670336:12345-192.168.202.56@tcp:101:cat.0 Request processed in 903us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015561.425372:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 419 00000100:00100000:1.0:1786015561.425609:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+56:32827:x1872772280669824:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 48019us (48215us total) trans 4294968320 rc 0/0 00000100:00100000:1.0:1786015561.425620:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1498 00000020:00080000:1.0:1786015561.425624:0:12526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1786015561.429423:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015561.429436:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1786015561.429527:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000040:00080000:3.0:1786015561.430152:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1786015561.430164:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015561.430549:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280670720 00000100:00100000:1.0:1786015561.430565:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280670720 00000100:00100000:1.0:1786015561.430634:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1499 00000100:00100000:1.0:1786015561.430646:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+104:32797:x1872772280670720:12345-192.168.202.56@tcp:58:cat.0 00000100:00100000:1.0:1786015561.431795:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+104:32797:x1872772280670720:12345-192.168.202.56@tcp:58:cat.0 Request processed in 1140us (2265us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015561.431810:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1499 00000100:00100000:2.0:1786015561.433159:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015561.435730:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280670976 00000100:00100000:0.0:1786015561.435753:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280670976 00000100:00100000:0.0:1786015561.436414:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 317 00000100:00100000:0.0:1786015561.436429:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916adc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+56:32827:x1872772280670976:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1786015561.438204:0:5798:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x2d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1786015561.438388:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968321 00010000:00010000:0.0:1786015561.438477:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503630 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.438499:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503630 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.438514:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503630 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.438525:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503630 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.438532:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503630 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.438539:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503630 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.438569:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786015561.438739:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786015561.438748:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503630 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.438757:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7400 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015561.438781:0:6606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503630 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.438791:0:6606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503630 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.438806:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8b7499c59100) 00010000:00010000:2.0:1786015561.438810:0:6606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786015561.438814:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503630 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.438820:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503630 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015561.438841:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015561.438843:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015561.438855:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015561.439395:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916adc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+58:32827:x1872772280670976:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 2964us (6238us total) trans 4294968322 rc 0/0 00000100:00100000:0.0:1786015561.439410:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 317 00000020:00080000:0.0:1786015561.439419:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786015561.439630:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015561.440328:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280671104 00000100:00100000:0.0:1786015561.440343:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280671104 00000100:00100000:0.0:1786015561.440418:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1500 00000100:00100000:0.0:1786015561.440429:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+104:32797:x1872772280671104:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1786015561.440457:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015561.440490:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503637 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e90ec expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.440572:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503637 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90ec expref: 105 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.440590:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503637 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90ec expref: 105 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015561.440620:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b749232d500) 00010000:00010000:0.0:1786015561.440624:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786015561.440628:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6400, rc 0) 00000100:00100000:0.0:1786015561.440687:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+105:32797:x1872772280671104:12345-192.168.202.56@tcp:101:cat.0 Request processed in 259us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015561.440695:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1500 00000100:00100000:3.0:1786015561.445641:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015561.446137:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280671360 00000100:00100000:1.0:1786015561.446153:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280671360 00000100:00100000:1.0:1786015561.446246:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 74 00000100:00100000:1.0:1786015561.446258:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+105:32798:x1872772280671360:12345-192.168.202.56@tcp:103:cat.0 00010000:00010000:1.0:1786015561.446280:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015561.446328:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503637 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90ec expref: 105 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015561.446357:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b749232d500) 00010000:00010000:1.0:1786015561.446372:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015561.446455:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+104:32798:x1872772280671360:12345-192.168.202.56@tcp:103:cat.0 Request processed in 197us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015561.446464:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 74 00000100:00100000:3.0:1786015561.449506:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015561.449657:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280671488 00000100:00100000:1.0:1786015561.449670:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280671488 00000100:00100000:1.0:1786015561.449755:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1501 00000100:00100000:1.0:1786015561.449797:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+104:32798:x1872772280671488:12345-192.168.202.56@tcp:58:cat.0 00000100:00100000:1.0:1786015561.450004:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+104:32798:x1872772280671488:12345-192.168.202.56@tcp:58:cat.0 Request processed in 211us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015561.450013:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1501 00000100:00100000:2.0:1786015561.453841:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015561.453953:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280671616 00000100:00100000:3.0:1786015561.453967:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280671616 00000100:00100000:3.0:1786015561.454099:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1502 00000100:00100000:3.0:1786015561.454109:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+104:32796:x1872772280671616:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:3.0:1786015561.454135:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015561.454209:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50363e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e90f3 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.454285:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50363e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90f3 expref: 105 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.454312:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afcc00/0xb1a5ef690c50363e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90f3 expref: 105 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015561.454337:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8b74b0022c00) 00010000:00010000:3.0:1786015561.454340:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786015561.454344:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afcc00, rc 0) 00000100:00100000:3.0:1786015561.454443:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+105:32796:x1872772280671616:12345-192.168.202.56@tcp:101:cat.0 Request processed in 335us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015561.454452:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1502 00000100:00100000:2.0:1786015561.460355:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015561.461344:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280671744 00000100:00100000:0.0:1786015561.461364:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280671744 00002000:00100000:0.0:1786015561.461439:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1f:0x0] (0->4095) req@ffff8b74aa474380 x1872772280671744/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:407/0 lens 488/0 e 0 to 0 dl 1786015572 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015561.461453:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aa474380 with x1872772280671744 ext(0->4095) 00002000:00010000:0.0:1786015561.461588:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74aa474380 00000100:00100000:0.0:1786015561.461630:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 125 00000100:00100000:0.0:1786015561.461642:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2352:x1872772280671744:12345-192.168.202.56@tcp:3:cat.0 00000100:00100000:0.0:1786015561.462277:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2352:x1872772280671744:12345-192.168.202.56@tcp:3:cat.0 Request processed in 633us (2003us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786015561.462348:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 125 00002000:00100000:0.0:1786015561.462360:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1f:0x0] (0->4095) req@ffff8b74aa474380 x1872772280671744/t0(0) o3->41677fca-39fb-471c-b582-96bce6540a36@192.168.202.56@tcp:407/0 lens 488/4536 e 0 to 0 dl 1786015572 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015561.462370:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aa474380 with x1872772280671744 ext(0->4095) 00002000:00010000:0.0:1786015561.462379:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74aa474380 00000100:00100000:2.0:1786015561.499432:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015561.499634:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280672000 00000100:00100000:3.0:1786015561.499650:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280672000 00000100:00100000:3.0:1786015561.499746:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 318 00000100:00100000:3.0:1786015561.499758:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+105:32798:x1872772280672000:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:2.0:1786015561.501235:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+106:32798:x1872772280672000:12345-192.168.202.56@tcp:35:cat.0 Request processed in 1467us (1807us total) trans 4294968323 rc 0/0 00000100:00100000:2.0:1786015561.501250:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 318 00010000:00010000:1.0:1786015561.580206:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015562.413445:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304465280:0@lo:400:kworker.0 00000100:00100000:1.0:1786015562.413553:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304465024:0@lo:400:kworker.0 00000100:00100000:2.0:1786015562.413941:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304465408:0@lo:400:kworker.0 00000100:00100000:0.0:1786015562.414368:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304465152:0@lo:400:kworker.0 00000100:00100000:1.0:1786015562.415757:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015562.415866:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304465536:0@lo:400:kworker.0 00000100:00100000:1.0:1786015562.415899:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015562.416982:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015562.417060:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304465536 00000100:00100000:3.0:1786015562.417071:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304465536 00000100:00100000:3.0:1786015562.417137:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304465280 00000100:00100000:3.0:1786015562.417141:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304465280 00000100:00100000:3.0:1786015562.417167:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:3.0:1786015562.417178:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304465536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015562.417251:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304465536:12345-0@lo:400:kworker.0 Request processed in 75us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015562.417259:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:3.0:1786015562.417278:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1786015562.417284:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304465280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015562.417305:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304465536:0@lo:400:kworker.0 00000100:00100000:3.0:1786015562.417317:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304465280:12345-0@lo:400:kworker.0 Request processed in 34us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015562.417322:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00080000:3.0:1786015562.417339:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015562.417359:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304465280:0@lo:400:kworker.0 00000100:00100000:2.0:1786015562.417739:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015562.417881:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304465024 00000100:00100000:1.0:1786015562.417888:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304465024 00000100:00100000:1.0:1786015562.417941:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:1.0:1786015562.417949:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304465024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015562.418000:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304465024:12345-0@lo:400:kworker.0 Request processed in 52us (2251us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015562.418008:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:1.0:1786015562.418049:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304465024:0@lo:400:kworker.0 00000100:00100000:3.0:1786015562.418455:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304465408 00000100:00100000:3.0:1786015562.418461:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304465408 00000100:00100000:3.0:1786015562.418514:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:3.0:1786015562.418522:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304465408:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1786015562.418528:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015562.418583:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304465408:12345-0@lo:400:kworker.0 Request processed in 62us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015562.418589:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1786015562.418599:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304465408:0@lo:400:kworker.0 00000100:00100000:0.0:1786015562.418683:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015562.418729:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304465664:0@lo:400:kworker.0 00000100:00100000:0.0:1786015562.418860:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015562.419008:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304465664 00000100:00100000:1.0:1786015562.419013:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304465664 00000100:00100000:1.0:1786015562.419073:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:1.0:1786015562.419081:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304465664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015562.419125:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304465664:12345-0@lo:400:kworker.0 Request processed in 45us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015562.419131:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:0.0:1786015562.419177:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304465664:0@lo:400:kworker.0 00000100:00100000:3.0:1786015562.419468:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304465152 00000100:00100000:3.0:1786015562.419472:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304465152 00000100:00100000:3.0:1786015562.419502:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:3.0:1786015562.419508:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304465152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015562.419556:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304465152:12345-0@lo:400:kworker.0 Request processed in 48us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015562.419562:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:0.0:1786015562.419572:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304465152:0@lo:400:kworker.0 00000040:00080000:3.0:1786015562.476176:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015562.476191:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015562.478341:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1786015562.478365:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786015562.605229:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015562.929032:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304465792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015562.929110:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015562.929198:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304465792 00000100:00100000:1.0:1786015562.929206:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304465792 00000100:00100000:1.0:1786015562.929255:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1786015562.929263:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304465792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015562.929302:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 88408064 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015562.929346:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304465792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015562.929354:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1786015562.929405:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304465792:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786015563.628215:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015564.656323:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015565.377135:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015565.377183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015565.377237:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015565.377267:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015565.377286:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015565.377305:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015565.377332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015565.377370:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280672640 00000100:00100000:2.0:1786015565.377382:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280672640 00000100:00100000:3.0:1786015565.377413:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280672384 00000100:00100000:3.0:1786015565.377425:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280672384 00000100:00100000:2.0:1786015565.377458:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280672256 00000100:00100000:3.0:1786015565.377459:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280672896 00000100:00100000:3.0:1786015565.377464:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280672896 00000100:00100000:2.0:1786015565.377464:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280672256 00000100:00100000:3.0:1786015565.377481:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 564 00000100:00100000:3.0:1786015565.377489:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+16:2351:x1872772280672384:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015565.377514:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 560 00000100:00100000:2.0:1786015565.377525:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+58:2351:x1872772280672640:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015565.377561:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+16:2351:x1872772280672384:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 74us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015565.377567:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 564 00000100:00100000:2.0:1786015565.377573:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+58:2351:x1872772280672640:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 50us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015565.377580:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280672512 00000100:00100000:2.0:1786015565.377583:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 560 00000100:00100000:3.0:1786015565.377584:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280672512 00000100:00100000:3.0:1786015565.377607:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280672768 00000100:00100000:2.0:1786015565.377609:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 561 00000100:00100000:3.0:1786015565.377612:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280672768 00000100:00100000:2.0:1786015565.377620:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+106:2351:x1872772280672256:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015565.377635:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 565 00000100:00100000:3.0:1786015565.377644:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280672896:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015565.377655:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+106:2351:x1872772280672256:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 37us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015565.377662:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 561 00000100:00100000:3.0:1786015565.377678:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280672896:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 35us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015565.377686:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 565 00000100:00100000:1.0:1786015565.378192:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280672128 00000100:00100000:1.0:1786015565.378198:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280672128 00000100:00100000:1.0:1786015565.378241:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 640 00000100:00100000:1.0:1786015565.378248:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280672128:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015565.378278:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280672128:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015565.378284:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 640 00000100:00080000:1.0:1786015565.378316:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015565.378321:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015565.378324:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015565.378390:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 566 00000100:00100000:2.0:1786015565.378399:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280672512:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015565.378426:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280672512:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015565.378435:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 566 00000100:00100000:2.0:1786015565.378448:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 567 00000100:00100000:2.0:1786015565.378454:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2351:x1872772280672768:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015565.378478:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2351:x1872772280672768:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015565.378485:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 567 00010000:00010000:1.0:1786015565.676126:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015565.996555:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304465920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015565.996633:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015565.998720:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304465920 00000100:00100000:3.0:1786015565.998736:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304465920 00000100:00100000:3.0:1786015565.998872:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00080000:1.0:1786015565.998880:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015565.998883:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304465920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015565.998922:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 93519872 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015565.999011:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304465920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (2378us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015565.999019:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1786015565.999046:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304465920:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1786015566.112086:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967375 is committed 00000040:00080000:2.0:1786015566.586476:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015566.586488:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015566.587039:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 45 count 3 00000040:00080000:2.0:1786015566.587048:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1786015566.601151:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967389 is committed 00000001:00080000:3.0:1786015566.601180:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967390 is committed 00000001:00080000:0.0:1786015566.664687:0:22141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968322 is committed 00000020:00080000:0.0:1786015566.664718:0:22141:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b74bf8a1900 refcount 2 committed 0 result 0 batchid 35 00000020:00080000:0.0:1786015566.664726:0:22141:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74b0235a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b74bf8a1f00 00000020:00080000:0.0:1786015566.664730:0:22141:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8b74b0235000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b74b8c8a400 00000020:00080000:1.0:1786015566.664989:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 35 committed batchid 34 00000020:00080000:1.0:1786015566.665221:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 34 00000001:00080000:1.0:1786015566.666056:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968323 is committed 00010000:00010000:2.0:1786015566.700993:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015567.536844:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304466048:0@lo:400:kworker.0 00000100:00100000:2.0:1786015567.536879:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304466304:0@lo:400:kworker.0 00000100:00100000:3.0:1786015567.536961:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304466176:0@lo:400:kworker.0 00000100:00100000:1.0:1786015567.539078:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304466432:0@lo:400:kworker.0 00000100:00100000:2.0:1786015567.542063:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015567.542085:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015567.542232:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304466560:0@lo:400:kworker.0 00000100:00100000:2.0:1786015567.558877:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304466304 00000100:00100000:2.0:1786015567.558892:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304466304 00000100:00100000:2.0:1786015567.558962:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:2.0:1786015567.558974:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304466304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015567.559067:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304466304:12345-0@lo:400:kworker.0 Request processed in 96us (17011us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015567.559075:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00080000:2.0:1786015567.559096:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015567.559143:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304466304:0@lo:400:kworker.0 00000100:00100000:0.0:1786015567.561115:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304466048 00000100:00100000:0.0:1786015567.561129:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304466048 00000100:00100000:0.0:1786015567.561213:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:0.0:1786015567.561229:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304466048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015567.561349:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304466048:12345-0@lo:400:kworker.0 Request processed in 120us (19255us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015567.561357:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:0.0:1786015567.561433:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015567.561495:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304466048:0@lo:400:kworker.0 00000100:00100000:0.0:1786015567.561886:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304466560 00000100:00100000:0.0:1786015567.561907:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304466560 00000100:00080000:2.0:1786015567.562784:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015567.565490:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:0.0:1786015567.565533:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304466560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015567.566656:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304466560:12345-0@lo:400:kworker.0 Request processed in 1145us (5217us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015567.566666:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:2.0:1786015567.567955:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304466560:0@lo:400:kworker.0 00000100:00100000:3.0:1786015567.572011:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015567.572082:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015567.572136:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304466176 00000100:00100000:2.0:1786015567.572148:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304466176 00000100:00100000:2.0:1786015567.572207:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:2.0:1786015567.572227:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304466176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015567.572299:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304466176:12345-0@lo:400:kworker.0 Request processed in 74us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015567.572307:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:1.0:1786015567.572447:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304466432 00000100:00100000:1.0:1786015567.572456:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304466432 00000100:00100000:1.0:1786015567.572529:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:1.0:1786015567.572540:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304466432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015567.572620:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304466432:12345-0@lo:400:kworker.0 Request processed in 83us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015567.572629:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:1.0:1786015567.572679:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967375 gen 2 00000004:00080000:1.0:1786015567.572686:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b7381cc2300, transno 4294967375 00000100:00100000:1.0:1786015567.572704:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304466432:0@lo:400:kworker.0 00000100:00080000:2.0:1786015567.572799:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015567.573082:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304466176:0@lo:400:kworker.0 00000100:00100000:3.0:1786015567.573096:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304466688:0@lo:400:kworker.0 00000100:00100000:3.0:1786015567.573151:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015567.573494:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304466688 00000100:00100000:2.0:1786015567.573501:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304466688 00000100:00100000:2.0:1786015567.573571:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1786015567.573580:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304466688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015567.573636:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304466688:12345-0@lo:400:kworker.0 Request processed in 57us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015567.573642:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00080000:3.0:1786015567.574494:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015567.574552:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967390 gen 2 00000004:00080000:3.0:1786015567.574560:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967390 committed transno 4294967390 00000100:00100000:3.0:1786015567.574586:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304466688:0@lo:400:kworker.0 00000100:00100000:0.0:1786015567.654055:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015567.654296:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280673024 00000100:00100000:3.0:1786015567.654311:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280673024 00000100:00100000:3.0:1786015567.654403:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1503 00000100:00100000:3.0:1786015567.654415:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+50:32746:x1872772280673024:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1786015567.654558:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+50:32746:x1872772280673024:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 145us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015567.654567:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1503 00000100:00080000:0.0:1786015567.655069:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786015567.725168:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015568.045202:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786015568.045238:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304466816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015568.045347:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015568.045453:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304466816 00000100:00100000:2.0:1786015568.045464:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304466816 00000100:00100000:2.0:1786015568.045532:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1786015568.045544:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304466816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015568.045596:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 88408064 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015568.045655:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304466816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015568.045664:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1786015568.045729:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304466816:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786015568.752451:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015569.773992:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786015569.818050:0:22330:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12u: Multiple reads on multiple HSM imported files in parallel ========================================================== 07:26:08 (1786015568) 00000100:00100000:2.0:1786015570.221516:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.221682:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280673152 00000100:00100000:0.0:1786015570.221692:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280673152 00000100:00100000:0.0:1786015570.221816:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1504 00000100:00100000:0.0:1786015570.221828:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+50:33435:x1872772280673152:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1786015570.221930:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+50:33435:x1872772280673152:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 105us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015570.221938:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1504 00000100:00080000:3.0:1786015570.222561:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015570.255001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.255417:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280673280 00000100:00100000:1.0:1786015570.255431:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280673280 00000100:00100000:1.0:1786015570.255549:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1505 00000100:00100000:1.0:1786015570.255562:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+105:33436:x1872772280673280:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015570.255596:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015570.255631:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503645 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e90fa expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.255742:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50364c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.255812:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50364c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.255828:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50364c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786015570.256296:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786015570.256428:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503653 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.256453:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503653 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.256467:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503653 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.258159:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50364c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.258176:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50364c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.258185:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50364c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.258191:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015570.258197:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50364c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.258205:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50364c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.258234:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06300) 00010000:00010000:1.0:1786015570.258237:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015570.258243:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50364c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.258250:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c50364c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.258265:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503653 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.258272:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503653 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.258277:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503653 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.258282:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015570.258284:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503653 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.258293:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503653 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.258300:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b8202c4 (ffff8b748f194700) 00010000:00010000:1.0:1786015570.258302:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015570.258305:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503653 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.258311:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503653 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.260236:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503645 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90fa expref: 106 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.260256:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06300) 00010000:00010000:1.0:1786015570.260259:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015570.260264:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503645 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e90fa expref: 106 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.260278:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920c00, rc 0) 00000100:00100000:1.0:1786015570.260370:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+105:33436:x1872772280673280:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 4809us (5388us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015570.260379:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1505 00000100:00100000:1.0:1786015570.269156:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015570.269456:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280673536 00000100:00100000:3.0:1786015570.269472:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280673536 00000100:00100000:3.0:1786015570.269541:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1506 00000100:00100000:3.0:1786015570.269554:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+105:33436:x1872772280673536:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:3.0:1786015570.269638:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015570.269674:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060200/0xb1a5ef690c50305d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f48 expref: 105 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.269697:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06300) 00010000:00010000:3.0:1786015570.269705:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015570.270279:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c50365a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.270297:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50309c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f5d expref: 49 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.270308:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c50365a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.270348:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50309c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f5d expref: 49 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.270365:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50309c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f5d expref: 49 pid: 7673 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015570.270384:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304466944:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015570.270498:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7490fa20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015570.277628:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.277757:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304466944:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015570.277832:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c50365a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015570.278563:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280673664 00000100:00100000:1.0:1786015570.278575:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280673664 00010000:00010000:1.0:1786015570.278627:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50309c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f5d expref: 50 pid: 7673 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015570.278675:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 445 00000100:00100000:1.0:1786015570.278685:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+50:2354:x1872772280673664:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015570.278704:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015570.278712:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50309c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f5d expref: 50 pid: 7673 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.278726:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50309c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f5d expref: 50 pid: 7673 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.278757:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c50309c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e8f5d expref: 50 pid: 7673 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.282332:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06300) 00010000:00010000:1.0:1786015570.282341:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c50365a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.282356:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c50365a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.282365:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c50365a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.282416:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015570.282577:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+49:2354:x1872772280673664:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 3886us (4958us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015570.282588:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 445 00010000:00010000:0.0:1786015570.283353:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c50365a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.283365:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c50365a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.283398:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503661 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.283411:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503661 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.283419:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503661 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015570.284666:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00010000:00010000:0.0:1786015570.284684:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c50365a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.284692:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c50365a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.284698:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c50365a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.284702:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.284706:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c50365a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.284713:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c50365a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.284731:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06300) 00010000:00010000:0.0:1786015570.284734:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.284740:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c50365a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.284746:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c50365a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015570.284814:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d6f7b50b reply state 00000000a02b226a transno 4294968324 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503661 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015570.284822:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015570.284936:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+106:33436:x1872772280673536:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 15382us (15790us total) trans 4294968324 rc 0/0 00000100:00100000:0.0:1786015570.284946:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1506 00010000:00010000:3.0:1786015570.291349:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503661 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.291372:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503661 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.291381:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503661 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.291388:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015570.291394:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503661 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.291403:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503661 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.291425:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b8202c4 (ffff8b748f24ac00) 00010000:00010000:3.0:1786015570.291429:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015570.291435:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503661 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.291441:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c503661 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015570.293631:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015570.298053:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280673792 00000100:00100000:2.0:1786015570.298082:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280673792 00000100:00100000:2.0:1786015570.298164:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1507 00000100:00100000:2.0:1786015570.298174:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+105:33437:x1872772280673792:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1786015570.298203:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015570.298236:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c503668 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9101 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.298321:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c50366f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.298335:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c50366f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.298344:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c50366f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015570.298417:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:2.0:1786015570.298420:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 35 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015570.298446:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c50366f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.298470:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c503668 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9101 expref: 107 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.298486:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b000/0xb1a5ef690c50366f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9101 expref: 106 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.298492:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06200) 00010000:00010000:2.0:1786015570.298496:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015570.298499:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386b000, rc 0) 00000100:00100000:2.0:1786015570.298589:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+106:33437:x1872772280673792:12345-192.168.202.56@tcp:101:bash.0 Request processed in 416us (4970us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015570.298595:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1507 00000100:00100000:2.0:1786015570.303455:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.303590:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280673920 00000100:00100000:1.0:1786015570.303603:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280673920 00000100:00100000:1.0:1786015570.303682:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1508 00000100:00100000:1.0:1786015570.303696:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+106:33437:x1872772280673920:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1786015570.303727:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015570.303755:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503676 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9108 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.303897:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50367d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.303916:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50367d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.303929:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50367d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.303950:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503684 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.303957:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503684 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.303961:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503684 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304119:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c50368b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304128:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c50368b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304134:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c50368b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015570.304180:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:1.0:1786015570.304185:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015570.304215:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c50368b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304231:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50367d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304238:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50367d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304246:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50367d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304253:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015570.304259:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50367d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304268:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50367d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304280:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06200) 00010000:00010000:1.0:1786015570.304282:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015570.304287:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50367d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304292:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50367d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304303:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503684 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304311:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503684 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304314:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503684 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304317:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015570.304319:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503684 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304322:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503684 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304325:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b8202c4 (ffff8b748f194700) 00010000:00010000:1.0:1786015570.304326:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015570.304328:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503684 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304331:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503684 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304358:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503676 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9108 expref: 108 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304367:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921800/0xb1a5ef690c50368b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9108 expref: 107 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.304372:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015570.304373:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1786015570.304375:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921800, rc 0) 00000100:00100000:1.0:1786015570.304438:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+107:33437:x1872772280673920:12345-192.168.202.56@tcp:101:bash.0 Request processed in 747us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015570.304444:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1508 00000100:00100000:1.0:1786015570.307964:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.308152:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280674048 00000100:00100000:0.0:1786015570.308164:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280674048 00000100:00100000:0.0:1786015570.308230:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1509 00000100:00100000:0.0:1786015570.308242:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+107:33437:x1872772280674048:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1786015570.308270:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015570.308301:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503692 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e910f expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308385:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503699 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308401:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503699 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308413:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503699 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308429:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308435:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308447:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308535:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503699 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308542:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503699 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308549:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503699 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308556:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.308561:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503699 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308569:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503699 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308583:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.308586:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.308591:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503699 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308599:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503699 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308611:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308617:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308623:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308629:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.308632:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308637:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308643:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff8b748f24ab00) 00010000:00010000:0.0:1786015570.308645:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.308648:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308653:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308687:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503692 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e910f expref: 108 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308697:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.308699:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.308702:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503692 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e910f expref: 108 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.308711:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7c00, rc 0) 00000100:00100000:0.0:1786015570.308837:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+107:33437:x1872772280674048:12345-192.168.202.56@tcp:101:bash.0 Request processed in 597us (894us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015570.308856:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1509 00000100:00100000:2.0:1786015570.333233:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015570.334132:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280674176 00000100:00100000:3.0:1786015570.334149:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280674176 00000100:00100000:3.0:1786015570.334247:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1510 00000100:00100000:3.0:1786015570.334259:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+49:33438:x1872772280674176:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015570.334289:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015570.334320:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5036a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9116 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.334436:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5036ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.334453:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5036ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.334469:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5036ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015570.334754:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:3.0:1786015570.334802:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 35 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015570.334841:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5036ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.334873:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5036a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9116 expref: 51 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.334898:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd000/0xb1a5ef690c5036ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9116 expref: 50 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.334910:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06200) 00010000:00010000:3.0:1786015570.334913:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015570.334918:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd000, rc 0) 00000100:00100000:3.0:1786015570.335244:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+50:33438:x1872772280674176:12345-192.168.202.56@tcp:101:rm.0 Request processed in 985us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015570.335255:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1510 00000100:00100000:3.0:1786015570.350830:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.350954:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280674304 00000100:00100000:0.0:1786015570.350969:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280674304 00000100:00100000:0.0:1786015570.351060:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1511 00000100:00100000:0.0:1786015570.351082:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+50:33438:x1872772280674304:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:0.0:1786015570.351117:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015570.351149:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c5036b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e911d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351243:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351263:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351277:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351296:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351303:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351311:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351463:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c5036ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351477:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c5036ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351484:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c5036ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015570.351524:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:0.0:1786015570.351529:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015570.351559:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c5036ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351575:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351582:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351589:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351597:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.351602:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351610:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351625:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b7487f06200) 00010000:00010000:0.0:1786015570.351629:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.351635:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351647:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351661:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351667:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351672:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351677:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.351679:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351685:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351691:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b8202c4 (ffff8b748f24ab00) 00010000:00010000:0.0:1786015570.351694:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.351696:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351702:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351736:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c5036b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e911d expref: 52 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351750:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6800/0xb1a5ef690c5036ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e911d expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.351829:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.351833:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786015570.351836:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6800, rc 0) 00000100:00100000:0.0:1786015570.352298:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+51:33438:x1872772280674304:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1225us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015570.352308:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1511 00000100:00100000:2.0:1786015570.361725:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.361829:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280674432 00000100:00100000:0.0:1786015570.361843:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280674432 00000100:00100000:0.0:1786015570.362150:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1512 00000100:00100000:0.0:1786015570.362163:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+51:33438:x1872772280674432:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:0.0:1786015570.362193:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015570.362225:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c5036d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9124 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362323:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362341:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362354:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362371:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362379:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362391:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362476:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362484:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362505:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362512:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.362517:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362526:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362539:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.362542:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.362547:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362554:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c5036d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362566:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362573:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362579:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362585:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.362587:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362592:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362599:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff8b748f24ab00) 00010000:00010000:0.0:1786015570.362602:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.362604:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362610:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5036df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362646:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c5036d1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9124 expref: 52 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362657:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.362660:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.362663:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c5036d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9124 expref: 52 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.362673:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7c00, rc 0) 00000100:00100000:0.0:1786015570.362757:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+51:33438:x1872772280674432:12345-192.168.202.56@tcp:101:rm.0 Request processed in 597us (1044us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015570.362818:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1512 00000100:00100000:2.0:1786015570.367951:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015570.368081:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280674560 00000100:00100000:3.0:1786015570.368095:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280674560 00000100:00100000:3.0:1786015570.368165:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1513 00000100:00100000:3.0:1786015570.368177:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:33438:x1872772280674560:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015570.368206:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015570.368235:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5036e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e912b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368323:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5036ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368340:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5036ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368355:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5036ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368379:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5036f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368387:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5036f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368393:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5036f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368477:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5036ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368485:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5036ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368493:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5036ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368499:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015570.368504:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5036ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368512:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5036ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368526:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015570.368529:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015570.368535:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5036ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368541:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c5036ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368557:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5036f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368563:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5036f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368569:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5036f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368587:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015570.368590:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5036f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368597:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5036f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368604:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff8b74b0022500) 00010000:00010000:3.0:1786015570.368606:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015570.368610:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5036f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368615:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5036f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368655:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5036e6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e912b expref: 52 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368666:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015570.368669:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015570.368673:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5036e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e912b expref: 52 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.368697:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc200, rc 0) 00000100:00100000:3.0:1786015570.368813:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+51:33438:x1872772280674560:12345-192.168.202.56@tcp:101:rm.0 Request processed in 637us (885us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015570.368821:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1513 00000100:00100000:2.0:1786015570.391101:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.391329:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280674688 00000100:00100000:0.0:1786015570.391345:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280674688 00000100:00100000:0.0:1786015570.391479:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1514 00000100:00100000:0.0:1786015570.391492:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+51:33439:x1872772280674688:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015570.391528:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015570.391558:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c5036fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9132 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.391652:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503702 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.391672:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503702 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.391685:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503702 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.391703:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503709 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.391710:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.391717:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.391859:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503702 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.391872:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503702 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.391878:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503702 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.391885:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.391889:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503702 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.391897:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503702 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.391911:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.391914:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.391918:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503702 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.391925:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503702 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.393194:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.393371:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503709 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.393380:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503709 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.393386:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.393393:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503709 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.393403:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503709 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.393421:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff8b748f24ab00) 00010000:00010000:0.0:1786015570.393425:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.393431:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503709 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.393438:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503709 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.394548:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c5036fb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9132 expref: 52 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.394571:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.394574:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.394578:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c5036fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9132 expref: 52 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.394595:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7c00, rc 0) 00000100:00100000:2.0:1786015570.403364:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+51:33439:x1872772280674688:12345-192.168.202.56@tcp:101:cp.0 Request processed in 11855us (12259us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015570.403382:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1514 00000100:00100000:2.0:1786015570.420601:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.420700:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280674816 00000100:00100000:1.0:1786015570.420717:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280674816 00000100:00100000:1.0:1786015570.420815:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1515 00000100:00100000:1.0:1786015570.420828:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+51:33439:x1872772280674816:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015570.420867:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015570.420898:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503710 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9139 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421008:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503717 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421025:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503717 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421040:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503717 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421056:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50371e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421063:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50371e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421069:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50371e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421160:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503717 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421168:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503717 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421175:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503717 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421182:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015570.421188:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503717 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421197:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503717 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421401:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015570.421405:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015570.421412:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503717 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421420:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503717 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421437:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50371e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421444:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50371e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421450:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50371e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421457:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015570.421460:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50371e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421466:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50371e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421475:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff8b748f194700) 00010000:00010000:1.0:1786015570.421477:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015570.421480:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50371e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421486:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50371e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421530:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503710 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9139 expref: 52 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421544:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015570.421546:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015570.421550:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503710 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9139 expref: 52 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.421560:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920c00, rc 0) 00000100:00100000:1.0:1786015570.421651:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+51:33439:x1872772280674816:12345-192.168.202.56@tcp:101:cp.0 Request processed in 826us (1064us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015570.421661:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1515 00000100:00100000:1.0:1786015570.425900:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015570.426212:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280675072 00000100:00100000:3.0:1786015570.426227:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280675072 00000100:00100000:3.0:1786015570.426311:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1516 00000100:00100000:3.0:1786015570.426323:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+51:33439:x1872772280675072:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015570.426352:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015570.426381:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503725 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9140 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.426558:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50372c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.426577:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50372c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.426590:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50372c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.426606:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503733 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.426613:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503733 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.426619:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503733 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786015570.427811:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d:0x0], index 0: 0 00010000:00010000:3.0:1786015570.428555:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50373a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.428575:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50373a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.428590:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50373a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.428636:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50372c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.428644:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50372c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.428651:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50372c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.428659:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015570.428664:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50372c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.428672:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50372c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.428688:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015570.428691:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015570.428697:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50372c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.428710:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50372c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015570.428729:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000281f40f4 reply state 000000001a5def5c transno 4294968325 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503733 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015570.428740:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786015570.428841:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503725 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9140 expref: 54 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.429475:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50373a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9140 expref: 53 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.429484:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:3.0:1786015570.429487:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015570.429490:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc000, rc 0) 00000100:00100000:3.0:1786015570.429624:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+54:33439:x1872772280675072:12345-192.168.202.56@tcp:101:cp.0 Request processed in 3303us (3739us total) trans 4294968325 rc 0/0 00000100:00100000:3.0:1786015570.429635:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1516 00010000:00010000:0.0:1786015570.432710:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503733 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.432735:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503733 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.432744:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503733 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.432757:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.432802:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503733 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.432811:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503733 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.432835:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff8b74b0022500) 00010000:00010000:0.0:1786015570.432839:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.432844:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503733 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.433027:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503733 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015570.436457:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015570.436841:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280675200 00000100:00100000:2.0:1786015570.436868:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280675200 00000100:00100000:2.0:1786015570.436967:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 420 00000100:00100000:2.0:1786015570.436980:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+8:2354:x1872772280675200:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015570.437005:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015570.437037:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733bf407/0xb1a5ef690c503748 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9147 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015570.437073:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786015570.437099:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=805s v=(0 0) 00010000:00010000:2.0:1786015570.437103:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015570.437116:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733bf407/0xb1a5ef690c503748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9147 expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.437142:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000733bf407/0xb1a5ef690c503748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9147 expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.437157:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386ae00, rc 0) 00000100:00100000:2.0:1786015570.437250:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280675200:12345-192.168.202.56@tcp:101:cp.0 Request processed in 273us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015570.437259:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 420 00000100:00080000:3.0:1786015570.438339:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015570.442520:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.442613:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280675328 00000100:00100000:1.0:1786015570.442629:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280675328 00000100:00100000:1.0:1786015570.442704:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 421 00000100:00100000:1.0:1786015570.442716:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:33439:x1872772280675328:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015570.442740:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015570.442811:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50374f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e914e expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.443174:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000733bf407/0xb1a5ef690c503748 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9147 expref: 10 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.443187:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015570.443192:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015570.443198:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50374f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e914e expref: 10 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.443365:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000733bf407/0xb1a5ef690c503748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9147 expref: 10 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.443383:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000733bf407/0xb1a5ef690c503748 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9147 expref: 10 pid: 6590 timeout: 905 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015570.443400:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304467072:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015570.443526:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7484fff300 going to sleep for 11 seconds 00000100:00100000:0.0:1786015570.453589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.453717:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280675456 00000100:00100000:1.0:1786015570.453730:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280675456 00010000:00010000:1.0:1786015570.453822:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000733bf407/0xb1a5ef690c503748 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9147 expref: 11 pid: 6590 timeout: 905 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015570.453888:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 446 00000100:00100000:1.0:1786015570.453900:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280675456:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015570.453922:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015570.453966:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000733bf407/0xb1a5ef690c503748 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9147 expref: 11 pid: 6590 timeout: 905 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.453989:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000733bf407/0xb1a5ef690c503748 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9147 expref: 11 pid: 6590 timeout: 905 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.454025:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015570.454031:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015570.454042:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50374f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e914e expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.454054:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50374f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e914e expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.454103:0:6607:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50374f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e914e expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015570.454123:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304467200:192.168.202.56@tcp:105: 00000100:00100000:1.0:1786015570.454485:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b01b03c0 going to sleep for 11 seconds 00010000:00010000:2.0:1786015570.455114:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733bf407/0xb1a5ef690c503748 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9147 expref: 11 pid: 6590 timeout: 905 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015570.455136:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304467072:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015570.455172:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50374f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e914e expref: 10 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.455186:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920c00, rc 0) 00000100:00100000:2.0:1786015570.455254:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:33439:x1872772280675328:12345-192.168.202.56@tcp:101:cp.0 Request processed in 12540us (12749us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015570.455265:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 421 00000100:00100000:0.0:1786015570.461573:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015570.461663:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280675712 00000100:00100000:2.0:1786015570.461676:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280675712 00000100:00100000:2.0:1786015570.461819:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 319 00000100:00100000:2.0:1786015570.461832:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:33439:x1872772280675712:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:2.0:1786015570.462596:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+54:33439:x1872772280675712:12345-192.168.202.56@tcp:35:cp.0 Request processed in 763us (1035us total) trans 4294968326 rc 0/0 00000100:00100000:2.0:1786015570.462606:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 319 00000100:00100000:1.0:1786015570.463019:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304467200:192.168.202.56@tcp:105: 00010000:00010000:1.0:1786015570.463050:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015570.463079:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280675456:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 9181us (9504us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015570.463090:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 446 00000100:00100000:1.0:1786015570.495190:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.495251:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.495282:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.495326:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.495369:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280676096 00000100:00100000:1.0:1786015570.495382:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280676096 00000100:00100000:1.0:1786015570.495458:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280675968 00000100:00100000:1.0:1786015570.495461:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280675968 00000100:00100000:1.0:1786015570.495488:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280676224 00000100:00100000:1.0:1786015570.495491:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280676224 00000100:00100000:1.0:1786015570.495511:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 570 00000100:00100000:1.0:1786015570.495523:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+17:2352:x1872772280676096:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015570.495625:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+17:2352:x1872772280676096:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 104us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015570.495634:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 570 00000100:00100000:1.0:1786015570.495654:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 571 00000100:00100000:1.0:1786015570.495661:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2352:x1872772280675968:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015570.495690:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2352:x1872772280675968:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015570.495696:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 571 00000100:00100000:1.0:1786015570.495708:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 572 00000100:00100000:1.0:1786015570.495714:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2352:x1872772280676224:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015570.495740:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2352:x1872772280676224:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015570.495746:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 572 00000100:00080000:1.0:1786015570.495839:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015570.495844:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015570.496350:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280675840 00000100:00100000:0.0:1786015570.496358:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280675840 00000100:00100000:0.0:1786015570.496408:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 642 00000100:00100000:0.0:1786015570.496416:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280675840:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015570.496455:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280675840:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 40us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015570.496463:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 642 00000100:00100000:3.0:1786015570.526016:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015570.526225:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280676352 00000100:00100000:2.0:1786015570.526238:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280676352 00000100:00100000:2.0:1786015570.526302:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1517 00000100:00100000:2.0:1786015570.526311:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+107:33443:x1872772280676352:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015570.526337:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015570.526362:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c503756 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9155 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.526437:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50375d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.526451:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50375d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.526462:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50375d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.526473:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503764 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.526478:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503764 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.526482:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503764 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527056:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50376b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527068:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50376b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527086:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50376b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015570.527133:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2e:0x0]: returning size 158 00000004:00200000:2.0:1786015570.527137:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015570.527160:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50376b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527173:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50376b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527182:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50375d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527188:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50375d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527195:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50375d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527262:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386b200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015570.527268:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50375d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527276:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50375d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527291:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015570.527295:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015570.527299:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50375d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527305:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c50375d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527320:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503764 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527326:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503764 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527332:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503764 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527337:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386be00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015570.527340:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503764 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527345:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503764 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527351:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff8b7487f06900) 00010000:00010000:2.0:1786015570.527354:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015570.527356:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503764 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527361:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503764 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527399:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c503756 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9155 expref: 109 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527413:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50376b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9155 expref: 108 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.527420:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:2.0:1786015570.527423:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015570.527425:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386b400, rc 0) 00000100:00100000:2.0:1786015570.527864:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+108:33443:x1872772280676352:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1551us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015570.527874:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1517 00000100:00100000:0.0:1786015570.530395:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.530484:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280676480 00000100:00100000:1.0:1786015570.530507:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280676480 00000100:00100000:1.0:1786015570.530584:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 422 00000100:00100000:1.0:1786015570.530596:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280676480:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015570.530625:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015570.530652:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004efa5a1c/0xb1a5ef690c503772 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e915c expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015570.530748:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304467328:192.168.202.56@tcp:106: 00000100:00100000:1.0:1786015570.531070:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b01b03c0 going to sleep for 11 seconds 00002000:00010000:1.0:1786015570.533611:0:6591:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x1d:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1786015570.533624:0:6591:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x1d:0x0] updating lvb mtime: 0 -> 1786015570 00002000:00010000:1.0:1786015570.533627:0:6591:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x1d:0x0] updating lvb atime: 0 -> 1786015570 00002000:00010000:1.0:1786015570.533630:0:6591:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x1d:0x0] updating lvb ctime: 0 -> 1786015570 00000100:00100000:1.0:1786015570.533663:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304467328:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015570.533710:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004efa5a1c/0xb1a5ef690c503772 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e915c expref: 17 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.533742:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004efa5a1c/0xb1a5ef690c503772 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e915c expref: 17 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.533756:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920200, rc 0) 00000100:00100000:1.0:1786015570.533950:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280676480:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3347us (3560us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015570.533960:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 422 00000100:00100000:3.0:1786015570.537444:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.537660:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280676608 00000100:00100000:1.0:1786015570.537675:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280676608 00000100:00100000:2.0:1786015570.538148:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1518 00000100:00100000:2.0:1786015570.538164:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+108:33443:x1872772280676608:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015570.538195:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015570.538238:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503779 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9163 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.538348:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503780 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.538366:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.538382:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015570.538464:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:2.0:1786015570.538469:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015570.538629:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.538668:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503779 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9163 expref: 110 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.539015:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503780 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9163 expref: 109 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.539027:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015570.539031:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015570.539036:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386b200, rc 0) 00000100:00100000:2.0:1786015570.539177:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+109:33443:x1872772280676608:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1017us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015570.539187:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1518 00000100:00100000:2.0:1786015570.548365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.548544:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280676736 00000100:00100000:1.0:1786015570.548559:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280676736 00000100:00100000:1.0:1786015570.548639:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 423 00000100:00100000:1.0:1786015570.548652:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280676736:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015570.548679:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015570.548707:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004efa5a1c/0xb1a5ef690c503787 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e916a expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015570.548830:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304467456:192.168.202.56@tcp:106: 00000100:00100000:1.0:1786015570.548972:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b01b03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015570.554449:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304467456:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015570.554505:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004efa5a1c/0xb1a5ef690c503787 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e916a expref: 17 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.554538:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004efa5a1c/0xb1a5ef690c503787 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e916a expref: 17 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.554561:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920200, rc 0) 00000100:00100000:1.0:1786015570.554707:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280676736:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 6057us (6356us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015570.554718:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 423 00000100:00100000:3.0:1786015570.562336:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.562523:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280676992 00000100:00100000:0.0:1786015570.562537:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280676992 00000100:00100000:0.0:1786015570.562610:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1519 00000100:00100000:0.0:1786015570.562622:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+109:33443:x1872772280676992:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:0.0:1786015570.563094:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].45, 136 off14312 00000100:00100000:0.0:1786015570.563224:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+109:33443:x1872772280676992:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 602us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015570.563234:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1519 00000100:00100000:2.0:1786015570.576307:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.576503:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280677120 00000100:00100000:0.0:1786015570.576517:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280677120 00000100:00100000:0.0:1786015570.576603:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1520 00000100:00100000:0.0:1786015570.576616:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+109:33444:x1872772280677120:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1786015570.576647:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015570.576676:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c50378e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9171 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.577283:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503795 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.577301:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503795 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.577319:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503795 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.578866:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50379c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.578979:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50379c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.578997:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50379c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.579079:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503795 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.579088:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503795 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.579095:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503795 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.579102:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.579107:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503795 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.579115:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503795 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.579128:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.579131:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.579136:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503795 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.579143:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503795 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.579159:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50379c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.579165:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50379c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.579171:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50379c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.579176:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.579178:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50379c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.579184:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50379c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.579191:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff8b748f24ab00) 00010000:00010000:0.0:1786015570.579193:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.579196:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50379c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.579202:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c50379c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.579257:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c50378e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9171 expref: 110 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.579275:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.579278:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.579282:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c50378e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9171 expref: 110 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.579291:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6200, rc 0) 00000100:00100000:0.0:1786015570.579374:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+109:33444:x1872772280677120:12345-192.168.202.56@tcp:101:bash.0 Request processed in 2759us (3082us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015570.579383:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1520 00000100:00100000:3.0:1786015570.606647:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.606798:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280677248 00000100:00100000:0.0:1786015570.606811:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280677248 00000100:00100000:0.0:1786015570.606957:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1521 00000100:00100000:0.0:1786015570.606971:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+54:33445:x1872772280677248:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:0.0:1786015570.607010:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015570.607039:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5037a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9178 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607129:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607148:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607161:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607179:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607187:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607194:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607498:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607508:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607515:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607523:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.607528:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607537:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607550:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.607553:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.607559:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607564:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607580:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607587:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607593:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607598:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.607601:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607608:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607615:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff8b748f24ab00) 00010000:00010000:0.0:1786015570.607618:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.607621:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607628:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607673:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5037a3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9178 expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607684:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.607687:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.607690:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5037a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9178 expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.607704:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6200, rc 0) 00000100:00100000:0.0:1786015570.608065:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+54:33445:x1872772280677248:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1095us (1426us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015570.608076:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1521 00000100:00100000:3.0:1786015570.611340:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.611462:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280677376 00000100:00100000:1.0:1786015570.611475:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280677376 00000100:00100000:1.0:1786015570.612057:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1522 00000100:00100000:1.0:1786015570.612070:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+54:33445:x1872772280677376:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:1.0:1786015570.612096:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015570.612121:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5037b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e917f expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612224:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5037bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612242:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5037bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612258:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5037bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612273:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5037c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612278:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5037c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612282:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5037c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612354:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5037bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612359:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5037bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612364:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5037bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612371:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015570.612375:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5037bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612389:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5037bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612403:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015570.612406:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015570.612412:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5037bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612418:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5037bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612434:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5037c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612440:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5037c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612446:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5037c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612451:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015570.612454:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5037c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612461:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5037c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612469:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff8b748f194700) 00010000:00010000:1.0:1786015570.612472:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015570.612474:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5037c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612484:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5037c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612535:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5037b8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e917f expref: 55 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612547:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015570.612549:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015570.612552:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5037b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e917f expref: 55 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.612563:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920200, rc 0) 00000100:00100000:1.0:1786015570.612648:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+54:33445:x1872772280677376:12345-192.168.202.56@tcp:101:rm.0 Request processed in 580us (1318us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015570.612656:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1522 00000100:00100000:2.0:1786015570.629439:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.631400:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280677504 00000100:00100000:0.0:1786015570.631418:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280677504 00000100:00100000:0.0:1786015570.631500:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1523 00000100:00100000:0.0:1786015570.631520:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+54:33446:x1872772280677504:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015570.631547:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015570.631571:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5037cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9186 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.631658:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.631672:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.631684:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.631700:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.631707:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.631715:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.632076:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.632086:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.632092:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.632099:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.632105:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.632113:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.632129:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.632132:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.632138:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.632144:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c5037d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.632158:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.632164:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.632170:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.632321:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.632325:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.632332:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.632342:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff8b748f24ab00) 00010000:00010000:0.0:1786015570.632345:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.632348:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.632354:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c5037db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.632401:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5037cd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9186 expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.632413:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.632415:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.632422:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5037cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9186 expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.632431:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6200, rc 0) 00000100:00100000:0.0:1786015570.632668:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+54:33446:x1872772280677504:12345-192.168.202.56@tcp:101:cp.0 Request processed in 1156us (3244us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015570.632678:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1523 00000100:00100000:3.0:1786015570.636438:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.636543:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280677632 00000100:00100000:0.0:1786015570.636557:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280677632 00000100:00100000:0.0:1786015570.636636:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1524 00000100:00100000:0.0:1786015570.636648:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+54:33446:x1872772280677632:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015570.636678:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015570.636717:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5037e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e918d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.636875:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5037e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.636894:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5037e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.636911:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5037e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.636931:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c5037f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.636949:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c5037f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.636957:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c5037f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.637053:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5037e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.637061:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5037e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.637069:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5037e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.637077:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.637081:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5037e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.637090:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5037e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.637104:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.637108:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.637114:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5037e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.637120:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5037e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.637135:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c5037f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.637142:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c5037f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.637148:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c5037f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.637153:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.637155:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c5037f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.637162:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c5037f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.637173:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff8b748f24ac00) 00010000:00010000:0.0:1786015570.637176:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.637179:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c5037f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.637186:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c5037f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.637240:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5037e2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e918d expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.637252:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.637254:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.637258:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5037e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e918d expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.637268:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7a00, rc 0) 00000100:00100000:0.0:1786015570.637338:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+54:33446:x1872772280677632:12345-192.168.202.56@tcp:101:cp.0 Request processed in 693us (918us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015570.637347:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1524 00000100:00100000:3.0:1786015570.643615:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.644358:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280677888 00000100:00100000:1.0:1786015570.644376:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280677888 00000100:00100000:1.0:1786015570.644456:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1525 00000100:00100000:1.0:1786015570.644468:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+54:33446:x1872772280677888:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015570.644501:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015570.644590:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5037f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9194 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.647048:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5037fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.647085:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503780 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9163 expref: 108 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.647094:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5037fe lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.647159:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503780 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9163 expref: 108 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.647178:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503780 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9163 expref: 108 pid: 12526 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015570.647197:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304467584:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015570.647335:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786015570.656883:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304467584:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015570.656927:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5037fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015570.657150:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.657688:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280678016 00000100:00100000:0.0:1786015570.657699:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280678016 00010000:00010000:0.0:1786015570.657751:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503780 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9163 expref: 109 pid: 12526 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015570.657841:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 447 00000100:00100000:0.0:1786015570.657864:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+109:2354:x1872772280678016:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015570.657885:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015570.657893:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503780 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9163 expref: 109 pid: 12526 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.657907:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503780 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9163 expref: 109 pid: 12526 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.657934:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b200/0xb1a5ef690c503780 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9163 expref: 109 pid: 12526 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.657969:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.657974:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5037fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.657986:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5037fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.657995:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5037fe lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.658030:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015570.658110:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+108:2354:x1872772280678016:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 248us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015570.658118:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 447 00010000:00010000:2.0:1786015570.658875:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5037fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.658888:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5037fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.658922:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c503805 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.658934:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c503805 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.658954:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c503805 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786015570.660544:0:7673:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x20:0x0], index 1: 0 00010000:00010000:2.0:1786015570.660843:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c50380c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.661524:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c50380c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.661541:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c50380c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.661608:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5037fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.661617:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5037fe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.661625:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5037fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.661632:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386be00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015570.661637:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5037fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.661645:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5037fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.661660:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015570.661665:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015570.661670:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5037fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.661677:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5037fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015570.661737:0:7673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001e4ec6dd reply state 0000000030b2bb76 transno 4294968327 ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c503805 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015570.661750:0:7673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786015570.662103:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5037f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9194 expref: 57 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.662126:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c50380c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9194 expref: 56 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.662141:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:2.0:1786015570.662144:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015570.662147:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1c00, rc 0) 00000100:00100000:2.0:1786015570.662403:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+57:33446:x1872772280677888:12345-192.168.202.56@tcp:101:cp.0 Request processed in 17935us (18801us total) trans 4294968327 rc 0/0 00000100:00100000:2.0:1786015570.662413:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1525 00000040:00080000:3.0:1786015570.668365:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015570.668380:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015570.668427:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 46 count 4 00000040:00080000:3.0:1786015570.668436:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015570.669898:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f7100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304467712:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015570.670575:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7490fa23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786015570.672167:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.672522:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280678144 00000100:00100000:0.0:1786015570.672536:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280678144 00000100:00100000:0.0:1786015570.672611:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 424 00000100:00100000:0.0:1786015570.672624:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280678144:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015570.672650:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015570.672691:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083734aac/0xb1a5ef690c50381a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e919b expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015570.672731:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786015570.672783:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=805s v=(0 0) 00010000:00010000:0.0:1786015570.672789:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015570.672802:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083734aac/0xb1a5ef690c50381a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e919b expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.672826:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000083734aac/0xb1a5ef690c50381a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e919b expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.672843:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7a00, rc 0) 00000100:00100000:0.0:1786015570.673151:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280678144:12345-192.168.202.56@tcp:101:cp.0 Request processed in 530us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015570.673160:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 424 00000100:00100000:2.0:1786015570.677817:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.677983:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280678272 00000100:00100000:1.0:1786015570.677997:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280678272 00000100:00100000:1.0:1786015570.678068:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 425 00000100:00100000:1.0:1786015570.678080:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:33446:x1872772280678272:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015570.678107:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015570.678135:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503821 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e91a2 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.678180:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083734aac/0xb1a5ef690c50381a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e919b expref: 12 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.678191:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015570.678196:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015570.678340:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503821 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91a2 expref: 12 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.678387:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083734aac/0xb1a5ef690c50381a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e919b expref: 12 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.678404:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083734aac/0xb1a5ef690c50381a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e919b expref: 12 pid: 6590 timeout: 905 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015570.678420:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304467840:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015570.678538:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b01b03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015570.679648:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f7100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304467712:192.168.202.56@tcp:107:hsm_cdtr.0 00010000:00010000:3.0:1786015570.680445:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c503805 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.680463:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c503805 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.680472:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c503805 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.680478:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b738386ae00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015570.680484:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c503805 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.680494:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c503805 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.680517:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff8b7487f06900) 00010000:00010000:3.0:1786015570.680521:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015570.680527:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c503805 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.680534:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ae00/0xb1a5ef690c503805 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015570.682538:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304467840:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015570.682590:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503821 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91a2 expref: 12 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.682622:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921600, rc 0) 00000100:00100000:2.0:1786015570.682711:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:33446:x1872772280678272:12345-192.168.202.56@tcp:101:cp.0 Request processed in 4632us (4907us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015570.682723:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 425 00000100:00100000:2.0:1786015570.688349:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.688570:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280678400 00000100:00100000:0.0:1786015570.688584:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280678400 00000100:00100000:0.0:1786015570.688660:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1526 00000100:00100000:0.0:1786015570.688672:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+56:33447:x1872772280678400:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015570.688740:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x2e:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015570.688981:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+56:33447:x1872772280678400:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 310us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015570.688989:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1526 00000100:00100000:0.0:1786015570.693167:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015570.695158:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.695947:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280678784 00000100:00100000:0.0:1786015570.695966:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280678784 00000100:00100000:0.0:1786015570.696069:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1527 00000100:00100000:0.0:1786015570.696082:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+56:33447:x1872772280678784:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015570.696115:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015570.696151:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503828 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e91a9 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.696550:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c50382f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.696570:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c50382f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.696587:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c50382f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015570.696601:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2e:0x0]: returning size 158 00010000:00010000:0.0:1786015570.697127:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503828 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91a9 expref: 59 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.697153:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c50382f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91a9 expref: 58 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.697164:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:0.0:1786015570.697168:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015570.697173:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6200, rc 0) 00000100:00100000:0.0:1786015570.697338:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+58:33447:x1872772280678784:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1257us (2195us total) trans 4294968328 rc 0/0 00000100:00100000:0.0:1786015570.697348:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1527 00000100:00100000:0.0:1786015570.702455:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.702524:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015570.702872:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280678912 00000100:00100000:2.0:1786015570.702890:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280678912 00000100:00100000:2.0:1786015570.702995:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 426 00000100:00100000:2.0:1786015570.703009:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280678912:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786015570.703090:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c50383d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.703129:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50374f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e914e expref: 9 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.703140:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015570.703146:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786015570.703152:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c50383d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.703854:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50374f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e914e expref: 9 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.703875:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50374f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e914e expref: 9 pid: 6592 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015570.703894:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304467968:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015570.704026:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786015570.709196:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304467968:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015570.709248:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c50383d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015570.709379:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.709510:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280679168 00000100:00100000:1.0:1786015570.709520:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280679168 00002000:00100000:1.0:1786015570.709587:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1d:0x0] (0->157) req@ffff8b7382d0ce00 x1872772280679168/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:416/0 lens 648/0 e 0 to 0 dl 1786015581 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015570.709599:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7382d0ce00 with x1872772280679168 ext(0->157) 00010000:00010000:1.0:1786015570.709609:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50374f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e914e expref: 10 pid: 6592 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.709624:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50374f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e914e expref: 10 pid: 6592 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015570.709633:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b7382d0ce00 00000100:00100000:1.0:1786015570.709675:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:1.0:1786015570.709686:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280679168:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:1.0:1786015570.710447:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280679168:12345-192.168.202.56@tcp:4:cp.0 Request processed in 758us (1067us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1786015570.710458:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00002000:00100000:1.0:1786015570.710467:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1d:0x0] (0->157) req@ffff8b7382d0ce00 x1872772280679168/t4294967376(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:416/0 lens 648/448 e 0 to 0 dl 1786015581 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015570.710477:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7382d0ce00 with x1872772280679168 ext(0->157) 00010000:00010000:1.0:1786015570.710485:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50374f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e914e expref: 12 pid: 6592 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.710498:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50374f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e914e expref: 12 pid: 6592 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015570.710512:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b7382d0ce00 00000100:00100000:3.0:1786015570.711093:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280678528 00000100:00100000:3.0:1786015570.711104:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280678528 00010000:00010000:3.0:1786015570.711872:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083734aac/0xb1a5ef690c50381a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e919b expref: 12 pid: 6590 timeout: 905 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015570.711924:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280679040 00000100:00100000:3.0:1786015570.711929:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280679040 00000100:00100000:3.0:1786015570.711973:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 448 00000100:00100000:3.0:1786015570.711982:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280678528:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015570.711999:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015570.712028:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000083734aac/0xb1a5ef690c50381a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e919b expref: 12 pid: 6590 timeout: 905 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.712044:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000083734aac/0xb1a5ef690c50381a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e919b expref: 12 pid: 6590 timeout: 905 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.712075:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083734aac/0xb1a5ef690c50381a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e919b expref: 12 pid: 6590 timeout: 905 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.712095:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015570.712100:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015570.712110:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91a2 expref: 11 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.712121:0:17038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503821 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91a2 expref: 11 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.712168:0:17038:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503821 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91a2 expref: 11 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015570.712187:0:17038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17038:1872772304468096:192.168.202.56@tcp:105: 00000100:00100000:3.0:1786015570.712299:0:17038:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7490fa23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015570.712368:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 75 00000100:00100000:0.0:1786015570.712379:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabf4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+58:2351:x1872772280679040:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015570.712389:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015570.712408:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c50382f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91a9 expref: 58 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.712422:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:0.0:1786015570.712428:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015570.712455:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabf4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+57:2351:x1872772280679040:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 78us (9930us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015570.712462:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 75 00000100:00100000:0.0:1786015570.718317:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015570.718510:0:17038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17038:1872772304468096:192.168.202.56@tcp:105: 00010000:00010000:3.0:1786015570.718547:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015570.718624:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280678528:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 6642us (25473us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015570.718638:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 448 00000100:00100000:2.0:1786015570.718800:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280679424 00000100:00100000:2.0:1786015570.718810:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280679424 00000100:00100000:2.0:1786015570.718897:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 320 00000100:00100000:2.0:1786015570.718908:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+57:33446:x1872772280679424:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:2.0:1786015570.719551:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+58:33446:x1872772280679424:12345-192.168.202.56@tcp:35:cp.0 Request processed in 641us (1247us total) trans 4294968329 rc 0/0 00000100:00100000:2.0:1786015570.719559:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 320 00000100:00100000:1.0:1786015570.735262:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.735828:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280679552 00000100:00100000:0.0:1786015570.735856:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280679552 00010000:00010000:0.0:1786015570.735917:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50374f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e914e expref: 12 pid: 6592 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015570.735985:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 449 00000100:00100000:0.0:1786015570.735996:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280679552:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015570.736018:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015570.736049:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50374f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e914e expref: 12 pid: 6592 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.736066:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50374f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e914e expref: 12 pid: 6592 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.736099:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50374f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e914e expref: 12 pid: 6592 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.736122:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015570.736128:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015570.736136:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c50383d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.736147:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c50383d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.736187:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015570.736277:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280679552:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 282us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015570.736285:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 449 00010000:00010000:1.0:1786015570.737208:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c50383d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.737225:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c50383d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.737269:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c50383d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.737279:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c50383d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.737287:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c50383d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.737296:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a0400 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015570.737302:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c50383d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.737312:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c50383d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.737329:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c50383d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.737337:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c50383d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015570.737436:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280678912:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 34427us (34994us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015570.737446:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 426 00000100:00100000:1.0:1786015570.759920:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015570.764543:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280679808 00000100:00100000:2.0:1786015570.764572:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280679808 00000100:00100000:2.0:1786015570.764858:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1528 00000100:00100000:2.0:1786015570.764875:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+58:33447:x1872772280679808:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015570.765084:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+58:33447:x1872772280679808:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 213us (5180us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015570.767462:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1528 00000100:00100000:0.0:1786015570.768398:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015570.768508:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280679936 00000100:00100000:3.0:1786015570.768522:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280679936 00000100:00100000:3.0:1786015570.768590:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1529 00000100:00100000:3.0:1786015570.768602:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+108:33450:x1872772280679936:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015570.768631:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015570.768660:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503844 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e91b0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.768790:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50384b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.768810:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50384b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.768826:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50384b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769142:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503852 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769156:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769163:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769366:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503859 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769376:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769383:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015570.769427:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2f:0x0]: returning size 158 00000004:00200000:3.0:1786015570.769432:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015570.769456:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769470:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769481:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50384b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769487:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50384b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769494:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50384b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769506:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015570.769511:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50384b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769519:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50384b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769533:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015570.769537:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015570.769542:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50384b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769548:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c50384b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769566:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769573:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503852 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769578:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503852 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769583:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015570.769586:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503852 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769592:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503852 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769603:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff8b74b0022500) 00010000:00010000:3.0:1786015570.769605:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015570.769608:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503852 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769613:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503852 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769648:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503844 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91b0 expref: 110 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769665:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503859 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91b0 expref: 109 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.769674:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:3.0:1786015570.769676:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015570.769755:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd400, rc 0) 00000100:00100000:3.0:1786015570.770223:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+109:33450:x1872772280679936:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1621us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015570.770233:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1529 00000100:00100000:3.0:1786015570.775358:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.778576:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015570.780314:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280680064 00000100:00100000:2.0:1786015570.780338:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280680064 00000100:00100000:2.0:1786015570.780418:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280680192 00000100:00100000:2.0:1786015570.780422:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280680192 00000100:00100000:2.0:1786015570.780459:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 427 00000100:00100000:2.0:1786015570.780470:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280680064:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015570.780498:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015570.780529:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c503860 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e91b7 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015570.780566:0:14547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 158, mtime: 0x6a746f52, atime: 0x0, ctime: 0x6a746f52, blocks: 0x1 00010000:00010000:2.0:1786015570.780596:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=806s v=(0 0) 00010000:00010000:2.0:1786015570.780602:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015570.780615:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c503860 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91b7 expref: 11 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.780640:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c503860 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91b7 expref: 11 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.780657:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a0400, rc 0) 00000100:00100000:2.0:1786015570.780739:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280680064:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 270us (5398us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015570.780747:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 427 00000100:00100000:2.0:1786015570.780804:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 428 00000100:00100000:2.0:1786015570.780812:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280680192:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015570.780820:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015570.780833:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5813b81/0xb1a5ef690c503867 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e91be expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015570.780915:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304468224:192.168.202.56@tcp:106: 00000100:00100000:2.0:1786015570.781123:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b73848723c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015570.785172:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00002000:00010000:2.0:1786015570.785415:0:14547:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1786015570.785420:0:14547:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb mtime: 0 -> 1786015570 00002000:00010000:2.0:1786015570.785423:0:14547:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb atime: 0 -> 1786015570 00002000:00010000:2.0:1786015570.785425:0:14547:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb ctime: 0 -> 1786015570 00000100:00100000:2.0:1786015570.785455:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304468224:192.168.202.56@tcp:106: 00010000:00010000:2.0:1786015570.785509:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5813b81/0xb1a5ef690c503867 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91be expref: 18 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.785543:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5813b81/0xb1a5ef690c503867 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91be expref: 18 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.785560:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1e00, rc 0) 00000100:00100000:2.0:1786015570.785646:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280680192:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 4833us (7084us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015570.785660:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 428 00000100:00100000:0.0:1786015570.786116:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280680448 00000100:00100000:0.0:1786015570.786127:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280680448 00000100:00100000:0.0:1786015570.786194:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1530 00000100:00100000:0.0:1786015570.786216:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+58:33447:x1872772280680448:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015570.786322:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+58:33447:x1872772280680448:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 109us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015570.786329:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1530 00000100:00100000:0.0:1786015570.792242:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.792291:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015570.792453:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280680704 00000100:00100000:2.0:1786015570.792467:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280680704 00000100:00100000:2.0:1786015570.792549:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1531 00000100:00100000:2.0:1786015570.792561:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+109:33450:x1872772280680704:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015570.792593:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015570.792623:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50386e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e91c5 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.792733:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503875 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.792751:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.792813:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015570.792912:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:2.0:1786015570.792917:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015570.792956:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.792989:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50386e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91c5 expref: 111 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.793013:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91c5 expref: 110 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.793028:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015570.793031:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015570.793036:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1000, rc 0) 00000100:00100000:2.0:1786015570.793112:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+110:33450:x1872772280680704:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 553us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015570.793121:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1531 00000100:00100000:1.0:1786015570.793357:0:17969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280680576 00000100:00100000:1.0:1786015570.793363:0:17969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280680576 00002000:00100000:1.0:1786015570.793406:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1d:0x0] (0->4095) req@ffff8b74c1223480 x1872772280680576/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:416/0 lens 488/0 e 0 to 0 dl 1786015581 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015570.793415:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c1223480 with x1872772280680576 ext(0->4095) 00002000:00010000:1.0:1786015570.793419:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74c1223480 00000100:00100000:1.0:1786015570.793447:0:17969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 126 00000100:00100000:1.0:1786015570.793455:0:17969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280680576:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1786015570.793667:0:17969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280680576:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 212us (1440us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786015570.793674:0:17969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 126 00002000:00100000:1.0:1786015570.793680:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1d:0x0] (0->4095) req@ffff8b74c1223480 x1872772280680576/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:416/0 lens 488/4536 e 0 to 0 dl 1786015581 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015570.793688:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c1223480 with x1872772280680576 ext(0->4095) 00002000:00010000:1.0:1786015570.793692:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74c1223480 00010000:00010000:2.0:1786015570.796322:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015570.801836:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.802167:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280680832 00000100:00100000:1.0:1786015570.802182:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280680832 00000100:00100000:1.0:1786015570.802334:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 429 00000100:00100000:1.0:1786015570.802347:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280680832:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015570.802378:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015570.802404:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000286d08cf/0xb1a5ef690c50387c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e91cc expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015570.802537:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304468352:192.168.202.56@tcp:106: 00000100:00100000:1.0:1786015570.802820:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b01b0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015570.806954:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.807423:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280680960 00000100:00100000:1.0:1786015570.807440:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280680960 00000100:00100000:1.0:1786015570.807607:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1532 00000100:00100000:1.0:1786015570.807621:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+58:33447:x1872772280680960:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015570.807657:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015570.807688:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503883 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e91d3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.807736:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50388a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.807786:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50388a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.807801:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50388a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.808137:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503883 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91d3 expref: 60 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.808168:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50388a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91d3 expref: 59 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.808179:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:1.0:1786015570.808183:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015570.808188:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921000, rc 0) 00000100:00100000:1.0:1786015570.808350:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+59:33447:x1872772280680960:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 732us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015570.808359:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1532 00000100:00100000:2.0:1786015570.814530:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.814891:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280681088 00000100:00100000:0.0:1786015570.814907:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280681088 00000100:00100000:0.0:1786015570.815133:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1533 00000100:00100000:0.0:1786015570.815147:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+59:33447:x1872772280681088:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015570.815272:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x2e:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015570.815437:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+59:33447:x1872772280681088:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 293us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015570.815445:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1533 00000100:00100000:1.0:1786015570.815680:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304468352:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015570.815728:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000286d08cf/0xb1a5ef690c50387c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91cc expref: 18 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.815793:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000286d08cf/0xb1a5ef690c50387c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91cc expref: 18 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.815811:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920400, rc 0) 00000100:00100000:1.0:1786015570.816087:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280680832:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 13741us (14265us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015570.816096:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 429 00000100:00100000:0.0:1786015570.824495:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.825333:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280681216 00000100:00100000:1.0:1786015570.825350:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280681216 00000100:00100000:1.0:1786015570.825427:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 430 00000100:00100000:1.0:1786015570.825441:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280681216:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015570.825506:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c503891 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.825528:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015570.825533:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015570.825540:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c503891 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.825557:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c503891 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.825600:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c503891 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.825609:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c503891 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.825618:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c503891 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.825626:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920400 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015570.825631:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c503891 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.825641:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c503891 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.825664:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c503891 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.825673:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000286d08cf/0xb1a5ef690c503891 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015570.826336:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280681216:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 895us (1853us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015570.826348:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 430 00000100:00100000:2.0:1786015570.826563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015570.827498:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280681472 00000100:00100000:3.0:1786015570.827511:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280681472 00000100:00100000:3.0:1786015570.827585:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1534 00000100:00100000:3.0:1786015570.827596:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+110:33450:x1872772280681472:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:3.0:1786015570.828195:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].46, 136 off14448 00000100:00100000:3.0:1786015570.829193:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+110:33450:x1872772280681472:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 1593us (2625us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015570.829330:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1534 00000100:00100000:2.0:1786015570.831290:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.844073:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280681728 00000100:00100000:1.0:1786015570.844098:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280681728 00000100:00100000:1.0:1786015570.844182:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1535 00000100:00100000:1.0:1786015570.844195:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+59:33447:x1872772280681728:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786015570.844573:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503898 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.844597:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50388a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91d3 expref: 59 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.844607:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503898 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.844657:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50388a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91d3 expref: 59 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.844674:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50388a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91d3 expref: 59 pid: 5794 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015570.844693:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304468480:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015570.845150:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b01b0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015570.849416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015570.849510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015570.849570:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280681984 00000100:00100000:3.0:1786015570.849582:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280681984 00010000:00010000:3.0:1786015570.849641:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50388a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91d3 expref: 60 pid: 5794 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015570.850160:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280681856 00000100:00100000:2.0:1786015570.850167:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280681856 00000100:00100000:2.0:1786015570.850289:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1536 00000100:00100000:2.0:1786015570.850302:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+110:33451:x1872772280681856:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1786015570.850327:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015570.850357:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50389f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e91da expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.850449:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5038a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.850466:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5038a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.850480:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5038a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.850503:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5038ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.850511:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5038ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.850518:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5038ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.850606:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5038a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.850615:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5038a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.850622:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5038a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.850629:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e7e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015570.850634:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5038a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.850643:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5038a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.850656:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015570.850660:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015570.850666:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5038a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.850673:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c5038a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015570.851096:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 450 00000100:00100000:3.0:1786015570.851109:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+60:2353:x1872772280681984:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015570.851124:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015570.851134:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50388a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91d3 expref: 60 pid: 5794 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.851149:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50388a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91d3 expref: 60 pid: 5794 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.851168:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:3.0:1786015570.851172:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503898 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.851182:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503898 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.851189:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503898 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.851405:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50388a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91d3 expref: 60 pid: 5794 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015570.851424:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304468480:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015570.851522:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5038ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.851530:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5038ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.851537:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5038ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.851543:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015570.851546:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5038ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.851553:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5038ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.851562:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff8b7487f06900) 00010000:00010000:2.0:1786015570.851564:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015570.851569:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5038ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.851576:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c5038ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.851622:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50389f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91da expref: 111 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.851632:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015570.851635:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015570.851639:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50389f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91da expref: 111 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.851648:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1e00, rc 0) 00000100:00100000:2.0:1786015570.851745:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+110:33451:x1872772280681856:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1446us (2344us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015570.851792:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1536 00010000:00010000:1.0:1786015570.861618:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503898 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015570.863223:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.863462:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280682112 00000100:00100000:0.0:1786015570.863476:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280682112 00000100:00100000:0.0:1786015570.863557:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1537 00000100:00100000:0.0:1786015570.863570:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+60:33452:x1872772280682112:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:0.0:1786015570.863601:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015570.863633:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5038b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e91e1 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.863732:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.863753:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.863802:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.863821:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5038c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.863830:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5038c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.863836:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5038c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.863952:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.863960:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.863968:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.863975:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.863981:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.863990:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.864003:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.864007:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.864012:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.864019:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.864034:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5038c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.864041:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5038c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.864047:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5038c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.864052:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.864056:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5038c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.864062:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5038c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.864070:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff8b748f24a100) 00010000:00010000:0.0:1786015570.864072:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.864075:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5038c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.864081:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5038c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.864123:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5038b4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91e1 expref: 61 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.864135:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.864137:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.864141:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5038b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91e1 expref: 61 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.864151:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7200, rc 0) 00000100:00100000:0.0:1786015570.864246:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+60:33452:x1872772280682112:12345-192.168.202.56@tcp:101:rm.0 Request processed in 679us (1044us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015570.864255:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1537 00010000:00010000:3.0:1786015570.868357:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015570.868700:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503898 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.868717:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503898 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.869073:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503898 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.869082:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503898 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.869089:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503898 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.869096:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.869100:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503898 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.869109:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503898 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.869133:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:0.0:1786015570.869136:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015570.869141:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503898 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.869148:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503898 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786015570.869802:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015570.869808:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015570.869860:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 47 count 5 00000040:00080000:2.0:1786015570.869867:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015570.870151:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304468608:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015570.870694:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+61:2353:x1872772280681984:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 19575us (21169us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015570.870708:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 450 00000100:00100000:0.0:1786015570.872598:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+60:33447:x1872772280681728:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 28391us (41306us total) trans 4294968330 rc 0/0 00000100:00100000:0.0:1786015570.872617:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1535 00000100:00100000:2.0:1786015570.873152:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7491d4b780 going to sleep for 11 seconds 00000100:00100000:2.0:1786015570.873422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015570.880010:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280682240 00000100:00100000:3.0:1786015570.880038:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280682240 00000100:00100000:3.0:1786015570.880158:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1538 00000100:00100000:3.0:1786015570.880171:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+60:33452:x1872772280682240:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015570.880212:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015570.880245:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5038c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e91e8 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880344:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5038d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880363:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5038d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880376:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5038d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880398:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5038d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880405:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5038d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880412:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5038d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880507:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5038d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880516:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5038d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880524:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5038d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880531:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015570.880536:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5038d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880545:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5038d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880560:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015570.880563:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015570.880569:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5038d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880575:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5038d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880593:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5038d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880600:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5038d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880606:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5038d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880611:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015570.880615:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5038d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880620:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5038d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880628:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff8b74b0022500) 00010000:00010000:3.0:1786015570.880630:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015570.880633:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5038d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880639:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c5038d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880679:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5038c9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91e8 expref: 61 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880693:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015570.880695:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015570.880698:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5038c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91e8 expref: 61 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.880708:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc200, rc 0) 00000100:00100000:3.0:1786015570.880853:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+60:33452:x1872772280682240:12345-192.168.202.56@tcp:101:rm.0 Request processed in 685us (7432us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015570.880861:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1538 00000100:00100000:3.0:1786015570.890262:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015570.890353:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.890783:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280682624 00000100:00100000:0.0:1786015570.890798:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280682624 00000100:00100000:0.0:1786015570.890885:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1539 00000100:00100000:0.0:1786015570.890898:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+60:33453:x1872772280682624:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015570.891102:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x2f:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015570.891261:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+60:33453:x1872772280682624:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 365us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015570.891269:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1539 00000100:00100000:1.0:1786015570.891731:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280682496 00000100:00100000:1.0:1786015570.891739:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280682496 00000100:00100000:2.0:1786015570.891946:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304468608:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786015570.900722:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 321 00000100:00100000:2.0:1786015570.900805:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+59:33447:x1872772280682496:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015570.901714:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+60:33447:x1872772280682496:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 971us (11460us total) trans 4294968331 rc 0/0 00000100:00100000:2.0:1786015570.901725:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 321 00000100:00100000:2.0:1786015570.913292:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.913428:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280682880 00000100:00100000:0.0:1786015570.913447:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280682880 00000100:00100000:0.0:1786015570.913529:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1540 00000100:00100000:0.0:1786015570.913542:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+60:33453:x1872772280682880:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015570.913577:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015570.913613:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5038de lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e91ef expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.913853:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5038e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.913875:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5038e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.913891:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5038e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015570.913907:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2f:0x0]: returning size 158 00010000:00010000:0.0:1786015570.914133:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5038de lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91ef expref: 63 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.914158:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5038e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91ef expref: 62 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.914170:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:0.0:1786015570.914174:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015570.914179:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7a00, rc 0) 00000100:00100000:0.0:1786015570.914275:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+62:33453:x1872772280682880:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 734us (997us total) trans 4294968332 rc 0/0 00000100:00100000:0.0:1786015570.914283:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1540 00000100:00100000:3.0:1786015570.918630:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.919324:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280683008 00000100:00100000:0.0:1786015570.919341:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280683008 00000100:00100000:0.0:1786015570.919430:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1541 00000100:00100000:0.0:1786015570.919443:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+62:33454:x1872772280683008:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015570.919479:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015570.919510:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5038f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e91f6 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.919614:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.919632:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.919647:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.919665:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503901 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.919673:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.919681:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.920162:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.920174:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.920181:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.920188:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.920194:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.920207:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.920224:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.920227:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.920233:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.920240:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c5038fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.920256:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.920263:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503901 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.920268:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503901 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.920273:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.920276:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503901 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.920281:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503901 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.920289:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff8b748f24a100) 00010000:00010000:0.0:1786015570.920291:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.920294:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503901 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.920304:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503901 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.920360:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5038f3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91f6 expref: 63 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.920372:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.920374:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.920378:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c5038f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91f6 expref: 63 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.920388:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7200, rc 0) 00000100:00100000:0.0:1786015570.920494:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+62:33454:x1872772280683008:12345-192.168.202.56@tcp:101:cp.0 Request processed in 1052us (1879us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015570.920504:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1541 00000100:00100000:1.0:1786015570.926717:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015570.927432:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280683264 00000100:00100000:3.0:1786015570.927459:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280683264 00000100:00100000:3.0:1786015570.927556:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 76 00000100:00100000:3.0:1786015570.927569:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+62:2351:x1872772280683264:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015570.927591:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015570.927630:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c5038e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91ef expref: 62 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.927657:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:3.0:1786015570.927663:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015570.927795:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+61:2351:x1872772280683264:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 228us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015570.927804:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 76 00000100:00100000:2.0:1786015570.931524:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.931621:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280683136 00000100:00100000:1.0:1786015570.931637:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280683136 00000100:00100000:1.0:1786015570.931714:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 431 00000100:00100000:1.0:1786015570.931727:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280683136:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015570.931859:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503908 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.931888:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91a2 expref: 11 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.931900:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x20:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786015570.931905:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015570.931911:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503908 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.931978:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503821 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91a2 expref: 11 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.931997:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503821 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91a2 expref: 11 pid: 6591 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015570.932020:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304468736:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015570.932145:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b01b0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015570.934912:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015570.935125:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280683392 00000100:00100000:2.0:1786015570.935140:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280683392 00000100:00100000:2.0:1786015570.935219:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1542 00000100:00100000:2.0:1786015570.935231:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+61:33454:x1872772280683392:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015570.935270:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015570.935301:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c50390f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e91fd expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935398:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c503916 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935416:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c503916 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935431:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c503916 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935449:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50391d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935457:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50391d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935464:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50391d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935553:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c503916 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935562:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c503916 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935569:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c503916 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935576:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e6000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015570.935581:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c503916 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935590:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c503916 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935604:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015570.935608:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015570.935613:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c503916 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935619:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c503916 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935635:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50391d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935641:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50391d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935647:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50391d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935651:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015570.935654:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50391d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935661:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50391d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935668:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff8b7487f06900) 00010000:00010000:2.0:1786015570.935671:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015570.935674:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50391d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935680:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50391d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935724:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c50390f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91fd expref: 62 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935736:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015570.935739:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015570.935743:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c50390f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91fd expref: 62 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.935798:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e7e00, rc 0) 00000100:00100000:2.0:1786015570.936040:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+61:33454:x1872772280683392:12345-192.168.202.56@tcp:101:cp.0 Request processed in 811us (1147us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015570.936047:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1542 00000100:00100000:3.0:1786015570.941452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.941586:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304468736:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015570.941625:0:14547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503908 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015570.941731:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280683520 00000100:00100000:0.0:1786015570.941742:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280683520 00002000:00100000:0.0:1786015570.941863:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x20:0x0] (0->157) req@ffff8b73824f6300 x1872772280683520/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:416/0 lens 648/0 e 0 to 0 dl 1786015581 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015570.941875:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b73824f6300 with x1872772280683520 ext(0->157) 00010000:00010000:0.0:1786015570.941884:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503821 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91a2 expref: 12 pid: 6591 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.941903:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503821 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91a2 expref: 12 pid: 6591 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015570.941918:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b73824f6300 00000100:00100000:0.0:1786015570.941972:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:0.0:1786015570.941984:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280683520:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:0.0:1786015570.943177:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2354:x1872772280683520:12345-192.168.202.56@tcp:4:cp.0 Request processed in 1181us (1733us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1786015570.943192:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00002000:00100000:0.0:1786015570.943206:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x20:0x0] (0->157) req@ffff8b73824f6300 x1872772280683520/t4294967391(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:416/0 lens 648/448 e 0 to 0 dl 1786015581 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015570.943217:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b73824f6300 with x1872772280683520 ext(0->157) 00010000:00010000:0.0:1786015570.943229:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503821 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91a2 expref: 14 pid: 6591 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.943251:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503821 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91a2 expref: 14 pid: 6591 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015570.943259:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b73824f6300 00000100:00100000:1.0:1786015570.944858:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015570.945278:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280683776 00000100:00100000:3.0:1786015570.945295:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280683776 00000100:00100000:3.0:1786015570.945379:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1543 00000100:00100000:3.0:1786015570.945392:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+61:33454:x1872772280683776:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015570.945426:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015570.945458:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c503924 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9204 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.945647:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50392b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.945675:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503875 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91c5 expref: 109 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.945742:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50392b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.945919:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91c5 expref: 109 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.945995:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503875 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91c5 expref: 109 pid: 7673 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015570.946019:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304468864:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015570.948782:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7483ea6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786015570.950833:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.954877:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304468864:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015570.954926:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50392b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015570.957788:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.958024:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280683904 00000100:00100000:0.0:1786015570.958040:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280683904 00010000:00010000:0.0:1786015570.958106:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503821 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91a2 expref: 14 pid: 6591 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015570.958160:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280684032 00000100:00100000:0.0:1786015570.958164:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280684032 00010000:00010000:0.0:1786015570.958183:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503875 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91c5 expref: 110 pid: 7673 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015570.958230:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 451 00000100:00100000:0.0:1786015570.958241:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2353:x1872772280683904:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015570.958265:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015570.958301:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503821 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91a2 expref: 14 pid: 6591 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.958320:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503821 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91a2 expref: 14 pid: 6591 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.958352:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503821 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91a2 expref: 14 pid: 6591 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.958376:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015570.958383:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015570.958390:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503908 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.958402:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503908 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.958443:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015570.958519:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280683904:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 278us (7700us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015570.958527:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 451 00000100:00100000:0.0:1786015570.958547:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 452 00000100:00100000:0.0:1786015570.958554:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+110:2354:x1872772280684032:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015570.958565:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015570.958571:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503875 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91c5 expref: 110 pid: 7673 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.958581:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91c5 expref: 110 pid: 7673 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.958599:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503875 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91c5 expref: 110 pid: 7673 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.958613:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.958618:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50392b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.958628:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50392b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.958636:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50392b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.958660:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015570.958682:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+109:2354:x1872772280684032:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 128us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015570.958689:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 452 00010000:00010000:0.0:1786015570.958718:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50392b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.958727:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50392b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.958816:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503932 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.958828:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503932 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.958836:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503932 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786015570.959605:0:12526:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e:0x0], index 0: 0 00010000:00010000:0.0:1786015570.959905:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503939 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.959919:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.959928:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.959987:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50392b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.959995:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50392b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.960003:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50392b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.960010:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.960016:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50392b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.960025:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50392b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.960037:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015570.960041:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.960045:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50392b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.960051:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50392b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015570.960068:0:12526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c66b47e9 reply state 00000000f63f160a transno 4294968333 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503932 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015570.960079:0:12526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786015570.960130:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c503924 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9204 expref: 64 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.960146:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503939 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9204 expref: 63 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.960154:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8b749232d500) 00010000:00010000:0.0:1786015570.960158:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015570.960160:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7000, rc 0) 00000100:00100000:0.0:1786015570.960230:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+64:33454:x1872772280683776:12345-192.168.202.56@tcp:101:cp.0 Request processed in 14841us (15394us total) trans 4294968333 rc 0/0 00000100:00100000:0.0:1786015570.960239:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1543 00010000:00010000:1.0:1786015570.960707:0:14547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503908 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.960722:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503908 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.960805:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503908 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.960815:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503908 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.960824:0:14547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503908 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.960831:0:14547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921000 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015570.960837:0:14547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503908 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.960845:0:14547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503908 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.960866:0:14547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503908 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.960875:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503908 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015570.960955:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280683136:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 29229us (29444us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015570.960968:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 431 00000100:00100000:3.0:1786015570.968019:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015570.968707:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280684288 00000100:00100000:2.0:1786015570.968722:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280684288 00000100:00100000:2.0:1786015570.968868:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1544 00000100:00100000:2.0:1786015570.968880:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+64:33453:x1872772280684288:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015570.970453:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+64:33453:x1872772280684288:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 1560us (2439us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015570.970471:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1544 00000100:00100000:3.0:1786015570.970642:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:0.0:1786015570.972592:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503932 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.972613:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503932 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.972623:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503932 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.972630:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015570.972636:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503932 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.972645:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503932 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.972669:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff8b748f24a100) 00010000:00010000:0.0:1786015570.972672:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015570.972678:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503932 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.972684:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7200/0xb1a5ef690c503932 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015570.972849:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280684416 00000100:00100000:2.0:1786015570.972863:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280684416 00000100:00100000:2.0:1786015570.972952:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 432 00000100:00100000:2.0:1786015570.972965:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280684416:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015570.972998:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015570.973032:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5813b81/0xb1a5ef690c503947 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e920b expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015570.973071:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786015570.973107:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=806s v=(0 0) 00010000:00010000:2.0:1786015570.973113:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015570.973128:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5813b81/0xb1a5ef690c503947 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e920b expref: 12 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.973150:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f5813b81/0xb1a5ef690c503947 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e920b expref: 12 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015570.973166:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1e00, rc 0) 00000100:00100000:2.0:1786015570.973264:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2352:x1872772280684416:12345-192.168.202.56@tcp:101:cp.0 Request processed in 300us (2621us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015570.973272:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 432 00000100:00100000:3.0:1786015570.979826:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.979991:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280684544 00000100:00100000:1.0:1786015570.980006:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280684544 00000100:00100000:1.0:1786015570.980082:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 433 00000100:00100000:1.0:1786015570.980094:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280684544:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015570.980119:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015570.980156:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000286d08cf/0xb1a5ef690c50394e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9212 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015570.980203:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 158, mtime: 0x6a746f52, atime: 0x0, ctime: 0x6a746f52, blocks: 0x1 00010000:00010000:1.0:1786015570.980235:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=806s v=(0 0) 00010000:00010000:1.0:1786015570.980241:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015570.980254:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000286d08cf/0xb1a5ef690c50394e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9212 expref: 13 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.980277:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000286d08cf/0xb1a5ef690c50394e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9212 expref: 13 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015570.980295:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920400, rc 0) 00000100:00100000:1.0:1786015570.980587:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280684544:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 494us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015570.980596:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 433 00000100:00100000:3.0:1786015570.991501:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015570.992244:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280684672 00000100:00100000:0.0:1786015570.992260:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280684672 00000100:00100000:0.0:1786015570.992348:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 434 00000100:00100000:0.0:1786015570.992363:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:33454:x1872772280684672:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015570.992395:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015570.992426:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c503955 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9219 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.992477:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5813b81/0xb1a5ef690c503947 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e920b expref: 13 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.992489:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015570.992495:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015570.992502:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c503955 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9219 expref: 13 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.992560:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f5813b81/0xb1a5ef690c503947 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e920b expref: 13 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.992578:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f5813b81/0xb1a5ef690c503947 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e920b expref: 13 pid: 6592 timeout: 906 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015570.992596:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1220000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304468992:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015570.992727:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7484fffe40 going to sleep for 11 seconds 00000100:00100000:1.0:1786015570.997679:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015570.997846:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015570.997985:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280684928 00000100:00100000:2.0:1786015570.997998:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280684928 00000100:00100000:2.0:1786015570.998101:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1545 00000100:00100000:2.0:1786015570.998115:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+63:33453:x1872772280684928:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015570.998292:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+63:33453:x1872772280684928:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 181us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015570.998301:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1545 00000100:00100000:0.0:1786015570.998626:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1220000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304468992:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015570.998669:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c503955 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9219 expref: 13 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015570.998700:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7200, rc 0) 00000100:00100000:0.0:1786015570.998729:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+13:33454:x1872772280684672:12345-192.168.202.56@tcp:101:cp.0 Request processed in 6372us (7248us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015570.998738:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 434 00000100:00100000:3.0:1786015570.999014:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280685056 00000100:00100000:3.0:1786015570.999020:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280685056 00010000:00010000:3.0:1786015570.999053:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f5813b81/0xb1a5ef690c503947 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e920b expref: 13 pid: 6592 timeout: 906 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015570.999079:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 453 00000100:00100000:3.0:1786015570.999088:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280685056:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015570.999105:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015570.999135:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f5813b81/0xb1a5ef690c503947 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e920b expref: 13 pid: 6592 timeout: 906 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.999150:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f5813b81/0xb1a5ef690c503947 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e920b expref: 13 pid: 6592 timeout: 906 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.999179:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5813b81/0xb1a5ef690c503947 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e920b expref: 13 pid: 6592 timeout: 906 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.999212:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015570.999217:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015570.999228:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c503955 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9219 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.999240:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c503955 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9219 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015570.999281:0:5780:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c503955 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9219 expref: 12 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015570.999297:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5780:1872772304469120:192.168.202.56@tcp:105: 00000100:00100000:3.0:1786015570.999369:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7483ea6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015571.007012:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5780:1872772304469120:192.168.202.56@tcp:105: 00010000:00010000:1.0:1786015571.007059:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015571.007151:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280685056:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 8062us (9301us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015571.007166:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 453 00000100:00100000:3.0:1786015571.013172:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015571.013268:0:17970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280685184 00000100:00100000:0.0:1786015571.013282:0:17970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280685184 00002000:00100000:0.0:1786015571.013350:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x20:0x0] (0->4095) req@ffff8b73824f7100 x1872772280685184/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:417/0 lens 488/0 e 0 to 0 dl 1786015582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015571.013363:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b73824f7100 with x1872772280685184 ext(0->4095) 00002000:00010000:0.0:1786015571.013370:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b73824f7100 00000100:00100000:0.0:1786015571.013413:0:17970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 127 00000100:00100000:0.0:1786015571.013426:0:17970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280685184:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1786015571.013744:0:17970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280685184:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 319us (590us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786015571.013913:0:17970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 127 00002000:00100000:0.0:1786015571.013925:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x20:0x0] (0->4095) req@ffff8b73824f7100 x1872772280685184/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:417/0 lens 488/4536 e 0 to 0 dl 1786015582 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015571.013934:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b73824f7100 with x1872772280685184 ext(0->4095) 00002000:00010000:0.0:1786015571.017575:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b73824f7100 00000100:00100000:3.0:1786015571.028274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015571.028341:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015571.028455:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280685568 00000100:00100000:2.0:1786015571.028472:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280685568 00000100:00100000:2.0:1786015571.028571:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 322 00000100:00100000:2.0:1786015571.028584:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+63:33454:x1872772280685568:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:2.0:1786015571.029193:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+64:33454:x1872772280685568:12345-192.168.202.56@tcp:35:cp.0 Request processed in 607us (845us total) trans 4294968334 rc 0/0 00000100:00100000:2.0:1786015571.029203:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 322 00000100:00100000:1.0:1786015571.030278:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280685312 00000100:00100000:1.0:1786015571.030298:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280685312 00000100:00100000:1.0:1786015571.030384:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1546 00000100:00100000:1.0:1786015571.030396:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+64:33453:x1872772280685312:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015571.030424:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015571.030461:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50395c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9220 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.030512:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c503963 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.030531:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c503963 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.030546:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c503963 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.030672:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c50395c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9220 expref: 66 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.030697:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c503963 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9220 expref: 65 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.030708:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:1.0:1786015571.030712:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015571.030716:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921400, rc 0) 00000100:00100000:1.0:1786015571.030875:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+65:33453:x1872772280685312:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 481us (2616us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015571.030883:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1546 00000100:00100000:3.0:1786015571.049649:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015571.053620:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280685696 00000100:00100000:2.0:1786015571.053647:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280685696 00000100:00100000:2.0:1786015571.053791:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1547 00000100:00100000:2.0:1786015571.053805:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+65:33453:x1872772280685696:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015571.053875:0:7673:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x2f:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015571.054084:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+65:33453:x1872772280685696:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 279us (4447us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015571.054094:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1547 00000100:00100000:3.0:1786015571.065116:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015571.066331:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280685824 00000100:00100000:0.0:1786015571.066350:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280685824 00000100:00100000:0.0:1786015571.066427:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 435 00000100:00100000:0.0:1786015571.066440:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280685824:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786015571.066514:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e8ee1ece/0xb1a5ef690c50396a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.066538:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015571.066543:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015571.066551:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8ee1ece/0xb1a5ef690c50396a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.066568:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8ee1ece/0xb1a5ef690c50396a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.066612:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e8ee1ece/0xb1a5ef690c50396a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.066622:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8ee1ece/0xb1a5ef690c50396a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.066631:0:11384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8ee1ece/0xb1a5ef690c50396a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.066638:0:11384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015571.066644:0:11384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8ee1ece/0xb1a5ef690c50396a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.066654:0:11384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8ee1ece/0xb1a5ef690c50396a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.066690:0:11384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8ee1ece/0xb1a5ef690c50396a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.066700:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8ee1ece/0xb1a5ef690c50396a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015571.067219:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280685824:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 777us (2112us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015571.067231:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 435 00000100:00100000:1.0:1786015571.085023:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015571.085239:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280686080 00000100:00100000:2.0:1786015571.085254:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280686080 00000100:00100000:2.0:1786015571.085333:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1548 00000100:00100000:2.0:1786015571.085345:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+65:33453:x1872772280686080:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1786015571.085462:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503971 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.085484:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c503963 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9220 expref: 65 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.085494:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503971 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.085544:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c503963 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9220 expref: 65 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.085560:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c503963 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9220 expref: 65 pid: 12526 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015571.085576:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304469248:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015571.085694:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786015571.092920:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304469248:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015571.092970:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503971 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015571.093901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015571.094020:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280686208 00000100:00100000:0.0:1786015571.094034:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280686208 00010000:00010000:0.0:1786015571.094087:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c503963 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9220 expref: 66 pid: 12526 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015571.094129:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 454 00000100:00100000:0.0:1786015571.094140:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabf7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+66:2353:x1872772280686208:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015571.094159:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015571.094168:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c503963 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9220 expref: 66 pid: 12526 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.094182:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c503963 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9220 expref: 66 pid: 12526 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.094230:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c503963 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9220 expref: 66 pid: 12526 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.094255:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:0.0:1786015571.094262:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503971 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.094275:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503971 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.094285:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503971 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.094317:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015571.094400:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabf7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+65:2353:x1872772280686208:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 260us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015571.094408:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 454 00010000:00010000:2.0:1786015571.094744:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503971 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.094776:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503971 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.095083:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503971 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.095093:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503971 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.095100:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503971 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.095108:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015571.095113:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503971 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.095121:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503971 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.095139:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:2.0:1786015571.095143:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015571.095147:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503971 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.095153:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503971 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015571.095480:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+65:33453:x1872772280686080:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 10133us (10469us total) trans 4294968335 rc 0/0 00000100:00100000:2.0:1786015571.095492:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1548 00000040:00080000:3.0:1786015571.096417:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015571.096425:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1786015571.098400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000040:00080000:3.0:1786015571.098431:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:3.0:1786015571.098447:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015571.098987:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280686464 00000100:00100000:2.0:1786015571.099004:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280686464 00000100:00100000:2.0:1786015571.099097:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 323 00000100:00100000:2.0:1786015571.099110:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+65:33453:x1872772280686464:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015571.099563:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+66:33453:x1872772280686464:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 454us (1173us total) trans 4294968336 rc 0/0 00000100:00100000:2.0:1786015571.099571:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 323 00000100:00100000:2.0:1786015571.117639:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304469376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015571.117794:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015571.120521:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304469376 00000100:00100000:0.0:1786015571.120541:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304469376 00000100:00100000:0.0:1786015571.120636:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1786015571.120650:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304469376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015571.120697:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 1703936 free 3857711104 avail 3855613952 00000100:00080000:3.0:1786015571.120798:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015571.120853:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304469376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 206us (3097us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015571.120862:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1786015571.123372:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304469376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015571.136236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015571.136287:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280686592 00000100:00100000:2.0:1786015571.136298:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280686592 00000100:00100000:2.0:1786015571.136369:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1549 00000100:00100000:2.0:1786015571.136380:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+109:33457:x1872772280686592:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015571.136409:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015571.136439:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503978 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9227 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.136534:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50397f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.136551:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50397f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.136567:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50397f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.136586:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503986 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.136592:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.136599:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.136748:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c50398d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.136794:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c50398d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.136802:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c50398d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015571.146298:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x30:0x0]: returning size 158 00000004:00200000:2.0:1786015571.146320:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015571.146372:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c50398d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.146398:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c50398d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.146412:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50397f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.146419:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50397f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.146427:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50397f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.146434:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015571.146438:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50397f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.146447:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50397f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.146465:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015571.146468:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015571.146474:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50397f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.146480:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c50397f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.146498:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.146505:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503986 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.146512:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503986 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.146518:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e7e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015571.146521:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503986 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.146527:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503986 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.146535:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff8b7487f06800) 00010000:00010000:2.0:1786015571.146538:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015571.146541:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503986 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.146547:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503986 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.146607:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503978 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9227 expref: 111 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.146624:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c50398d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9227 expref: 110 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.146633:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8b749232d500) 00010000:00010000:2.0:1786015571.146635:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015571.146639:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e6000, rc 0) 00000100:00100000:2.0:1786015571.146791:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+110:33457:x1872772280686592:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 10411us (10567us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015571.146805:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1549 00000100:00100000:0.0:1786015571.163632:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015571.163701:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015571.163743:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280686848 00000100:00100000:0.0:1786015571.163788:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280686848 00000100:00100000:0.0:1786015571.163867:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 75 00000100:00100000:0.0:1786015571.163881:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:41677fca-39fb-471c-b582-96bce6540a36+110:2352:x1872772280686848:12345-192.168.202.56@tcp:63:ll_sa.0 00010000:00010000:0.0:1786015571.163975:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015571.164006:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503994 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9235 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164087:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50399b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164106:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50399b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164120:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50399b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164139:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5039a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164146:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5039a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164153:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5039a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164603:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50399b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164614:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50399b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164621:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50399b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164632:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015571.164638:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50399b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164646:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50399b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164661:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015571.164664:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015571.164671:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50399b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164677:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6600/0xb1a5ef690c50399b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164691:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5039a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164697:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5039a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164703:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5039a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164708:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015571.164710:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5039a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164716:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5039a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164727:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff8b7482d4b200) 00010000:00010000:0.0:1786015571.164730:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015571.164733:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5039a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164740:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c5039a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164810:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503994 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9235 expref: 111 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.164820:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015571.164823:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786015571.164827:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503994 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9235 expref: 111 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.165119:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6400, rc -2) 00000100:00100000:0.0:1786015571.166087:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:41677fca-39fb-471c-b582-96bce6540a36+110:2352:x1872772280686848:12345-192.168.202.56@tcp:63:ll_sa.0 Request processed in 2199us (2374us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786015571.166105:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 75 00000100:00100000:0.0:1786015571.167029:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280686720 00000100:00100000:0.0:1786015571.167045:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280686720 00000100:00100000:0.0:1786015571.167126:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 436 00000100:00100000:0.0:1786015571.167138:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280686720:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015571.167166:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015571.169308:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af40c25c/0xb1a5ef690c5039a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e922e expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015571.169414:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1220380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304469504:192.168.202.56@tcp:106: 00000100:00100000:0.0:1786015571.169534:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7490fa2600 going to sleep for 11 seconds 00002000:00010000:0.0:1786015571.175716:0:6591:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size: 0 -> 158 00002000:00010000:0.0:1786015571.175731:0:6591:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb mtime: 0 -> 1786015571 00002000:00010000:0.0:1786015571.175734:0:6591:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb atime: 0 -> 1786015571 00002000:00010000:0.0:1786015571.175736:0:6591:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb ctime: 0 -> 1786015571 00000100:00100000:0.0:1786015571.175800:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1220380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304469504:192.168.202.56@tcp:106: 00010000:00010000:0.0:1786015571.175865:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000af40c25c/0xb1a5ef690c5039a9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e922e expref: 17 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.175899:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af40c25c/0xb1a5ef690c5039a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e922e expref: 17 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.175918:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7800, rc 0) 00000100:00100000:0.0:1786015571.176060:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280686720:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 8923us (12444us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015571.176071:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 436 00000100:00100000:1.0:1786015571.181957:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015571.182019:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280686976 00000100:00100000:1.0:1786015571.182032:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280686976 00000100:00100000:1.0:1786015571.182101:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1550 00000100:00100000:1.0:1786015571.182112:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+110:33457:x1872772280686976:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015571.182152:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015571.182184:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5039b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e926d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.182280:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5039b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.182299:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5039b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.182313:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5039b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015571.182397:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:1.0:1786015571.182402:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015571.182431:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5039b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.182465:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5039b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e926d expref: 112 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.182484:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5039b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e926d expref: 111 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.182495:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015571.182498:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015571.182502:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920600, rc 0) 00000100:00100000:0.0:1786015571.189410:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+111:33457:x1872772280686976:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 7281us (7451us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015571.189427:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1550 00000100:00100000:2.0:1786015571.225898:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015571.226140:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280687104 00000100:00100000:1.0:1786015571.226156:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280687104 00000100:00100000:1.0:1786015571.226237:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 437 00000100:00100000:1.0:1786015571.226251:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280687104:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015571.226279:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015571.226307:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0572f25/0xb1a5ef690c5039be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9274 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015571.226397:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304469632:192.168.202.56@tcp:106: 00000100:00100000:1.0:1786015571.226509:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b01b0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015571.235327:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304469632:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015571.235381:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b0572f25/0xb1a5ef690c5039be lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9274 expref: 17 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.235413:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0572f25/0xb1a5ef690c5039be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9274 expref: 17 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.235429:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921400, rc 0) 00000100:00100000:1.0:1786015571.235530:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280687104:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 9281us (9646us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015571.235541:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 437 00000100:00100000:2.0:1786015571.281080:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015571.281164:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280687360 00000100:00100000:2.0:1786015571.281186:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280687360 00000100:00100000:2.0:1786015571.281257:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1551 00000100:00100000:2.0:1786015571.281270:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+111:33457:x1872772280687360:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:2.0:1786015571.281611:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].47, 136 off14584 00000100:00100000:2.0:1786015571.281733:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+111:33457:x1872772280687360:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 464us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015571.281742:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1551 00000100:00100000:2.0:1786015571.306365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015571.306437:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015571.306561:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280687488 00000100:00100000:1.0:1786015571.306575:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280687488 00000100:00100000:1.0:1786015571.306655:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1552 00000100:00100000:1.0:1786015571.306668:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+111:33460:x1872772280687488:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1786015571.306709:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015571.306739:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c5039c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e927b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.306889:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5039cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.306908:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5039cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.306923:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5039cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.307467:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5039d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.307478:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5039d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.307487:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5039d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.307577:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5039cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.307586:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5039cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.307598:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5039cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.307605:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015571.307611:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5039cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.307619:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5039cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.307635:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015571.307638:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015571.307643:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5039cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.307649:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c5039cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.307662:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5039d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.307669:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5039d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.307675:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5039d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.311496:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015571.311508:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5039d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.311530:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5039d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.311556:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff8b748f194000) 00010000:00010000:1.0:1786015571.311559:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015571.311565:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5039d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.311573:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5039d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.311658:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c5039c5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e927b expref: 112 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.311671:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015571.311673:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015571.311677:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921400/0xb1a5ef690c5039c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e927b expref: 112 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.311707:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921400, rc 0) 00000100:00100000:1.0:1786015571.312713:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+111:33460:x1872772280687488:12345-192.168.202.56@tcp:101:bash.0 Request processed in 6035us (6350us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015571.312727:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1552 00000100:00100000:1.0:1786015571.315128:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280687616 00000100:00100000:1.0:1786015571.315152:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280687616 00000100:00100000:1.0:1786015571.316425:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 76 00000100:00100000:1.0:1786015571.316444:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:41677fca-39fb-471c-b582-96bce6540a36+111:2353:x1872772280687616:12345-192.168.202.56@tcp:63:ll_sa.0 00010000:00010000:1.0:1786015571.316500:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015571.316530:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5039da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9282 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.316605:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5039e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.316622:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5039e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.316635:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5039e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.316653:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5039e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.316660:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5039e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.316667:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5039e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.316794:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5039e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.316803:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5039e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.316809:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5039e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.316815:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015571.316821:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5039e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.316830:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5039e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.322143:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015571.322158:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015571.322432:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5039e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.322447:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c5039e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.322476:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5039e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.322484:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5039e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.322492:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5039e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.322498:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015571.322504:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5039e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.322512:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5039e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.322526:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x996ea506 (ffff8b748f194f00) 00010000:00010000:1.0:1786015571.322529:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015571.322533:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5039e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.322538:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5039e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.322602:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5039da lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9282 expref: 112 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.322615:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015571.322617:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786015571.322621:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c5039da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9282 expref: 112 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.322633:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921c00, rc -2) 00000100:00100000:0.0:1786015571.323470:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:41677fca-39fb-471c-b582-96bce6540a36+111:2353:x1872772280687616:12345-192.168.202.56@tcp:63:ll_sa.0 Request processed in 7022us (17022us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786015571.323485:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 76 00000100:00100000:1.0:1786015571.339703:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015571.341259:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280687744 00000100:00100000:3.0:1786015571.341280:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280687744 00000100:00100000:3.0:1786015571.341385:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1553 00000100:00100000:3.0:1786015571.341400:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+66:33461:x1872772280687744:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015571.341438:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015571.341473:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5039ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9289 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.341597:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5039f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.341614:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5039f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.341628:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5039f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.341645:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5039fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.341652:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5039fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.341671:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5039fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.342147:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5039f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.342157:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5039f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.342164:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5039f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.342171:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.342176:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5039f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.342186:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5039f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.342201:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015571.342204:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.342210:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5039f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.342217:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5039f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.342233:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5039fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.342239:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5039fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.342245:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5039fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.342249:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.342252:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5039fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.342258:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5039fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.342264:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff8b749802e800) 00010000:00010000:3.0:1786015571.342266:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.342269:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5039fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.342274:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5039fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.342326:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5039ef lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9289 expref: 67 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.342338:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015571.342341:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.342344:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5039ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9289 expref: 67 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.342354:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc200, rc 0) 00000100:00100000:3.0:1786015571.342991:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+66:33461:x1872772280687744:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1590us (3305us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015571.343006:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1553 00000001:00080000:3.0:1786015571.348182:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967376 is committed 00000100:00100000:2.0:1786015571.380569:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015571.380736:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280687872 00000100:00100000:0.0:1786015571.380787:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280687872 00000100:00100000:0.0:1786015571.380869:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1554 00000100:00100000:0.0:1786015571.380882:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+66:33461:x1872772280687872:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:0.0:1786015571.380912:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015571.380944:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503a04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9290 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381044:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503a0b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381062:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503a0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381076:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503a0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381093:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381101:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381108:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381195:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503a0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381204:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503a0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381211:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503a0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381218:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015571.381224:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503a0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381232:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503a0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381247:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015571.381250:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015571.381256:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503a0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381263:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503a0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381278:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381285:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381290:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381295:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015571.381297:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381303:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381315:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff8b7482d4b200) 00010000:00010000:0.0:1786015571.381318:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015571.381321:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381327:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381370:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503a04 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9290 expref: 67 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381382:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015571.381385:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015571.381389:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503a04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9290 expref: 67 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.381399:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7800, rc 0) 00000100:00100000:0.0:1786015571.381475:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+66:33461:x1872772280687872:12345-192.168.202.56@tcp:101:rm.0 Request processed in 596us (921us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015571.381484:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1554 00000100:00100000:3.0:1786015571.405103:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015571.405339:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280688000 00000100:00100000:1.0:1786015571.405352:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280688000 00000100:00100000:1.0:1786015571.405466:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1555 00000100:00100000:1.0:1786015571.405478:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+66:33462:x1872772280688000:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015571.405514:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015571.405541:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503a19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9297 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.405626:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503a20 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.405642:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503a20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.405668:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503a20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.405691:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503a27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.405699:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503a27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.405706:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503a27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.408024:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503a20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.408048:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503a20 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.408057:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503a20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.408064:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.408070:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503a20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.408079:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503a20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.408101:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015571.408105:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.408110:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503a20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.408118:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c503a20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.408141:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503a27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.408147:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503a27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.408155:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503a27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.408161:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.408164:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503a27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.408170:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503a27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.408178:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff8b748f194f00) 00010000:00010000:3.0:1786015571.408181:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.408184:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503a27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.408190:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c503a27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.408259:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503a19 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9297 expref: 67 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.408272:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015571.408274:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.408278:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c503a19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9297 expref: 67 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.408288:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921c00, rc 0) 00000100:00100000:3.0:1786015571.408405:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+66:33462:x1872772280688000:12345-192.168.202.56@tcp:101:cp.0 Request processed in 2926us (3313us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015571.408420:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1555 00000100:00100000:1.0:1786015571.416361:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015571.416454:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280688128 00000100:00100000:3.0:1786015571.416469:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280688128 00000100:00100000:3.0:1786015571.416558:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1556 00000100:00100000:3.0:1786015571.416571:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+66:33462:x1872772280688128:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015571.416600:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015571.416629:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c503a2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e929e expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.416730:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.416790:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.416806:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.416824:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503a3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.416831:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.416838:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.416944:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.416958:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.416966:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.416974:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.416980:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.416989:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.417004:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015571.417007:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.417012:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.417018:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.417033:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.417039:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503a3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.417046:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503a3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.417050:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.417054:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503a3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.417060:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503a3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.417067:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff8b749802e800) 00010000:00010000:3.0:1786015571.417069:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.417072:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503a3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.417078:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503a3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.417122:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c503a2e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e929e expref: 67 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.417134:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015571.417136:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.417140:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c503a2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e929e expref: 67 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.417152:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afce00, rc 0) 00000100:00100000:3.0:1786015571.417238:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+66:33462:x1872772280688128:12345-192.168.202.56@tcp:101:cp.0 Request processed in 669us (890us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015571.417248:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1556 00000100:00100000:1.0:1786015571.421071:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015571.421667:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280688384 00000100:00100000:2.0:1786015571.421684:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280688384 00000100:00100000:2.0:1786015571.421823:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1557 00000100:00100000:2.0:1786015571.421836:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+66:33462:x1872772280688384:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015571.422143:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015571.422175:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503a43 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e92a5 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.422363:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.422384:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5039b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e926d expref: 110 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.422400:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a4a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.422446:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5039b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e926d expref: 110 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.422462:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5039b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e926d expref: 110 pid: 5796 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015571.422481:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383749500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304469760:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015571.427455:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015571.429225:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280688512 00000100:00100000:3.0:1786015571.429245:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280688512 00010000:00010000:3.0:1786015571.429319:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5039b7 lrc: 6/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e926d expref: 111 pid: 5796 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015571.429389:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 455 00000100:00100000:3.0:1786015571.429400:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+111:2353:x1872772280688512:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015571.429423:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015571.429433:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5039b7 lrc: 6/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e926d expref: 111 pid: 5796 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.429452:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5039b7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e926d expref: 111 pid: 5796 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.429485:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015571.429491:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.429503:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.429522:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a4a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.429551:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015571.429641:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+111:2353:x1872772280688512:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 242us (2524us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015571.429650:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 455 00000100:00100000:0.0:1786015571.431292:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b73848723c0 going to sleep for 11 seconds 00010000:00010000:0.0:1786015571.431357:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5039b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e926d expref: 110 pid: 5796 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015571.431384:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383749500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304469760:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015571.431413:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.431428:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.431435:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.431467:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503a51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.431481:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503a51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.431492:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503a51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786015571.432276:0:12526:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21:0x0], index 1: 0 00010000:00010000:0.0:1786015571.432506:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.432520:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.432530:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.432578:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.432587:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a4a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.432599:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.432606:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015571.432612:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.432621:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a4a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.432635:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015571.432638:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015571.432644:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a4a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.432650:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015571.432665:0:12526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bfc71b76 reply state 0000000031ab1b0c transno 4294968337 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503a51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015571.432675:0:12526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786015571.432720:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503a43 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92a5 expref: 69 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.432738:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92a5 expref: 68 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.432745:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8b7482d4bb00) 00010000:00010000:0.0:1786015571.432810:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015571.432814:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6c00, rc 0) 00000100:00100000:0.0:1786015571.432902:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+69:33462:x1872772280688384:12345-192.168.202.56@tcp:101:cp.0 Request processed in 11068us (11845us total) trans 4294968337 rc 0/0 00000100:00100000:0.0:1786015571.432912:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1557 00010000:00010000:3.0:1786015571.436650:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503a51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.436691:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503a51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.436700:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503a51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.436707:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.436713:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503a51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.436722:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503a51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.436743:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff8b7482d4b200) 00010000:00010000:3.0:1786015571.436746:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.436783:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503a51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.436791:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503a51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015571.441042:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015571.441634:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280688640 00000100:00100000:0.0:1786015571.441648:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280688640 00000100:00100000:0.0:1786015571.441744:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 438 00000100:00100000:0.0:1786015571.441795:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2352:x1872772280688640:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015571.441823:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015571.441852:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c503a66 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e92ac expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015571.441890:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786015571.441922:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=806s v=(0 0) 00010000:00010000:0.0:1786015571.441929:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015571.441943:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c503a66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92ac expref: 14 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.441969:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c503a66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92ac expref: 14 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.441988:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6400, rc 0) 00000100:00100000:0.0:1786015571.442080:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2352:x1872772280688640:12345-192.168.202.56@tcp:101:cp.0 Request processed in 318us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015571.442088:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 438 00000100:00100000:1.0:1786015571.448590:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015571.450072:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280688768 00000100:00100000:0.0:1786015571.450094:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280688768 00000100:00100000:0.0:1786015571.450415:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 439 00000100:00100000:0.0:1786015571.450429:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+14:33462:x1872772280688768:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015571.450457:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015571.450486:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062a1eb1c/0xb1a5ef690c503a6d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e92b3 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.450532:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c503a66 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92ac expref: 15 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.450543:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015571.450548:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015571.450553:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062a1eb1c/0xb1a5ef690c503a6d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92b3 expref: 15 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.450598:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c503a66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92ac expref: 15 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.450615:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c503a66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92ac expref: 15 pid: 11384 timeout: 906 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015571.450632:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1220380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304469888:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015571.452320:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74af54bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015571.453054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015571.453608:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280688896 00000100:00100000:2.0:1786015571.453622:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280688896 00000100:00100000:2.0:1786015571.453702:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 77 00000100:00100000:2.0:1786015571.453714:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+68:2353:x1872772280688896:12345-192.168.202.56@tcp:63:ll_sa.0 00010000:00010000:2.0:1786015571.454009:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015571.454039:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503a74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e92ba expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454130:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a7b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454149:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454163:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454205:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503a82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454213:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454219:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454309:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454318:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a7b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454324:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454331:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2178c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015571.454335:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454344:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a7b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454358:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015571.454361:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015571.454366:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454373:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503a7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454391:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454398:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503a82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454404:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503a82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454410:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e7e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015571.454413:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503a82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454419:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503a82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454427:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8b7487f06700) 00010000:00010000:2.0:1786015571.454429:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015571.454432:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503a82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454439:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503a82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454477:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503a74 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92ba expref: 69 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454489:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015571.454492:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786015571.454496:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503a74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92ba expref: 69 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.454507:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2179200, rc -2) 00000100:00100000:2.0:1786015571.454605:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+68:2353:x1872772280688896:12345-192.168.202.56@tcp:63:ll_sa.0 Request processed in 893us (1556us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786015571.454615:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 77 00000100:00100000:3.0:1786015571.470244:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015571.470333:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280689024 00000100:00100000:1.0:1786015571.470347:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280689024 00010000:00010000:1.0:1786015571.470403:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c503a66 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92ac expref: 16 pid: 11384 timeout: 906 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015571.470508:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 456 00000100:00100000:1.0:1786015571.470521:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+16:2353:x1872772280689024:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015571.470543:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015571.470580:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c503a66 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92ac expref: 16 pid: 11384 timeout: 906 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.470604:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c503a66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92ac expref: 16 pid: 11384 timeout: 906 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.470642:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015571.470647:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015571.470658:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062a1eb1c/0xb1a5ef690c503a6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92b3 expref: 16 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.470669:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062a1eb1c/0xb1a5ef690c503a6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92b3 expref: 16 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.470718:0:5780:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000062a1eb1c/0xb1a5ef690c503a6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92b3 expref: 16 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015571.470735:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5780:1872772304470016:192.168.202.56@tcp:105: 00000100:00100000:1.0:1786015571.470888:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b01b0cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1786015571.471535:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012bae31f/0xb1a5ef690c503a66 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92ac expref: 16 pid: 11384 timeout: 906 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015571.471556:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1220380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304469888:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015571.471587:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062a1eb1c/0xb1a5ef690c503a6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92b3 expref: 15 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.471602:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6600, rc 0) 00000100:00100000:0.0:1786015571.471661:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+15:33462:x1872772280688768:12345-192.168.202.56@tcp:101:cp.0 Request processed in 21235us (23088us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015571.471671:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 439 00000100:00100000:1.0:1786015571.473098:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5780:1872772304470016:192.168.202.56@tcp:105: 00010000:00010000:1.0:1786015571.473136:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015571.473207:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2353:x1872772280689024:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 2688us (2976us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015571.473219:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 456 00000100:00100000:1.0:1786015571.475675:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015571.475810:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280689280 00000100:00100000:2.0:1786015571.475823:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280689280 00000100:00100000:2.0:1786015571.475913:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 324 00000100:00100000:2.0:1786015571.475925:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+68:33462:x1872772280689280:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:2.0:1786015571.476424:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+69:33462:x1872772280689280:12345-192.168.202.56@tcp:35:cp.0 Request processed in 499us (760us total) trans 4294968338 rc 0/0 00000100:00100000:2.0:1786015571.476433:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 324 00000100:00100000:0.0:1786015571.524086:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015571.524225:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280689408 00000100:00100000:3.0:1786015571.524238:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280689408 00000100:00100000:3.0:1786015571.524310:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:3.0:1786015571.524321:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+69:2351:x1872772280689408:12345-192.168.202.56@tcp:63:ll_sa.0 00010000:00010000:3.0:1786015571.524400:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015571.524428:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503a89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e92f2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.524500:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.524518:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.524531:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.524549:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503a97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.524556:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.524563:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.524650:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.524657:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.524664:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.524671:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.524676:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.524685:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.524698:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015571.524702:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.524707:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.524713:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503a90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.524729:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.524735:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503a97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.524740:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503a97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.524745:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.524757:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503a97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.525125:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503a97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.525134:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8b749802e800) 00010000:00010000:3.0:1786015571.525136:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.525140:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503a97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.525146:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503a97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.525205:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503a89 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92f2 expref: 70 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.525219:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015571.525221:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786015571.525225:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503a89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92f2 expref: 70 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.525236:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd800, rc -2) 00000100:00100000:3.0:1786015571.525337:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+69:2351:x1872772280689408:12345-192.168.202.56@tcp:63:ll_sa.0 Request processed in 1016us (1262us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786015571.525347:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:1.0:1786015571.573585:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015571.573990:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280689536 00000100:00100000:3.0:1786015571.574014:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280689536 00000100:00100000:3.0:1786015571.574118:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1558 00000100:00100000:3.0:1786015571.574133:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+110:33469:x1872772280689536:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015571.574180:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015571.574216:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503a9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e932a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.574338:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503aa5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.574359:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503aa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.574372:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503aa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.574391:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503aac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.574399:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503aac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.574405:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503aac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.574540:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c503ab3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.574548:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c503ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.574556:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c503ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015571.574599:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x31:0x0]: returning size 158 00000004:00200000:3.0:1786015571.574605:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015571.574631:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c503ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.574645:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c503ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.574654:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503aa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.574661:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503aa5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.574668:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503aa5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.574692:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.574697:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503aa5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.574705:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503aa5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.574720:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015571.574723:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.574728:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503aa5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.574735:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503aa5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.577088:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503aac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.577111:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503aac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.577121:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503aac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.577128:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.577133:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503aac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.577141:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503aac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.577278:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff8b749802e800) 00010000:00010000:3.0:1786015571.577283:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.577291:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503aac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.577299:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503aac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.577381:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503a9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e932a expref: 112 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.577399:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c503ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e932a expref: 111 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.577406:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8b7482d4bb00) 00010000:00010000:3.0:1786015571.577409:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015571.577411:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afce00, rc 0) 00000100:00100000:3.0:1786015571.577604:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+111:33469:x1872772280689536:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3472us (4032us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015571.577614:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1558 00000100:00100000:2.0:1786015571.611914:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015571.611968:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280689664 00000100:00100000:2.0:1786015571.611982:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280689664 00000100:00100000:2.0:1786015571.612059:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 440 00000100:00100000:2.0:1786015571.612071:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280689664:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015571.612096:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015571.612139:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c503aba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9331 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015571.612238:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8caca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304470144:192.168.202.56@tcp:106: 00000100:00100000:2.0:1786015571.612349:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872e40 going to sleep for 11 seconds 00002000:00010000:2.0:1786015571.616329:0:14547:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1786015571.616343:0:14547:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime: 0 -> 1786015571 00002000:00010000:2.0:1786015571.616348:0:14547:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime: 0 -> 1786015571 00002000:00010000:2.0:1786015571.616350:0:14547:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime: 0 -> 1786015571 00000100:00100000:2.0:1786015571.616385:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8caca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304470144:192.168.202.56@tcp:106: 00010000:00010000:2.0:1786015571.616437:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c503aba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9331 expref: 18 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.616470:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c503aba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9331 expref: 18 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.616488:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e7e00, rc 0) 00000100:00100000:2.0:1786015571.616577:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280689664:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 4508us (4678us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015571.616587:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 440 00000100:00100000:2.0:1786015571.624193:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015571.624435:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280689792 00000100:00100000:3.0:1786015571.624450:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280689792 00000100:00100000:3.0:1786015571.624552:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1559 00000100:00100000:3.0:1786015571.624564:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+111:33469:x1872772280689792:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015571.624595:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015571.624627:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503ac1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9338 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.624733:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503ac8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.624791:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.624806:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015571.624889:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:3.0:1786015571.624893:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015571.624923:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.624958:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503ac1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9338 expref: 113 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.624984:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9338 expref: 112 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.624994:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015571.624997:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015571.625001:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afda00, rc 0) 00000100:00100000:3.0:1786015571.625079:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+112:33469:x1872772280689792:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 517us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015571.625088:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1559 00000100:00100000:3.0:1786015571.640160:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015571.643705:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280689920 00000100:00100000:2.0:1786015571.643723:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280689920 00000100:00100000:2.0:1786015571.643835:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 441 00000100:00100000:2.0:1786015571.643847:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280689920:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015571.643872:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015571.643894:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000802f16a6/0xb1a5ef690c503acf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e933f expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015571.644268:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304470272:192.168.202.56@tcp:106: 00000100:00100000:2.0:1786015571.644371:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7384872e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786015571.671531:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304470272:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015571.671593:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000802f16a6/0xb1a5ef690c503acf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e933f expref: 18 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.671629:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000802f16a6/0xb1a5ef690c503acf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e933f expref: 18 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.671649:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2178c00, rc 0) 00000100:00100000:1.0:1786015571.671781:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280689920:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 27917us (31617us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015571.671792:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 441 00000100:00100000:2.0:1786015571.691949:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015571.692003:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280690176 00000100:00100000:2.0:1786015571.692017:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280690176 00000100:00100000:2.0:1786015571.692083:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1560 00000100:00100000:2.0:1786015571.692096:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+112:33469:x1872772280690176:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:2.0:1786015571.692588:0:12526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].48, 136 off14720 00000100:00100000:2.0:1786015571.692695:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+112:33469:x1872772280690176:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 602us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015571.692704:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1560 00000100:00100000:3.0:1786015571.716160:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015571.716291:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280690304 00000100:00100000:3.0:1786015571.716304:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280690304 00000100:00100000:3.0:1786015571.716369:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1561 00000100:00100000:3.0:1786015571.716381:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+112:33470:x1872772280690304:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1786015571.716411:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015571.716440:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503ad6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9346 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.716674:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503add lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.716692:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503add lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.716707:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503add lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.716725:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ae4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.716731:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.716738:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.720380:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503add lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.720403:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503add lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.720417:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503add lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.720424:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.720429:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503add lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.720438:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503add lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.720458:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015571.720462:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.720467:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503add lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.720474:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503add lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.720489:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.720496:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ae4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.720502:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.720526:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.720529:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.720540:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.720548:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8b749802ea00) 00010000:00010000:3.0:1786015571.720550:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.720554:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ae4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.720559:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ae4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.720638:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503ad6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9346 expref: 113 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.720651:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015571.720653:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.720657:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503ad6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9346 expref: 113 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.720668:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd800, rc 0) 00000100:00100000:3.0:1786015571.720821:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+112:33470:x1872772280690304:12345-192.168.202.56@tcp:101:bash.0 Request processed in 4440us (4675us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015571.720832:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1561 00000001:00080000:3.0:1786015571.746962:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967391 is committed 00000001:00080000:0.0:1786015571.755084:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968337 is committed 00000001:00080000:0.0:1786015571.755126:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968324 is committed 00000020:00080000:0.0:1786015571.755136:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 35 batchid updated 00000001:00080000:0.0:1786015571.755150:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968338 is committed 00000020:00080000:0.0:1786015571.755415:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 35 00000020:00080000:0.0:1786015571.755427:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 35 00000100:00100000:2.0:1786015571.766025:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015571.766195:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280690432 00000100:00100000:0.0:1786015571.766209:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280690432 00000100:00100000:0.0:1786015571.766289:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1562 00000100:00100000:0.0:1786015571.766302:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+55:33471:x1872772280690432:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:0.0:1786015571.766333:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015571.766365:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503aeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e934d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.766470:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503af2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.766494:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503af2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.766509:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503af2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.766530:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503af9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.766538:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.766545:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.766947:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503af2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.766957:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503af2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.766965:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503af2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.766975:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015571.766980:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503af2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.766988:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503af2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.767004:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015571.767008:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015571.767015:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503af2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.767021:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503af2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.767038:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.767044:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503af9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.767051:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503af9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.767056:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015571.767059:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503af9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.767066:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503af9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.767074:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8b7482d4b200) 00010000:00010000:0.0:1786015571.767076:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015571.767079:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503af9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.767085:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503af9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.767131:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503aeb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e934d expref: 56 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.767145:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015571.767147:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015571.767151:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503aeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e934d expref: 56 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.767161:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6a00, rc 0) 00000100:00100000:0.0:1786015571.767250:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+55:33471:x1872772280690432:12345-192.168.202.56@tcp:101:rm.0 Request processed in 951us (1239us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015571.767259:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1562 00000100:00100000:2.0:1786015571.772755:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015571.772963:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280690560 00000100:00100000:0.0:1786015571.772978:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280690560 00000100:00100000:0.0:1786015571.773058:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00100000:0.0:1786015571.773070:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+55:2351:x1872772280690560:12345-192.168.202.56@tcp:63:ll_sa.0 00010000:00010000:0.0:1786015571.773124:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015571.773155:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503b00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9354 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773230:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773248:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773262:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773279:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503b0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773287:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503b0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773293:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503b0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773625:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773634:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773641:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773648:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015571.773653:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773662:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773676:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015571.773680:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015571.773686:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773693:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773705:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503b0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773712:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503b0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773718:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503b0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773723:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015571.773726:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503b0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773732:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503b0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773739:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x36fdbbdd (ffff8b7482d4b000) 00010000:00010000:0.0:1786015571.773741:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015571.773743:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503b0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773801:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503b0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773837:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503b00 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9354 expref: 56 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773848:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015571.773850:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786015571.773854:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503b00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9354 expref: 56 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.773870:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca6400, rc -2) 00000100:00100000:0.0:1786015571.773959:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+55:2351:x1872772280690560:12345-192.168.202.56@tcp:63:ll_sa.0 Request processed in 890us (1227us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786015571.773970:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00100000:3.0:1786015571.793325:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015571.793443:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280690688 00000100:00100000:2.0:1786015571.793457:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280690688 00000100:00100000:2.0:1786015571.793532:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1563 00000100:00100000:2.0:1786015571.793544:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+55:33471:x1872772280690688:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015571.793575:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015571.793608:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503b15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e935b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.798734:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.798797:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.798813:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.799080:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503b23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.799090:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.799097:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.799469:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.799477:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.799484:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.799491:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.799495:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.799504:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.799652:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015571.799656:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.799662:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.799669:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.799696:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.799703:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503b23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.799708:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503b23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.799714:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.799717:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503b23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.799722:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503b23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.799730:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8b74b0022500) 00010000:00010000:3.0:1786015571.799733:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.799736:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503b23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.799741:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503b23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.800125:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503b15 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e935b expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.800140:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015571.800143:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.800147:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2178c00/0xb1a5ef690c503b15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e935b expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.800161:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2178c00, rc 0) 00000100:00100000:3.0:1786015571.800316:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+55:33471:x1872772280690688:12345-192.168.202.56@tcp:101:rm.0 Request processed in 6772us (7008us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015571.800327:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1563 00010000:00010000:0.0:1786015571.824546:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015571.836311:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015571.836527:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280690816 00000100:00100000:3.0:1786015571.836541:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280690816 00000100:00100000:3.0:1786015571.836617:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1564 00000100:00100000:3.0:1786015571.836629:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+55:33472:x1872772280690816:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015571.836656:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015571.836684:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503b2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9362 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.836822:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b31 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.836841:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.836855:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.836873:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.836881:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.836888:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.838369:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.838389:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b31 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.838397:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.838404:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.838410:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.838420:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b31 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.838442:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015571.838446:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.838451:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.838458:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.838474:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.838482:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.838488:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.838492:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.838495:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.838501:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.838508:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8b74b0022500) 00010000:00010000:3.0:1786015571.838511:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.838514:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.838520:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.838580:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503b2a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9362 expref: 56 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.838592:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015571.838594:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.838598:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503b2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9362 expref: 56 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.838613:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc200, rc 0) 00000100:00100000:3.0:1786015571.838726:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+55:33472:x1872772280690816:12345-192.168.202.56@tcp:101:cp.0 Request processed in 2098us (2431us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015571.838736:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1564 00000100:00100000:2.0:1786015571.847481:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015571.849153:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280690944 00000100:00100000:0.0:1786015571.849171:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280690944 00000100:00100000:0.0:1786015571.849264:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1565 00000100:00100000:0.0:1786015571.849277:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+55:33472:x1872772280690944:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015571.849309:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015571.849341:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503b3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9369 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.849432:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b46 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.849449:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.849463:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.849478:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503b4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.849486:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503b4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.849497:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503b4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.849918:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.849939:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b46 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.849948:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.849957:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015571.849962:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.849971:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.849986:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015571.849990:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015571.849994:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.850002:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503b46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.850014:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503b4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.850021:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503b4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.850028:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503b4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.850034:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015571.850037:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503b4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.850042:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503b4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.850048:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8b7482d4b000) 00010000:00010000:0.0:1786015571.850050:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015571.850053:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503b4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.850058:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6a00/0xb1a5ef690c503b4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.850098:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503b3f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9369 expref: 56 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.850109:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015571.850111:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015571.850115:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503b3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9369 expref: 56 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.850123:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7800, rc 0) 00000100:00100000:0.0:1786015571.850215:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+55:33472:x1872772280690944:12345-192.168.202.56@tcp:101:cp.0 Request processed in 940us (2748us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015571.850228:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1565 00000100:00100000:0.0:1786015571.859853:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015571.859975:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280691200 00000100:00100000:3.0:1786015571.859989:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280691200 00000100:00100000:3.0:1786015571.860068:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1566 00000100:00100000:3.0:1786015571.860081:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+55:33472:x1872772280691200:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015571.860112:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015571.860154:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503b54 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9370 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.860636:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b5b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.860655:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503ac8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9338 expref: 110 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.860666:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b5b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.860710:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9338 expref: 110 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.860727:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9338 expref: 110 pid: 7673 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015571.860797:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738299ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304470400:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015571.860932:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b748809c840 going to sleep for 11 seconds 00000100:00100000:0.0:1786015571.867441:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015571.867612:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280691328 00000100:00100000:1.0:1786015571.867624:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280691328 00010000:00010000:1.0:1786015571.867685:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503ac8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9338 expref: 111 pid: 7673 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015571.867742:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 457 00000100:00100000:1.0:1786015571.867804:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+111:2353:x1872772280691328:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015571.867824:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015571.867839:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503ac8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9338 expref: 111 pid: 7673 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.867857:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9338 expref: 111 pid: 7673 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.867888:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015571.867894:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b5b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.867909:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.867919:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b5b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.868242:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015571.868321:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+111:2353:x1872772280691328:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 560us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015571.868331:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 457 00010000:00010000:3.0:1786015571.869379:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503ac8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9338 expref: 110 pid: 7673 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015571.869406:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738299ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304470400:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015571.869436:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.869446:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.869452:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.869483:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.869495:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.869504:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786015571.877391:0:5796:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f:0x0], index 0: 0 00010000:00010000:3.0:1786015571.878147:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c503b69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.878429:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c503b69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.878447:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c503b69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.878521:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.878530:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b5b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.878539:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.878546:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.878551:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.878560:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b5b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.878576:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015571.878579:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.878585:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b5b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.878591:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503b5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015571.878607:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b12b6816 reply state 00000000462cda66 transno 4294968339 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015571.878620:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786015571.879443:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503b54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9370 expref: 58 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.879470:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c503b69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9370 expref: 57 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.879479:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8b749802ea00) 00010000:00010000:3.0:1786015571.879482:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015571.879485:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73829f9600, rc 0) 00000100:00100000:3.0:1786015571.879617:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+58:33472:x1872772280691200:12345-192.168.202.56@tcp:101:cp.0 Request processed in 19536us (19777us total) trans 4294968339 rc 0/0 00000100:00100000:3.0:1786015571.879627:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1566 00010000:00010000:1.0:1786015571.884872:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.884899:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.884908:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.884916:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015571.884922:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.884939:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b62 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.884964:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8b74b0022500) 00010000:00010000:1.0:1786015571.884967:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015571.884973:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b62 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.884986:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503b62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015571.893873:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015571.894980:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280691456 00000100:00100000:0.0:1786015571.894997:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280691456 00000100:00100000:0.0:1786015571.895074:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 442 00000100:00100000:0.0:1786015571.895084:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280691456:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015571.895106:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015571.895137:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af40c25c/0xb1a5ef690c503b77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9377 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015571.895174:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786015571.895199:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=807s v=(0 0) 00010000:00010000:0.0:1786015571.895203:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015571.895213:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af40c25c/0xb1a5ef690c503b77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9377 expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.895230:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000af40c25c/0xb1a5ef690c503b77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9377 expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015571.895244:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7800, rc 0) 00000100:00100000:0.0:1786015571.895347:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280691456:12345-192.168.202.56@tcp:101:cp.0 Request processed in 264us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015571.895353:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 442 00000100:00100000:0.0:1786015571.906800:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015571.907084:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280691584 00000100:00100000:2.0:1786015571.907097:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280691584 00000100:00100000:2.0:1786015571.907184:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 443 00000100:00100000:2.0:1786015571.907196:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:33472:x1872772280691584:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015571.907222:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015571.907247:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000802f16a6/0xb1a5ef690c503b7e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e937e expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.907298:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af40c25c/0xb1a5ef690c503b77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9377 expref: 12 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.907309:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015571.907314:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015571.907320:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000802f16a6/0xb1a5ef690c503b7e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e937e expref: 12 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.907366:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af40c25c/0xb1a5ef690c503b77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9377 expref: 12 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.907383:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af40c25c/0xb1a5ef690c503b77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9377 expref: 12 pid: 6591 timeout: 907 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015571.907400:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304470528:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015571.907518:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015571.911395:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304470528:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015571.911444:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000802f16a6/0xb1a5ef690c503b7e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e937e expref: 12 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015571.911472:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2178c00, rc 0) 00000100:00100000:1.0:1786015571.911557:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+12:33472:x1872772280691584:12345-192.168.202.56@tcp:101:cp.0 Request processed in 4362us (4818us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015571.911567:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 443 00000100:00100000:3.0:1786015571.919124:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015571.919320:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280691712 00000100:00100000:2.0:1786015571.919332:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280691712 00010000:00010000:2.0:1786015571.919380:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af40c25c/0xb1a5ef690c503b77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9377 expref: 12 pid: 6591 timeout: 907 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015571.919422:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 458 00000100:00100000:2.0:1786015571.919430:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280691712:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015571.919446:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015571.919474:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af40c25c/0xb1a5ef690c503b77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9377 expref: 12 pid: 6591 timeout: 907 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.919487:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af40c25c/0xb1a5ef690c503b77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9377 expref: 12 pid: 6591 timeout: 907 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.919516:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af40c25c/0xb1a5ef690c503b77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9377 expref: 12 pid: 6591 timeout: 907 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.919540:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015571.919546:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015571.919557:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000802f16a6/0xb1a5ef690c503b7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e937e expref: 11 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.919570:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000802f16a6/0xb1a5ef690c503b7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e937e expref: 11 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.919627:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000802f16a6/0xb1a5ef690c503b7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e937e expref: 11 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015571.919645:0:5781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f19180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5781:1872772304470656:192.168.202.56@tcp:105: 00000100:00100000:2.0:1786015571.919837:0:5781:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb4240 going to sleep for 11 seconds 00000100:00100000:0.0:1786015571.924001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015571.924600:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280691968 00000100:00100000:3.0:1786015571.924618:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280691968 00000100:00100000:3.0:1786015571.924735:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 325 00000100:00100000:3.0:1786015571.924756:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+57:33472:x1872772280691968:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:2.0:1786015571.924758:0:5781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f19180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5781:1872772304470656:192.168.202.56@tcp:105: 00010000:00010000:2.0:1786015571.924801:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015571.924940:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280691712:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 5508us (5836us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015571.924954:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 458 00000100:00100000:3.0:1786015571.925231:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+58:33472:x1872772280691968:12345-192.168.202.56@tcp:35:cp.0 Request processed in 487us (1253us total) trans 4294968340 rc 0/0 00000100:00100000:3.0:1786015571.925239:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 325 00000100:00100000:0.0:1786015571.954553:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015571.955718:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280692096 00000100:00100000:2.0:1786015571.955737:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280692096 00000100:00100000:2.0:1786015571.955914:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 80 00000100:00100000:2.0:1786015571.956126:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+58:2351:x1872772280692096:12345-192.168.202.56@tcp:63:ll_sa.0 00010000:00010000:2.0:1786015571.956319:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015571.956359:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503b85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9385 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956456:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503b8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956476:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956490:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956508:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503b93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956515:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956522:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956629:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956643:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503b8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956650:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503b8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956657:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e7e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015571.956663:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503b8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956671:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503b8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956687:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015571.956690:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015571.956697:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503b8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956704:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503b8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956724:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956731:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503b93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956737:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503b93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956743:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015571.956757:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503b93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956811:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503b93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956819:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x36fdbbdd (ffff8b7487f06700) 00010000:00010000:2.0:1786015571.956822:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015571.956824:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503b93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956830:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503b93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956869:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503b85 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9385 expref: 59 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956880:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015571.956882:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786015571.956886:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503b85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9385 expref: 59 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015571.956898:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2179200, rc -2) 00000100:00100000:2.0:1786015571.957605:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+58:2351:x1872772280692096:12345-192.168.202.56@tcp:63:ll_sa.0 Request processed in 1675us (3064us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786015571.957619:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 80 00000100:00100000:2.0:1786015571.988114:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015571.988647:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280692224 00000100:00100000:3.0:1786015571.988672:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280692224 00000100:00100000:3.0:1786015571.988989:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1567 00000100:00100000:3.0:1786015571.989003:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+110:33475:x1872772280692224:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015571.989039:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015571.989073:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503b9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e938c expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989453:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ba1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989472:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989486:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989504:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503ba8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989512:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989519:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989650:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503baf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989659:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503baf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989665:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503baf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015571.989710:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x32:0x0]: returning size 158 00000004:00200000:3.0:1786015571.989715:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015571.989755:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503baf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989795:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503baf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989805:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989812:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ba1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989819:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ba1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989825:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.989830:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ba1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989838:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ba1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989854:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015571.989857:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.989863:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ba1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989869:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503ba1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989887:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989899:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503ba8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989905:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989910:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015571.989913:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989920:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503ba8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989940:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8b749802e800) 00010000:00010000:3.0:1786015571.989943:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015571.989946:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503ba8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989952:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503ba8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.989999:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503b9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e938c expref: 112 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.990015:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503baf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e938c expref: 111 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015571.990024:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8b749802ea00) 00010000:00010000:3.0:1786015571.990026:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015571.990029:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afd800, rc 0) 00000100:00100000:3.0:1786015571.990950:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+111:33475:x1872772280692224:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1942us (2843us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015571.990963:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1567 00000100:00100000:0.0:1786015571.998528:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015571.999252:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280692352 00000100:00100000:1.0:1786015571.999266:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280692352 00000100:00100000:1.0:1786015571.999336:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 444 00000100:00100000:1.0:1786015571.999347:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2351:x1872772280692352:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015571.999371:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015571.999394:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503bb6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9393 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015571.999470:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304470784:192.168.202.56@tcp:106: 00000100:00100000:1.0:1786015571.999717:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486540cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015572.004480:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.007156:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280692480 00000100:00100000:0.0:1786015572.007184:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280692480 00000100:00100000:0.0:1786015572.007299:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 81 00000100:00100000:0.0:1786015572.007315:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:41677fca-39fb-471c-b582-96bce6540a36+111:2353:x1872772280692480:12345-192.168.202.56@tcp:63:ll_sa.0 00010000:00010000:0.0:1786015572.007393:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015572.007423:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503bbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e939a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.007499:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503bc4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.007515:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.007529:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.007550:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.007556:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.007563:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.007673:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.007686:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503bc4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.007693:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503bc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.007699:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.007704:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503bc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.007713:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503bc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.007729:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015572.007732:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.007753:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503bc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.007804:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503bc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.007823:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.007830:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.008342:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.008349:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.008353:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.008361:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.008371:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff8b749302fb00) 00010000:00010000:0.0:1786015572.008374:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.008377:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bcb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.008383:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.008431:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503bbd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e939a expref: 112 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.008444:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015572.008446:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786015572.008450:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503bbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e939a expref: 112 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.008461:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7600, rc -2) 00000100:00100000:0.0:1786015572.008578:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:41677fca-39fb-471c-b582-96bce6540a36+111:2353:x1872772280692480:12345-192.168.202.56@tcp:63:ll_sa.0 Request processed in 1267us (4113us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786015572.008588:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 81 00000100:00080000:2.0:1786015572.008698:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00010000:1.0:1786015572.013483:0:6592:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1786015572.013498:0:6592:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb mtime: 0 -> 1786015572 00002000:00010000:1.0:1786015572.013501:0:6592:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb atime: 0 -> 1786015572 00002000:00010000:1.0:1786015572.013504:0:6592:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb ctime: 0 -> 1786015572 00000100:00100000:1.0:1786015572.013545:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304470784:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015572.013597:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503bb6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9393 expref: 17 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.013630:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503bb6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9393 expref: 17 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.013648:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921000, rc 0) 00000100:00100000:0.0:1786015572.014381:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+16:2351:x1872772280692352:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 15028us (15860us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015572.014395:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 444 00000100:00100000:3.0:1786015572.022603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.023347:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280692608 00000100:00100000:0.0:1786015572.023363:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280692608 00000100:00100000:0.0:1786015572.023443:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1568 00000100:00100000:0.0:1786015572.023455:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+111:33475:x1872772280692608:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015572.023486:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015572.023517:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503bd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e93d2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.023666:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.024247:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.024268:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015572.024378:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 7680 00000004:00200000:0.0:1786015572.024383:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015572.024416:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.024454:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503bd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93d2 expref: 113 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.024477:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93d2 expref: 112 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.024487:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015572.024490:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786015572.024496:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7c00, rc 0) 00000100:00100000:0.0:1786015572.024616:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+112:33475:x1872772280692608:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1160us (2026us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.024628:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1568 00000100:00100000:3.0:1786015572.031527:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.031630:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280692736 00000100:00100000:1.0:1786015572.031645:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280692736 00000100:00100000:1.0:1786015572.031895:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 445 00000100:00100000:1.0:1786015572.031910:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280692736:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015572.031947:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015572.031981:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503be0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e93d9 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015572.032075:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304470912:192.168.202.56@tcp:106: 00000100:00100000:1.0:1786015572.032702:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486540cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015572.036507:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304470912:192.168.202.56@tcp:106: 00010000:00010000:3.0:1786015572.036568:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503be0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93d9 expref: 17 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.036604:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c503be0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93d9 expref: 17 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.036622:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921000, rc 0) 00000100:00100000:3.0:1786015572.036726:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+16:2354:x1872772280692736:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 4820us (5214us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015572.037572:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 445 00000100:00080000:2.0:1786015572.043109:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015572.045873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.046364:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280692992 00000100:00100000:1.0:1786015572.046379:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280692992 00000100:00100000:1.0:1786015572.046461:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1569 00000100:00100000:1.0:1786015572.046474:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+112:33475:x1872772280692992:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:1.0:1786015572.047572:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].49, 136 off14856 00000100:00100000:1.0:1786015572.048311:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+112:33475:x1872772280692992:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 1831us (2445us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015572.048323:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1569 00000100:00100000:0.0:1786015572.059273:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.059344:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.059475:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280693120 00000100:00100000:3.0:1786015572.059490:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280693120 00000100:00100000:3.0:1786015572.059573:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1570 00000100:00100000:3.0:1786015572.059585:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+112:33478:x1872772280693120:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1786015572.059615:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015572.059647:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503be7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e93e0 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060208:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503bee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060229:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503bee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060243:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503bee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060262:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503bf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060269:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060276:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060367:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503bee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060374:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503bee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060381:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503bee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060387:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015572.060392:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503bee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060404:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503bee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060418:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015572.060422:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.060427:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503bee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060433:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c503bee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060450:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060456:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503bf5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060462:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060468:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015572.060470:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060476:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503bf5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060482:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff8b749802e800) 00010000:00010000:3.0:1786015572.060485:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.060488:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503bf5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060497:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c503bf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060545:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503be7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93e0 expref: 113 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060556:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015572.060558:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.060562:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c503be7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93e0 expref: 113 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.060573:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afca00, rc 0) 00000100:00100000:3.0:1786015572.060662:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+112:33478:x1872772280693120:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1078us (1401us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015572.060670:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1570 00000100:00100000:1.0:1786015572.068429:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280693248 00000100:00100000:1.0:1786015572.068453:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280693248 00000100:00100000:3.0:1786015572.073304:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 82 00000100:00100000:3.0:1786015572.073324:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:41677fca-39fb-471c-b582-96bce6540a36+112:2354:x1872772280693248:12345-192.168.202.56@tcp:63:ll_sa.0 00010000:00010000:3.0:1786015572.073417:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015572.073447:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503bfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e93e7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.073528:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503c03 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.073548:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503c03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.073569:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503c03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.073588:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503c0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.073595:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.073602:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.073707:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503c03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.073716:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503c03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.073723:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503c03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.073729:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015572.073734:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503c03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.074322:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503c03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.074338:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015572.074341:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.074347:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503c03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.074354:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503c03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.074372:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.074378:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503c0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.074384:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503c0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.074389:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbdc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015572.074392:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503c0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.074399:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503c0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.074405:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x4b66ad81 (ffff8b74a04b5b00) 00010000:00010000:3.0:1786015572.074407:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.074410:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503c0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.074415:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503c0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.074462:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503bfc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93e7 expref: 113 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.074480:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015572.074482:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786015572.074485:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503bfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93e7 expref: 113 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.074495:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73829f9400, rc -2) 00000100:00100000:3.0:1786015572.074602:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:41677fca-39fb-471c-b582-96bce6540a36+112:2354:x1872772280693248:12345-192.168.202.56@tcp:63:ll_sa.0 Request processed in 1282us (15255us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786015572.074612:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 82 00000100:00100000:0.0:1786015572.080280:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.081333:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280693376 00000100:00100000:2.0:1786015572.081349:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280693376 00000100:00100000:2.0:1786015572.081452:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1571 00000100:00100000:2.0:1786015572.081464:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+58:33479:x1872772280693376:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015572.081493:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015572.081531:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c503c11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e93ee expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.081627:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.081646:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.081661:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.081690:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503c1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.081698:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.081705:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.081856:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.081865:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.081871:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.081879:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015572.081884:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.081892:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.081909:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015572.081913:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015572.081920:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786015572.082032:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786015572.082452:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.082473:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.082480:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503c1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.082487:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503c1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.082493:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c2179200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015572.082496:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503c1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.082503:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503c1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.082563:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff8b7487f06700) 00010000:00010000:2.0:1786015572.082566:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015572.082570:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503c1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.082575:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503c1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.082635:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c503c11 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93ee expref: 59 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.082647:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015572.082649:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015572.082653:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c503c11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93ee expref: 59 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.082663:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73830a1e00, rc 0) 00000100:00100000:2.0:1786015572.083758:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+58:33479:x1872772280693376:12345-192.168.202.56@tcp:101:rm.0 Request processed in 2269us (3467us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015572.083786:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1571 00000100:00100000:0.0:1786015572.108970:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.109141:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280693504 00000100:00100000:2.0:1786015572.109156:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280693504 00000100:00100000:2.0:1786015572.109244:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1572 00000100:00100000:2.0:1786015572.109256:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+58:33479:x1872772280693504:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015572.109290:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015572.109325:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503c26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e93f5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109455:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c503c2d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109473:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c503c2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109486:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c503c2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109503:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109510:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109516:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109602:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c503c2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109608:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c503c2d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109615:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c503c2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109621:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015572.109626:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c503c2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109640:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c503c2d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109653:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015572.109657:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015572.109662:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c503c2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109669:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1e00/0xb1a5ef690c503c2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109684:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109690:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109696:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109702:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015572.109705:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109711:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109718:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff8b7487f06700) 00010000:00010000:2.0:1786015572.109721:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015572.109723:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109733:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1000/0xb1a5ef690c503c34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109845:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503c26 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93f5 expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109857:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015572.109859:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015572.109862:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503c26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93f5 expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.109875:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c2179200, rc 0) 00000100:00100000:2.0:1786015572.109971:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+58:33479:x1872772280693504:12345-192.168.202.56@tcp:101:rm.0 Request processed in 716us (1024us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015572.109979:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1572 00000100:00100000:3.0:1786015572.135297:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.135496:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280693632 00000100:00100000:0.0:1786015572.135520:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280693632 00000100:00100000:0.0:1786015572.135596:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1573 00000100:00100000:0.0:1786015572.135610:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+58:33480:x1872772280693632:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015572.135641:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015572.135673:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503c3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e93fc expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136087:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136110:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136126:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136147:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503c49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136154:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136286:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136387:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136395:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136403:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136410:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.136416:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136425:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136440:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015572.136444:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.136449:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136456:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136472:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136479:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503c49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136486:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503c49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136491:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.136494:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503c49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136500:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503c49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136881:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff8b749302fb00) 00010000:00010000:0.0:1786015572.136885:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.136890:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503c49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.136897:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503c49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.137106:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503c3b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93fc expref: 59 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.137122:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015572.137125:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.137129:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503c3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93fc expref: 59 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.137140:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7400, rc 0) 00000100:00100000:0.0:1786015572.137392:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+58:33480:x1872772280693632:12345-192.168.202.56@tcp:101:cp.0 Request processed in 1782us (2108us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015572.137407:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1573 00000040:00080000:2.0:1786015572.141618:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015572.141630:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015572.141690:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 50 count 8 00000040:00080000:2.0:1786015572.141698:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015572.142658:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f1a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304471040:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786015572.147951:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786015572.151851:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.151962:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280693760 00000100:00100000:0.0:1786015572.151977:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280693760 00000100:00100000:0.0:1786015572.152060:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1574 00000100:00100000:0.0:1786015572.152074:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+59:33483:x1872772280693760:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015572.152122:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015572.152287:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+59:33483:x1872772280693760:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 216us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.152295:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1574 00000100:00100000:1.0:1786015572.154171:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.154242:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.154448:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f1a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304471040:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786015572.155009:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280693888 00000100:00100000:0.0:1786015572.155019:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280693888 00000100:00100000:0.0:1786015572.155080:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280694016 00000100:00100000:0.0:1786015572.155083:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280694016 00000100:00100000:0.0:1786015572.155114:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1575 00000100:00100000:0.0:1786015572.155123:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+59:33482:x1872772280693888:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015572.155162:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x31:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015572.155284:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+59:33482:x1872772280693888:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 162us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.155293:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1575 00000100:00100000:0.0:1786015572.155312:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1576 00000100:00100000:0.0:1786015572.155318:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+58:33481:x1872772280694016:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015572.155354:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x30:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015572.155387:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+58:33481:x1872772280694016:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 69us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.155394:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1576 00000100:00100000:1.0:1786015572.158270:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.158544:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280694144 00000100:00100000:3.0:1786015572.158559:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280694144 00000100:00100000:3.0:1786015572.158636:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1577 00000100:00100000:3.0:1786015572.158648:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+58:33480:x1872772280694144:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015572.158678:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015572.158709:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c503c50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9403 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.158850:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503c57 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.158868:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503c57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.158882:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503c57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.158903:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503c5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.158911:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503c5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.158918:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503c5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.159022:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503c57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.159031:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503c57 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.159038:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503c57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.159046:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015572.159052:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503c57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.159061:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503c57 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.159076:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015572.159080:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.159085:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503c57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.159092:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503c57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.159107:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503c5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.159114:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503c5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.159120:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503c5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.159125:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015572.159128:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503c5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.159134:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503c5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.159141:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff8b74a04b5b00) 00010000:00010000:3.0:1786015572.159143:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.159146:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503c5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.159152:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503c5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.159204:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c503c50 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9403 expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.159217:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015572.159219:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.159224:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc400/0xb1a5ef690c503c50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9403 expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.159235:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc400, rc 0) 00000100:00100000:3.0:1786015572.159312:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+58:33480:x1872772280694144:12345-192.168.202.56@tcp:101:cp.0 Request processed in 666us (1056us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015572.159321:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1577 00000100:00100000:0.0:1786015572.164683:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.164731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.165050:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280694400 00000100:00100000:3.0:1786015572.165065:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280694400 00000100:00100000:3.0:1786015572.165146:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280694656 00000100:00100000:3.0:1786015572.165149:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280694656 00000100:00100000:3.0:1786015572.165189:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1578 00000100:00100000:3.0:1786015572.165201:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+59:33482:x1872772280694400:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015572.165232:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015572.165263:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503c65 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e940a expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.165415:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503c6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.165436:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503c6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.165450:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503c6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015572.165465:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x31:0x0]: returning size 158 00010000:00010000:3.0:1786015572.165662:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503c65 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e940a expref: 62 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.165691:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503c6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e940a expref: 61 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.165703:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8b7482d4bb00) 00010000:00010000:3.0:1786015572.165706:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015572.165711:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc200, rc 0) 00000100:00100000:3.0:1786015572.165831:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+61:33482:x1872772280694400:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 631us (1165us total) trans 4294968341 rc 0/0 00000100:00100000:3.0:1786015572.165839:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1578 00000100:00100000:3.0:1786015572.165866:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1579 00000100:00100000:3.0:1786015572.165874:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+60:33483:x1872772280694656:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015572.165883:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015572.165893:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503c7a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9411 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.165965:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503c81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.165975:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503c81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.165984:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503c81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015572.165993:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x32:0x0]: returning size 158 00010000:00010000:3.0:1786015572.166054:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503c7a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9411 expref: 63 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.166073:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503c81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9411 expref: 62 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.166080:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8b749802ea00) 00010000:00010000:3.0:1786015572.166083:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015572.166085:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73829f9400, rc 0) 00000100:00100000:3.0:1786015572.166109:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+62:33483:x1872772280694656:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 237us (1377us total) trans 4294968342 rc 0/0 00000100:00100000:3.0:1786015572.166116:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1579 00000100:00100000:1.0:1786015572.172385:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.172511:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280694912 00000100:00100000:0.0:1786015572.172526:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280694912 00000100:00100000:0.0:1786015572.172602:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1580 00000100:00100000:0.0:1786015572.172614:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+62:33480:x1872772280694912:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015572.172649:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015572.172683:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503c8f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9418 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.172959:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c96 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.172982:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93d2 expref: 111 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.172993:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c96 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.173045:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93d2 expref: 111 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.173065:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93d2 expref: 111 pid: 5794 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.173085:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381305c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304471168:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015572.173208:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb180 going to sleep for 11 seconds 00000100:00100000:1.0:1786015572.175431:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.176537:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280695040 00000100:00100000:3.0:1786015572.176557:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280695040 00000100:00100000:3.0:1786015572.176667:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 446 00000100:00100000:3.0:1786015572.176691:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280695040:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015572.176811:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503c9d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.176854:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000802f16a6/0xb1a5ef690c503b7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e937e expref: 11 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.176868:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015572.176875:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015572.176880:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503c9d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.176951:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000802f16a6/0xb1a5ef690c503b7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e937e expref: 11 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.176970:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000802f16a6/0xb1a5ef690c503b7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e937e expref: 11 pid: 14547 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015572.176991:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304471296:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015572.177106:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b7e16900 going to sleep for 11 seconds 00000100:00080000:2.0:1786015572.177420:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015572.179885:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.180088:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.180480:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280695168 00000100:00100000:0.0:1786015572.180494:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280695168 00000100:00100000:0.0:1786015572.180569:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280695296 00000100:00100000:0.0:1786015572.180572:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280695296 00000100:00100000:0.0:1786015572.180614:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 77 00000100:00100000:0.0:1786015572.180626:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+65:2351:x1872772280695168:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015572.180648:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015572.180682:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503c81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9411 expref: 65 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.180707:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8b749802ea00) 00010000:00010000:0.0:1786015572.180713:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015572.180821:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+64:2351:x1872772280695168:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 196us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.180830:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 77 00000100:00100000:0.0:1786015572.180854:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:0.0:1786015572.180861:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+63:2353:x1872772280695296:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015572.180869:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015572.180882:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503c6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e940a expref: 63 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.180894:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8b7482d4bb00) 00010000:00010000:0.0:1786015572.180897:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015572.180917:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+62:2353:x1872772280695296:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 56us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.182388:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:1.0:1786015572.185574:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.186045:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280695680 00000100:00100000:0.0:1786015572.186061:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280695680 00000100:00100000:0.0:1786015572.186226:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 447 00000100:00100000:0.0:1786015572.186239:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2352:x1872772280695680:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786015572.186307:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004e3b593d/0xb1a5ef690c503ca4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.186333:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062a1eb1c/0xb1a5ef690c503a6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92b3 expref: 12 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.186344:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x21:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786015572.186349:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015572.186355:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3b593d/0xb1a5ef690c503ca4 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.186401:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062a1eb1c/0xb1a5ef690c503a6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92b3 expref: 12 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.186417:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062a1eb1c/0xb1a5ef690c503a6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92b3 expref: 12 pid: 6591 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.186435:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304471424:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015572.186548:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb840 going to sleep for 11 seconds 00000100:00100000:1.0:1786015572.192328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.192461:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304471296:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015572.192500:0:14547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503c9d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.192806:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280695552 00000100:00100000:0.0:1786015572.192817:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280695552 00000100:00100000:0.0:1786015572.192886:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1581 00000100:00100000:0.0:1786015572.192899:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+62:33481:x1872772280695552:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015572.192937:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015572.192969:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503cab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e941f expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.193128:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503cb2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.193146:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.193169:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015572.193184:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x30:0x0]: returning size 158 00010000:00010000:0.0:1786015572.193376:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6400/0xb1a5ef690c503cab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e941f expref: 65 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.193400:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e941f expref: 64 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.193410:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8b749232d500) 00010000:00010000:0.0:1786015572.193413:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015572.193418:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7400, rc 0) 00000100:00100000:0.0:1786015572.193504:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+64:33481:x1872772280695552:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 607us (1189us total) trans 4294968343 rc 0/0 00000100:00100000:0.0:1786015572.193513:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1581 00000100:00100000:0.0:1786015572.193572:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381305c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304471168:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015572.193595:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c96 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.196608:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.196662:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.197438:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280695808 00000100:00100000:1.0:1786015572.197452:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280695808 00010000:00010000:1.0:1786015572.197513:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93d2 expref: 112 pid: 5794 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015572.197561:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 459 00000100:00100000:1.0:1786015572.197572:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabf4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+112:2351:x1872772280695808:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015572.197591:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015572.197599:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93d2 expref: 112 pid: 5794 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.197615:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93d2 expref: 112 pid: 5794 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.197642:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7c00/0xb1a5ef690c503bd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e93d2 expref: 112 pid: 5794 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.197665:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015572.197671:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c96 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.197694:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.197702:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c96 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.197733:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015572.197847:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabf4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+111:2351:x1872772280695808:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 276us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015572.197856:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 459 00010000:00010000:0.0:1786015572.200108:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015572.200442:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280695936 00000100:00100000:3.0:1786015572.200461:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280695936 00002000:00100000:3.0:1786015572.200538:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1f:0x0] (0->157) req@ffff8b7381305c00 x1872772280695936/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:418/0 lens 648/0 e 0 to 0 dl 1786015583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015572.200551:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381305c00 with x1872772280695936 ext(0->157) 00010000:00010000:3.0:1786015572.200561:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000802f16a6/0xb1a5ef690c503b7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e937e expref: 12 pid: 14547 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.200580:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000802f16a6/0xb1a5ef690c503b7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e937e expref: 12 pid: 14547 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015572.200589:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b7381305c00 00000100:00100000:3.0:1786015572.200629:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:3.0:1786015572.200640:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2351:x1872772280695936:12345-192.168.202.56@tcp:4:cp.0 00010000:00010000:0.0:1786015572.201014:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.201054:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503cc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.201070:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.201082:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786015572.201827:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1786015572.202067:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503cc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.202080:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.202090:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.202135:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.202143:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c96 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.202150:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.202157:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca7800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.202161:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.202169:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c96 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.202184:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015572.202187:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.202193:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c96 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.202201:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7800/0xb1a5ef690c503c96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015572.202216:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006b5d12b4 reply state 000000007a580c85 transno 4294968344 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.202227:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786015572.202279:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7a00/0xb1a5ef690c503c8f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9418 expref: 65 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.202297:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9418 expref: 64 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.202306:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8b749302f200) 00010000:00010000:0.0:1786015572.202309:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015572.202312:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74c0ca7600, rc 0) 00000100:00100000:0.0:1786015572.202424:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+65:33480:x1872772280694912:12345-192.168.202.56@tcp:101:cp.0 Request processed in 29811us (30055us total) trans 4294968344 rc 0/0 00000100:00100000:0.0:1786015572.202434:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1580 00000100:00100000:3.0:1786015572.204497:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2351:x1872772280695936:12345-192.168.202.56@tcp:4:cp.0 Request processed in 3842us (7817us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1786015572.204514:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 18 00002000:00100000:3.0:1786015572.204531:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1f:0x0] (0->157) req@ffff8b7381305c00 x1872772280695936/t4294967377(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:418/0 lens 648/448 e 0 to 0 dl 1786015583 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015572.204545:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381305c00 with x1872772280695936 ext(0->157) 00010000:00010000:3.0:1786015572.204558:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000802f16a6/0xb1a5ef690c503b7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e937e expref: 14 pid: 14547 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.204574:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000802f16a6/0xb1a5ef690c503b7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e937e expref: 14 pid: 14547 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015572.204584:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b7381305c00 00000100:00100000:3.0:1786015572.204781:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.205940:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00080000:2.0:1786015572.208037:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015572.209038:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280696192 00000100:00100000:3.0:1786015572.209057:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280696192 00000100:00100000:2.0:1786015572.209504:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.209624:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 448 00000100:00100000:3.0:1786015572.209639:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2353:x1872772280696192:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015572.209710:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000062f96dbd/0xb1a5ef690c503cd5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.209738:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c503955 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9219 expref: 14 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.209758:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1e:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786015572.209805:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015572.209811:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062f96dbd/0xb1a5ef690c503cd5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.209862:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c503955 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9219 expref: 14 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.209879:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c503955 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9219 expref: 14 pid: 14547 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015572.209899:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304471552:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015572.210024:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b7e16900 going to sleep for 11 seconds 00010000:00010000:3.0:1786015572.210054:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.210063:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503cc0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.210071:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503cc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.210079:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015572.210085:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503cc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.210093:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503cc0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.210127:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff8b749302fb00) 00010000:00010000:3.0:1786015572.210131:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.210137:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503cc0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.210145:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6200/0xb1a5ef690c503cc0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015572.210204:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:3.0:1786015572.210213:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00000100:00100000:1.0:1786015572.211225:0:6591:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:1.0:1786015572.211239:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280696320 00000100:00100000:1.0:1786015572.211248:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280696320 00000100:00100000:0.0:1786015572.212333:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280696064 00000100:00100000:0.0:1786015572.212344:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280696064 00002000:00100000:0.0:1786015572.212404:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (0->157) req@ffff8b7382d0d880 x1872772280696064/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:418/0 lens 648/0 e 0 to 0 dl 1786015583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015572.212419:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7382d0d880 with x1872772280696064 ext(0->157) 00010000:00010000:0.0:1786015572.212431:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000062a1eb1c/0xb1a5ef690c503a6d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92b3 expref: 14 pid: 6591 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.212450:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000062a1eb1c/0xb1a5ef690c503a6d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92b3 expref: 14 pid: 6591 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015572.212460:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b7382d0d880 00000100:00100000:0.0:1786015572.212487:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:0.0:1786015572.212499:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2353:x1872772280696064:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:0.0:1786015572.213477:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+16:2353:x1872772280696064:12345-192.168.202.56@tcp:4:cp.0 Request processed in 973us (8710us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1786015572.213489:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00002000:00100000:0.0:1786015572.213497:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x21:0x0] (0->157) req@ffff8b7382d0d880 x1872772280696064/t4294967392(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:418/0 lens 648/448 e 0 to 0 dl 1786015583 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015572.213507:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7382d0d880 with x1872772280696064 ext(0->157) 00010000:00010000:0.0:1786015572.213516:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000062a1eb1c/0xb1a5ef690c503a6d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92b3 expref: 16 pid: 6591 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.213534:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000062a1eb1c/0xb1a5ef690c503a6d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92b3 expref: 16 pid: 6591 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015572.213542:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b7382d0d880 00000100:00100000:0.0:1786015572.214938:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304471424:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015572.214981:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004e3b593d/0xb1a5ef690c503ca4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.216071:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 449 00000100:00100000:0.0:1786015572.216087:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2354:x1872772280696320:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015572.216119:0:22346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015572.216147:0:22346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c503cdc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9426 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015572.216185:0:22346:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786015572.216211:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=807s v=(0 0) 00010000:00010000:0.0:1786015572.216217:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015572.216228:0:22346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c503cdc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9426 expref: 16 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.216248:0:22346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c503cdc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9426 expref: 16 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.216265:0:22346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386be00, rc 0) 00000100:00100000:0.0:1786015572.216344:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+16:2354:x1872772280696320:12345-192.168.202.56@tcp:101:cp.0 Request processed in 261us (6842us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.216352:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 449 00000100:00100000:1.0:1786015572.218991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.219103:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280696448 00000100:00100000:2.0:1786015572.219132:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280696448 00000100:00100000:2.0:1786015572.219225:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00100000:2.0:1786015572.219237:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+64:2354:x1872772280696448:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015572.219258:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015572.219294:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7400/0xb1a5ef690c503cb2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e941f expref: 64 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.219319:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8b749232d500) 00010000:00010000:2.0:1786015572.219325:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015572.219399:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+63:2354:x1872772280696448:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 164us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015572.219409:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00100000:2.0:1786015572.229229:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.229281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.229325:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.229490:0:17969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280696704 00000100:00100000:0.0:1786015572.229508:0:17969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280696704 00002000:00100000:0.0:1786015572.229606:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1e:0x0] (0->157) req@ffff8b74b8f18000 x1872772280696704/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:418/0 lens 648/0 e 0 to 0 dl 1786015583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015572.229622:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74b8f18000 with x1872772280696704 ext(0->157) 00010000:00010000:0.0:1786015572.229636:0:17969:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c503955 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9219 expref: 15 pid: 14547 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.229657:0:17969:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c503955 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9219 expref: 15 pid: 14547 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015572.229667:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b74b8f18000 00000100:00100000:0.0:1786015572.229712:0:17969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:0.0:1786015572.229724:0:17969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2354:x1872772280696704:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:0.0:1786015572.230400:0:17969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+17:2354:x1872772280696704:12345-192.168.202.56@tcp:4:cp.0 Request processed in 675us (1114us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1786015572.230410:0:17969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 20 00002000:00100000:0.0:1786015572.230418:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1e:0x0] (0->157) req@ffff8b74b8f18000 x1872772280696704/t4294967378(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:418/0 lens 648/448 e 0 to 0 dl 1786015583 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015572.230429:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74b8f18000 with x1872772280696704 ext(0->157) 00010000:00010000:0.0:1786015572.230436:0:17969:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c503955 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9219 expref: 17 pid: 14547 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.230454:0:17969:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c503955 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9219 expref: 17 pid: 14547 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015572.230461:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b74b8f18000 00000100:00100000:1.0:1786015572.230964:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280696576 00000100:00100000:1.0:1786015572.230975:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280696576 00010000:00010000:1.0:1786015572.231009:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000802f16a6/0xb1a5ef690c503b7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e937e expref: 17 pid: 14547 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015572.231041:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 460 00000100:00100000:1.0:1786015572.231049:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+17:2354:x1872772280696576:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015572.231064:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015572.231083:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000802f16a6/0xb1a5ef690c503b7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e937e expref: 17 pid: 14547 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.231097:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000802f16a6/0xb1a5ef690c503b7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e937e expref: 17 pid: 14547 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.231138:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000802f16a6/0xb1a5ef690c503b7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e937e expref: 17 pid: 14547 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.231280:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015572.231286:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015572.231293:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503c9d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.231305:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503c9d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.231344:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015572.231374:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+16:2354:x1872772280696576:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 325us (2163us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015572.231381:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 460 00000100:00100000:1.0:1786015572.231407:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280696832 00000100:00100000:1.0:1786015572.231411:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280696832 00000100:00100000:1.0:1786015572.231438:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 450 00000100:00100000:1.0:1786015572.231444:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+16:33480:x1872772280696832:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015572.231458:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015572.231477:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0572f25/0xb1a5ef690c503ce3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e942d expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.231501:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c503cdc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9426 expref: 17 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.231510:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015572.231513:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015572.231517:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0572f25/0xb1a5ef690c503ce3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e942d expref: 17 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.231548:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c503cdc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9426 expref: 17 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.231561:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c503cdc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9426 expref: 17 pid: 22346 timeout: 907 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015572.231576:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304471680:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015572.231637:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486540cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1786015572.232346:0:14547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503c9d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.232362:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503c9d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.232398:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503c9d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.232405:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503c9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.232414:0:14547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503c9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.232422:0:14547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc400 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015572.232427:0:14547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503c9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.232436:0:14547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503c9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.232457:0:14547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503c9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.232466:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503c9d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.232579:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2353:x1872772280695040:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 55899us (57158us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.232588:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 446 00000100:00100000:3.0:1786015572.235631:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304471552:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015572.235681:0:11384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000062f96dbd/0xb1a5ef690c503cd5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015572.238103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.238487:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.238571:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6591:1872772304471680:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015572.238617:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0572f25/0xb1a5ef690c503ce3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e942d expref: 17 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.238643:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921400, rc 0) 00000100:00100000:1.0:1786015572.238727:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+17:33480:x1872772280696832:12345-192.168.202.56@tcp:101:cp.0 Request processed in 7281us (9399us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015572.238738:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 450 00000100:00100000:2.0:1786015572.244455:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.244523:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280696960 00000100:00100000:0.0:1786015572.244546:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280696960 00010000:00010000:0.0:1786015572.244605:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062a1eb1c/0xb1a5ef690c503a6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92b3 expref: 17 pid: 6591 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.244654:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280697216 00000100:00100000:0.0:1786015572.244658:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280697216 00010000:00010000:0.0:1786015572.244677:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c503955 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9219 expref: 15 pid: 14547 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.244703:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 461 00000100:00100000:0.0:1786015572.244714:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+17:2351:x1872772280696960:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015572.244753:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015572.244809:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062a1eb1c/0xb1a5ef690c503a6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92b3 expref: 17 pid: 6591 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.244845:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062a1eb1c/0xb1a5ef690c503a6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92b3 expref: 17 pid: 6591 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.244876:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062a1eb1c/0xb1a5ef690c503a6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92b3 expref: 17 pid: 6591 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.244901:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015572.244907:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015572.244915:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e3b593d/0xb1a5ef690c503ca4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015572.245090:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 462 00000100:00100000:1.0:1786015572.245102:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2353:x1872772280697216:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015572.245124:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015572.245145:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c503955 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9219 expref: 15 pid: 14547 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.245157:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c503955 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9219 expref: 15 pid: 14547 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.245185:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7260132/0xb1a5ef690c503955 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9219 expref: 15 pid: 14547 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.245196:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015572.245200:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015572.245204:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000062f96dbd/0xb1a5ef690c503cd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.245217:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062f96dbd/0xb1a5ef690c503cd5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.245255:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015572.245328:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2353:x1872772280697216:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 228us (6841us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015572.245341:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 462 00010000:00010000:1.0:1786015572.245383:0:11384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000062f96dbd/0xb1a5ef690c503cd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.245393:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062f96dbd/0xb1a5ef690c503cd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.245421:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000062f96dbd/0xb1a5ef690c503cd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.245431:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062f96dbd/0xb1a5ef690c503cd5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.245438:0:11384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062f96dbd/0xb1a5ef690c503cd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.245446:0:11384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbce00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015572.245451:0:11384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062f96dbd/0xb1a5ef690c503cd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.245460:0:11384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062f96dbd/0xb1a5ef690c503cd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.245473:0:11384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062f96dbd/0xb1a5ef690c503cd5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.245486:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062f96dbd/0xb1a5ef690c503cd5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015572.245552:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280696192:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 35917us (39632us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015572.245563:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 448 00010000:00010000:0.0:1786015572.246052:0:17038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3b593d/0xb1a5ef690c503ca4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.246088:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015572.246187:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004e3b593d/0xb1a5ef690c503ca4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.246197:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e3b593d/0xb1a5ef690c503ca4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.246227:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004e3b593d/0xb1a5ef690c503ca4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.246234:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e3b593d/0xb1a5ef690c503ca4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.246240:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e3b593d/0xb1a5ef690c503ca4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.246247:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74c0ca6a00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015572.246250:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e3b593d/0xb1a5ef690c503ca4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.246263:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e3b593d/0xb1a5ef690c503ca4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.246274:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e3b593d/0xb1a5ef690c503ca4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.246281:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e3b593d/0xb1a5ef690c503ca4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015572.246334:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+16:2352:x1872772280695680:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 60097us (60774us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015572.246342:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 447 00000100:00100000:0.0:1786015572.246437:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2351:x1872772280696960:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1725us (8349us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.246445:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 461 00000100:00100000:2.0:1786015572.246755:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.249093:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280697088 00000100:00100000:3.0:1786015572.249124:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280697088 00010000:00010000:3.0:1786015572.249214:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c503cdc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9426 expref: 15 pid: 22346 timeout: 907 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.249542:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280697472 00000100:00100000:0.0:1786015572.249548:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280697472 00000100:00100000:0.0:1786015572.249608:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1582 00000100:00100000:0.0:1786015572.249620:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+63:33483:x1872772280697472:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015572.249805:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+63:33483:x1872772280697472:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 187us (3067us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.249813:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1582 00000100:00100000:3.0:1786015572.251752:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 463 00000100:00100000:3.0:1786015572.251798:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2352:x1872772280697088:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015572.251822:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015572.251875:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c503cdc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9426 expref: 15 pid: 22346 timeout: 907 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.251898:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c503cdc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9426 expref: 15 pid: 22346 timeout: 907 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.251940:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d9fc6c8/0xb1a5ef690c503cdc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9426 expref: 15 pid: 22346 timeout: 907 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.251967:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015572.251972:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015572.251984:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0572f25/0xb1a5ef690c503ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e942d expref: 14 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.251996:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0572f25/0xb1a5ef690c503ce3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e942d expref: 14 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.252051:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b0572f25/0xb1a5ef690c503ce3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e942d expref: 14 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015572.252069:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5782:1872772304471808:192.168.202.56@tcp:105: 00000100:00100000:1.0:1786015572.253365:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.253413:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280697728 00000100:00100000:1.0:1786015572.253424:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280697728 00000100:00100000:1.0:1786015572.253484:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1583 00000100:00100000:1.0:1786015572.253495:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+63:33482:x1872772280697728:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015572.253686:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.258644:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280697984 00000100:00100000:2.0:1786015572.258671:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280697984 00000100:00100000:2.0:1786015572.258817:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1584 00000100:00100000:2.0:1786015572.258839:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+64:33481:x1872772280697984:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015572.259020:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+64:33481:x1872772280697984:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 192us (5333us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015572.259028:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1584 00000100:00100000:1.0:1786015572.261316:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+63:33482:x1872772280697728:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 7028us (7164us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015572.261338:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1583 00000100:00100000:1.0:1786015572.261449:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.261611:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.261641:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280698368 00000100:00100000:1.0:1786015572.261652:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280698368 00000100:00100000:1.0:1786015572.261725:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 326 00000100:00100000:1.0:1786015572.261750:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+63:33480:x1872772280698368:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:0.0:1786015572.269182:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280698112 00000100:00100000:0.0:1786015572.269206:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280698112 00000100:00100000:0.0:1786015572.269323:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 451 00000100:00100000:0.0:1786015572.269337:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280698112:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015572.269366:0:22346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015572.269399:0:22346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d08a9211/0xb1a5ef690c503cea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9434 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015572.269437:0:22346:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 158, mtime: 0x6a746f54, atime: 0x0, ctime: 0x6a746f54, blocks: 0x1 00010000:00010000:0.0:1786015572.269467:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=807s v=(0 0) 00010000:00010000:0.0:1786015572.269473:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015572.269485:0:22346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d08a9211/0xb1a5ef690c503cea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9434 expref: 14 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.269507:0:22346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d08a9211/0xb1a5ef690c503cea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9434 expref: 14 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.269524:0:22346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386b200, rc 0) 00000100:00100000:3.0:1786015572.270281:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b7e16900 going to sleep for 11 seconds 00000100:00100000:3.0:1786015572.270328:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5782:1872772304471808:192.168.202.56@tcp:105: 00010000:00010000:3.0:1786015572.270359:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015572.272313:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2354:x1872772280698112:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 2188us (10073us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.272333:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 451 00000100:00100000:3.0:1786015572.272589:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2352:x1872772280697088:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 20804us (28147us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015572.272601:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 463 00000100:00100000:1.0:1786015572.273315:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+64:33480:x1872772280698368:12345-192.168.202.56@tcp:35:cp.0 Request processed in 11575us (11697us total) trans 4294968345 rc 0/0 00000100:00100000:1.0:1786015572.273329:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 326 00000100:00100000:2.0:1786015572.273470:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.273518:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.279715:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.280380:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280698496 00000100:00100000:3.0:1786015572.280394:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280698496 00000100:00100000:3.0:1786015572.282048:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280698624 00000100:00100000:3.0:1786015572.282063:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280698624 00000100:00100000:3.0:1786015572.282108:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 452 00000100:00100000:3.0:1786015572.282120:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2353:x1872772280698496:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015572.282153:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015572.282196:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503cf1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e943b expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015572.282232:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 158, mtime: 0x6a746f53, atime: 0x0, ctime: 0x6a746f53, blocks: 0x1 00010000:00010000:3.0:1786015572.282265:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=807s v=(0 0) 00010000:00010000:3.0:1786015572.282271:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015572.282283:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503cf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e943b expref: 15 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.282306:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503cf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e943b expref: 15 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.282326:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbc400, rc 0) 00000100:00100000:0.0:1786015572.292699:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 453 00000100:00100000:0.0:1786015572.292752:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2354:x1872772280698624:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015572.292794:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015572.292828:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000733bf407/0xb1a5ef690c503cf8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9442 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015572.292882:0:14547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 158, mtime: 0x6a746f53, atime: 0x0, ctime: 0x6a746f53, blocks: 0x1 00010000:00010000:0.0:1786015572.292917:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=807s v=(0 0) 00010000:00010000:0.0:1786015572.293122:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015572.293138:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000733bf407/0xb1a5ef690c503cf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9442 expref: 15 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.293277:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000733bf407/0xb1a5ef690c503cf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9442 expref: 15 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.293298:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386ae00, rc 0) 00000100:00100000:3.0:1786015572.298616:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2353:x1872772280698496:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 16473us (25121us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015572.298638:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 452 00000100:00100000:3.0:1786015572.298902:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280698880 00000100:00100000:3.0:1786015572.298917:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280698880 00000100:00100000:3.0:1786015572.299005:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1585 00000100:00100000:3.0:1786015572.299016:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+64:33483:x1872772280698880:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015572.304422:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2354:x1872772280698624:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 11685us (30881us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.304442:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 453 00000100:00100000:1.0:1786015572.305134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.305250:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280699136 00000100:00100000:0.0:1786015572.305263:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280699136 00000100:00100000:0.0:1786015572.305329:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1586 00000100:00100000:0.0:1786015572.305341:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+65:33481:x1872772280699136:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786015572.307629:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+65:33483:x1872772280698880:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 8595us (27912us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015572.307646:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1585 00000100:00100000:0.0:1786015572.310892:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+64:33481:x1872772280699136:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 5531us (5739us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.310912:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1586 00000100:00100000:1.0:1786015572.312058:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.317452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.317568:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280699520 00000100:00100000:1.0:1786015572.317584:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280699520 00002000:00100000:1.0:1786015572.317654:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1f:0x0] (0->4095) req@ffff8b7488259f80 x1872772280699520/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:418/0 lens 488/0 e 0 to 0 dl 1786015583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015572.317669:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7488259f80 with x1872772280699520 ext(0->4095) 00002000:00010000:1.0:1786015572.317677:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7488259f80 00000100:00100000:1.0:1786015572.317730:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 128 00000100:00100000:1.0:1786015572.317751:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2353:x1872772280699520:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1786015572.318457:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2353:x1872772280699520:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 713us (1016us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786015572.318468:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 128 00002000:00100000:1.0:1786015572.318477:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1f:0x0] (0->4095) req@ffff8b7488259f80 x1872772280699520/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:418/0 lens 488/4536 e 0 to 0 dl 1786015583 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015572.318487:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7488259f80 with x1872772280699520 ext(0->4095) 00002000:00010000:1.0:1786015572.318492:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7488259f80 00000100:00100000:0.0:1786015572.320983:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280699392 00000100:00100000:0.0:1786015572.321005:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280699392 00000100:00100000:0.0:1786015572.321082:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1587 00000100:00100000:0.0:1786015572.321094:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+64:33482:x1872772280699392:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015572.323362:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+64:33482:x1872772280699392:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 2255us (11295us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.323380:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1587 00000100:00100000:2.0:1786015572.326478:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.326801:0:17970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280699648 00000100:00100000:0.0:1786015572.326815:0:17970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280699648 00002000:00100000:0.0:1786015572.327608:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1e:0x0] (0->4095) req@ffff8b7381cc2a00 x1872772280699648/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:418/0 lens 488/0 e 0 to 0 dl 1786015583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015572.327625:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381cc2a00 with x1872772280699648 ext(0->4095) 00002000:00010000:0.0:1786015572.327633:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7381cc2a00 00000100:00100000:0.0:1786015572.328060:0:17970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 129 00000100:00100000:0.0:1786015572.328078:0:17970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2351:x1872772280699648:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1786015572.328467:0:17970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2351:x1872772280699648:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 393us (2001us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786015572.332031:0:17970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 129 00002000:00100000:0.0:1786015572.332061:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1e:0x0] (0->4095) req@ffff8b7381cc2a00 x1872772280699648/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:418/0 lens 488/4536 e 0 to 0 dl 1786015583 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015572.332075:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381cc2a00 with x1872772280699648 ext(0->4095) 00002000:00010000:0.0:1786015572.332084:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7381cc2a00 00000100:00100000:2.0:1786015572.336637:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.337172:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280699904 00000100:00100000:1.0:1786015572.337186:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280699904 00000100:00100000:1.0:1786015572.337378:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1588 00000100:00100000:1.0:1786015572.337391:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+64:33483:x1872772280699904:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015572.337424:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015572.337454:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503cff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9450 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.337498:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503d06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.337515:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503d06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.337538:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503d06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.337672:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503cff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9450 expref: 66 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.337697:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503d06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9450 expref: 65 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.337708:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8b749802ea00) 00010000:00010000:1.0:1786015572.337712:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015572.337716:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921600, rc 0) 00000100:00100000:1.0:1786015572.338059:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+65:33483:x1872772280699904:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 671us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015572.338068:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1588 00000100:00100000:3.0:1786015572.350885:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.351030:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280700032 00000100:00100000:0.0:1786015572.351045:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280700032 00000100:00100000:0.0:1786015572.351133:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1589 00000100:00100000:0.0:1786015572.351144:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+65:33481:x1872772280700032:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015572.351176:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015572.351208:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503d0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9457 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.351260:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503d14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.351280:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503d14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.351293:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503d14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.351443:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c503d0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9457 expref: 67 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.351466:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503d14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9457 expref: 66 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.351475:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8b749232d500) 00010000:00010000:0.0:1786015572.351478:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015572.351482:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73829f9400, rc 0) 00000100:00100000:0.0:1786015572.351636:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+66:33481:x1872772280700032:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 493us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.351645:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1589 00000100:00100000:3.0:1786015572.351737:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.352279:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280700160 00000100:00100000:0.0:1786015572.352288:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280700160 00002000:00100000:0.0:1786015572.352328:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (0->4095) req@ffff8b7382d0df80 x1872772280700160/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:418/0 lens 488/0 e 0 to 0 dl 1786015583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015572.352339:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7382d0df80 with x1872772280700160 ext(0->4095) 00002000:00010000:0.0:1786015572.352345:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7382d0df80 00000100:00100000:0.0:1786015572.352378:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 130 00000100:00100000:0.0:1786015572.352386:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2353:x1872772280700160:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1786015572.352884:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2353:x1872772280700160:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 497us (1145us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786015572.352894:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 130 00002000:00100000:0.0:1786015572.352901:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (0->4095) req@ffff8b7382d0df80 x1872772280700160/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:418/0 lens 488/4536 e 0 to 0 dl 1786015583 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015572.352910:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7382d0df80 with x1872772280700160 ext(0->4095) 00002000:00010000:0.0:1786015572.352914:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b7382d0df80 00000100:00100000:3.0:1786015572.357027:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.357490:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280699776 00000100:00100000:1.0:1786015572.357505:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280699776 00000100:00100000:1.0:1786015572.357591:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1590 00000100:00100000:1.0:1786015572.357604:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+111:33487:x1872772280699776:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015572.357637:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015572.357672:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503d1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9449 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.357815:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503d22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.357843:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503d22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.357859:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503d22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.357879:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503d29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.357887:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503d29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.357894:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503d29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358053:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c503d30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358063:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c503d30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358070:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c503d30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015572.358472:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x33:0x0]: returning size 158 00000004:00200000:1.0:1786015572.358479:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015572.358503:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c503d30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358518:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c503d30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358575:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503d22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358584:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503d22 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358592:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503d22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358598:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015572.358604:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503d22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358612:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503d22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358627:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015572.358629:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015572.358634:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503d22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358640:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503d22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358660:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503d29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358666:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503d29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358671:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503d29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358676:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015572.358679:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503d29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358685:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503d29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358692:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff8b748f194000) 00010000:00010000:1.0:1786015572.358695:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015572.358698:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503d29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358704:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503d29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358752:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503d1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9449 expref: 113 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358798:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c503d30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9449 expref: 112 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.358813:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8b749302f200) 00010000:00010000:1.0:1786015572.358815:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015572.358818:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920000, rc 0) 00000100:00100000:1.0:1786015572.360511:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+112:33487:x1872772280699776:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 2897us (3487us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015572.360527:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1590 00000100:00100000:2.0:1786015572.362959:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.363007:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280700288 00000100:00100000:2.0:1786015572.363020:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280700288 00000100:00100000:2.0:1786015572.363082:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1591 00000100:00100000:2.0:1786015572.363092:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+66:33483:x1872772280700288:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015572.363151:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015572.363279:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+66:33483:x1872772280700288:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 188us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015572.363287:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1591 00000100:00100000:2.0:1786015572.365401:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.365506:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280700416 00000100:00100000:3.0:1786015572.365520:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280700416 00000100:00100000:3.0:1786015572.365597:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1592 00000100:00100000:3.0:1786015572.365608:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+66:33481:x1872772280700416:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015572.365692:0:7673:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x30:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015572.365861:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+66:33481:x1872772280700416:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 254us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015572.365870:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1592 00000100:00100000:3.0:1786015572.374594:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.375119:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280700544 00000100:00100000:0.0:1786015572.375134:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280700544 00000100:00100000:0.0:1786015572.375232:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 454 00000100:00100000:0.0:1786015572.375245:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280700544:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015572.375271:0:22346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015572.375297:0:22346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f1b73ba/0xb1a5ef690c503d37 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e945e expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.375379:0:22346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22346:1872772304471936:192.168.202.56@tcp:106: 00000100:00100000:0.0:1786015572.375501:0:22346:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb600 going to sleep for 11 seconds 00000100:00080000:2.0:1786015572.375699:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015572.384005:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.385617:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.387717:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.388187:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280700928 00000100:00100000:0.0:1786015572.388201:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280700928 00000100:00100000:0.0:1786015572.388273:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1593 00000100:00100000:0.0:1786015572.388284:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+66:33482:x1872772280700928:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015572.388313:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015572.388342:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c503d3e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9465 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.388389:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503d45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.388407:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503d45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.388421:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503d45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.388571:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c503d3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9465 expref: 68 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.388595:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503d45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9465 expref: 67 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.388606:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8b7482d4bb00) 00010000:00010000:0.0:1786015572.388609:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015572.388613:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481664a00, rc 0) 00000100:00100000:0.0:1786015572.388687:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+67:33482:x1872772280700928:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 404us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.388695:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1593 00002000:00010000:0.0:1786015572.392715:0:22346:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size: 0 -> 158 00002000:00010000:0.0:1786015572.392731:0:22346:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime: 0 -> 1786015572 00002000:00010000:0.0:1786015572.392747:0:22346:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime: 0 -> 1786015572 00002000:00010000:0.0:1786015572.392751:0:22346:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime: 0 -> 1786015572 00000100:00100000:0.0:1786015572.392810:0:22346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22346:1872772304471936:192.168.202.56@tcp:106: 00010000:00010000:0.0:1786015572.392872:0:22346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000f1b73ba/0xb1a5ef690c503d37 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e945e expref: 18 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.392907:0:22346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f1b73ba/0xb1a5ef690c503d37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e945e expref: 18 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.392933:0:22346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481665400, rc 0) 00000100:00100000:0.0:1786015572.393036:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280700544:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 17792us (18455us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015572.393046:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 454 00000100:00100000:3.0:1786015572.393516:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280700672 00000100:00100000:3.0:1786015572.393528:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280700672 00000100:00100000:3.0:1786015572.393608:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280700800 00000100:00100000:3.0:1786015572.393612:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280700800 00000100:00100000:3.0:1786015572.393657:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 455 00000100:00100000:3.0:1786015572.393668:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+16:2351:x1872772280700672:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015572.393753:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c503d4c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.393790:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015572.393795:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015572.393803:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c503d4c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.393820:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c503d4c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015572.393966:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 456 00000100:00100000:2.0:1786015572.393979:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+16:2352:x1872772280700800:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786015572.394003:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c9e3925a/0xb1a5ef690c503d53 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.394013:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015572.394016:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015572.394020:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9e3925a/0xb1a5ef690c503d53 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.394037:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9e3925a/0xb1a5ef690c503d53 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.394076:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c9e3925a/0xb1a5ef690c503d53 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.394086:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9e3925a/0xb1a5ef690c503d53 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.394096:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9e3925a/0xb1a5ef690c503d53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.394104:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73830a1000 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015572.394119:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9e3925a/0xb1a5ef690c503d53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.394137:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9e3925a/0xb1a5ef690c503d53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.394152:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9e3925a/0xb1a5ef690c503d53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.394160:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9e3925a/0xb1a5ef690c503d53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015572.394233:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+16:2352:x1872772280700800:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 258us (8628us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015572.394241:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 456 00000100:00100000:1.0:1786015572.395287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:3.0:1786015572.395530:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c503d4c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.395544:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c503d4c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.395552:0:14547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c503d4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.395559:0:14547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015572.395563:0:14547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c503d4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.395571:0:14547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c503d4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.395587:0:14547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c503d4c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.395596:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c503d4c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015572.395684:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2351:x1872772280700672:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 2014us (12156us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015572.395693:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 455 00000100:00100000:2.0:1786015572.395870:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280701056 00000100:00100000:2.0:1786015572.395882:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280701056 00000100:00100000:2.0:1786015572.395950:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1594 00000100:00100000:2.0:1786015572.395962:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+67:33482:x1872772280701056:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015572.396021:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x31:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015572.396494:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+67:33482:x1872772280701056:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 532us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015572.396502:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1594 00000100:00100000:2.0:1786015572.403093:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.403144:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.403311:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280701312 00000100:00100000:3.0:1786015572.403324:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280701312 00000100:00100000:3.0:1786015572.403383:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280701568 00000100:00100000:3.0:1786015572.403386:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280701568 00000100:00100000:3.0:1786015572.403408:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1595 00000100:00100000:3.0:1786015572.403418:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+68:33483:x1872772280701312:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786015572.403526:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503d5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.403547:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503d06 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9450 expref: 68 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.403556:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503d5a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.403598:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503d06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9450 expref: 68 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.403614:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503d06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9450 expref: 68 pid: 5795 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015572.403631:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304472064:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015572.403720:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b7e16900 going to sleep for 11 seconds 00000100:00100000:1.0:1786015572.404020:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1596 00000100:00100000:1.0:1786015572.404033:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+68:33481:x1872772280701568:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786015572.404066:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503d61 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.404078:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503d14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9457 expref: 68 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.404086:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503d61 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.404104:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503d14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9457 expref: 68 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.404123:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503d14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9457 expref: 68 pid: 5796 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015572.404139:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304472192:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015572.404170:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7486540cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015572.405852:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.406339:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280701696 00000100:00100000:2.0:1786015572.406352:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280701696 00000100:00100000:2.0:1786015572.406426:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1597 00000100:00100000:2.0:1786015572.406437:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+112:33487:x1872772280701696:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015572.406462:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015572.406489:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503d68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e946c expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.406577:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503d6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.406596:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.406611:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015572.406697:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 7680 00000004:00200000:2.0:1786015572.406702:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 6 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015572.406732:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.407646:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179200/0xb1a5ef690c503d68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e946c expref: 114 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.407673:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503d6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e946c expref: 113 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.407694:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015572.407697:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015572.407702:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e7e00, rc 0) 00000100:00100000:2.0:1786015572.407839:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+113:33487:x1872772280701696:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1402us (2007us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015572.407849:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1597 00000100:00100000:1.0:1786015572.410914:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.411419:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280701824 00000100:00100000:0.0:1786015572.411431:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280701824 00000100:00100000:0.0:1786015572.411499:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 457 00000100:00100000:0.0:1786015572.411511:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2353:x1872772280701824:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786015572.411578:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008d06a128/0xb1a5ef690c503d76 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.411600:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015572.411606:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015572.411614:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d06a128/0xb1a5ef690c503d76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.411631:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d06a128/0xb1a5ef690c503d76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.411674:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008d06a128/0xb1a5ef690c503d76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.411688:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d06a128/0xb1a5ef690c503d76 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.411698:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d06a128/0xb1a5ef690c503d76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.411706:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481665600 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015572.411712:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d06a128/0xb1a5ef690c503d76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.411722:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d06a128/0xb1a5ef690c503d76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.411750:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d06a128/0xb1a5ef690c503d76 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.411780:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d06a128/0xb1a5ef690c503d76 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.411893:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2353:x1872772280701824:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 383us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.411901:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 457 00000100:00100000:3.0:1786015572.412328:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1872772304472064:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015572.412360:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503d5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015572.412416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.412503:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.412567:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280701952 00000100:00100000:0.0:1786015572.412573:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280701952 00010000:00010000:0.0:1786015572.412603:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503d06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9450 expref: 69 pid: 5795 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.412640:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280702080 00000100:00100000:0.0:1786015572.412643:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280702080 00010000:00010000:0.0:1786015572.412657:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503d14 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9457 expref: 70 pid: 5796 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.412678:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 464 00000100:00100000:0.0:1786015572.412686:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+70:2352:x1872772280701952:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015572.412703:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015572.412710:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503d06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9450 expref: 70 pid: 5795 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.412724:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503d06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9450 expref: 70 pid: 5795 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.412788:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c503d06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9450 expref: 70 pid: 5795 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.412803:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8b749802ea00) 00010000:00010000:0.0:1786015572.412808:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503d5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.412819:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503d5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.412836:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503d5a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.412864:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015572.412898:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+69:2352:x1872772280701952:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 213us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.412906:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 464 00000100:00100000:1.0:1786015572.413852:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304472192:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015572.413881:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503d61 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015572.414433:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 465 00000100:00100000:1.0:1786015572.414452:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748821c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+68:2352:x1872772280702080:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015572.414471:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015572.414482:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503d14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9457 expref: 68 pid: 5796 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.414542:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503d14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9457 expref: 68 pid: 5796 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.414567:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9400/0xb1a5ef690c503d14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9457 expref: 68 pid: 5796 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.414584:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8b749232d500) 00010000:00010000:1.0:1786015572.414589:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503d61 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.414598:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503d61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.414606:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503d61 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.414632:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015572.414692:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748821c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+67:2352:x1872772280702080:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 248us (2188us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015572.414700:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 465 00010000:00010000:1.0:1786015572.414821:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503d61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.414829:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503d61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.418552:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503d61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.418575:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503d61 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.418583:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503d61 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.418590:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015572.418595:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503d61 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.418603:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503d61 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.418624:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8b749232d500) 00010000:00010000:1.0:1786015572.418628:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015572.418634:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503d61 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.418641:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503d61 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015572.418972:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+67:33481:x1872772280701568:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 14932us (15815us total) trans 4294968346 rc 0/0 00000100:00100000:1.0:1786015572.418984:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1596 00010000:00010000:1.0:1786015572.419048:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503d5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.419057:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503d5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.422706:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503d5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.422730:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503d5a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.423298:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503d5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.423306:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbdc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015572.423312:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503d5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.423322:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503d5a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.423349:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8b749802ea00) 00010000:00010000:1.0:1786015572.423352:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015572.423359:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503d5a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.423366:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503d5a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015572.423603:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+67:33483:x1872772280701312:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 20178us (20515us total) trans 4294968347 rc 0/0 00000100:00100000:1.0:1786015572.423615:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1595 00000100:00100000:3.0:1786015572.424274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.424324:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280702208 00000100:00100000:3.0:1786015572.424337:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280702208 00000100:00100000:3.0:1786015572.424391:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 458 00000100:00100000:3.0:1786015572.424401:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280702208:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015572.424426:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015572.424451:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac472ba5/0xb1a5ef690c503d7d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9473 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015572.424526:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b29180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304472320:192.168.202.56@tcp:106: 00000100:00100000:3.0:1786015572.424617:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b7e16900 going to sleep for 11 seconds 00000100:00100000:3.0:1786015572.425135:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.425182:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280702464 00000100:00100000:3.0:1786015572.425188:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280702464 00000100:00100000:3.0:1786015572.425235:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1598 00000100:00100000:3.0:1786015572.425244:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+67:33482:x1872772280702464:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786015572.425331:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503d84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.425347:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503d45 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9465 expref: 67 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.425356:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503d84 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.425387:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503d45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9465 expref: 67 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.425403:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503d45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9465 expref: 67 pid: 5794 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015572.425416:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304472448:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015572.425457:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b7e16300 going to sleep for 11 seconds 00000100:00100000:3.0:1786015572.433451:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b29180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304472320:192.168.202.56@tcp:106: 00010000:00010000:3.0:1786015572.433511:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac472ba5/0xb1a5ef690c503d7d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9473 expref: 18 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.433556:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac472ba5/0xb1a5ef690c503d7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9473 expref: 18 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.433575:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd600, rc 0) 00000100:00100000:3.0:1786015572.433655:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280702208:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 9253us (9731us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015572.433667:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 458 00000100:00100000:0.0:1786015572.434489:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304472448:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015572.434515:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503d84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015572.439728:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.439809:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.439854:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280702720 00000100:00100000:2.0:1786015572.439869:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280702720 00000100:00100000:2.0:1786015572.439969:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280703104 00000100:00100000:2.0:1786015572.439973:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280703104 00000100:00100000:2.0:1786015572.439991:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 327 00000100:00100000:2.0:1786015572.440001:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+69:33483:x1872772280702720:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015572.440330:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+70:33483:x1872772280702720:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 330us (618us total) trans 4294968348 rc 0/0 00000100:00100000:2.0:1786015572.440339:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 327 00000100:00100000:2.0:1786015572.440359:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 328 00000100:00100000:2.0:1786015572.440366:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+69:33481:x1872772280703104:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015572.440454:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+70:33481:x1872772280703104:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 88us (645us total) trans 4294968349 rc 0/0 00000100:00100000:2.0:1786015572.440461:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 328 00000100:00100000:2.0:1786015572.440513:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.441066:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280702848 00000100:00100000:3.0:1786015572.441074:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280702848 00010000:00010000:3.0:1786015572.441123:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503d45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9465 expref: 70 pid: 5794 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015572.441167:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 466 00000100:00100000:3.0:1786015572.441177:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+70:2354:x1872772280702848:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015572.441192:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015572.441200:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503d45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9465 expref: 70 pid: 5794 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.441215:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503d45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9465 expref: 70 pid: 5794 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.441251:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503d45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9465 expref: 70 pid: 5794 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.441272:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8b7482d4bb00) 00010000:00010000:3.0:1786015572.441278:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503d84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.441290:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503d84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.441299:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503d84 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.441325:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015572.441352:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+69:2354:x1872772280702848:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 177us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015572.441360:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 466 00010000:00010000:0.0:1786015572.441493:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503d84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.441503:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503d84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.441712:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503d84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.441722:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503d84 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.441729:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503d84 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.441753:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.441758:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503d84 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.441791:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503d84 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.441808:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8b7482d4bb00) 00010000:00010000:0.0:1786015572.441812:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015572.441816:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503d84 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.441822:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503d84 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.442331:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+69:33482:x1872772280702464:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 17085us (17596us total) trans 4294968350 rc 0/0 00000100:00100000:0.0:1786015572.442342:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1598 00000040:00080000:0.0:1786015572.442494:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015572.442500:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015572.443631:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 8 00000040:00080000:0.0:1786015572.443649:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015572.448492:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.448695:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280703360 00000100:00100000:2.0:1786015572.448710:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280703360 00000100:00100000:2.0:1786015572.448837:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1599 00000100:00100000:2.0:1786015572.448851:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+113:33487:x1872772280703360:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:2.0:1786015572.449419:0:7673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].50, 136 off14992 00000100:00100000:2.0:1786015572.449546:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+113:33487:x1872772280703360:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 696us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015572.449556:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1599 00000100:00100000:3.0:1786015572.455613:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.456304:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280703616 00000100:00100000:2.0:1786015572.456320:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280703616 00000100:00100000:2.0:1786015572.456434:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 329 00000100:00100000:2.0:1786015572.456445:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916a1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+69:33482:x1872772280703616:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015572.458507:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916a1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+70:33482:x1872772280703616:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 2049us (2896us total) trans 4294968351 rc 0/0 00000100:00100000:2.0:1786015572.458523:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 329 00000100:00100000:1.0:1786015572.469262:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.469426:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280703744 00000100:00100000:3.0:1786015572.469440:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280703744 00000100:00100000:3.0:1786015572.469523:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1600 00000100:00100000:3.0:1786015572.469543:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+113:33488:x1872772280703744:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1786015572.469573:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015572.469604:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503d8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e947a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.469718:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503d92 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.469799:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503d92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.469814:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503d92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470320:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503d99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470333:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503d99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470342:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503d99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470438:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503d92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470446:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503d92 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470453:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503d92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470460:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015572.470464:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503d92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470472:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503d92 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470487:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015572.470490:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015572.470495:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503d92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470502:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503d92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470523:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503d99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470530:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503d99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470536:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503d99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470541:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015572.470544:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503d99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470550:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503d99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470557:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff8b7483ce2a00) 00010000:00010000:2.0:1786015572.470560:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015572.470563:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503d99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470568:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503d99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470615:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503d8b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e947a expref: 114 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470627:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015572.470630:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015572.470634:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503d8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e947a expref: 114 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.470646:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd600, rc 0) 00000100:00100000:2.0:1786015572.470785:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+113:33488:x1872772280703744:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1221us (1514us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015572.470794:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1600 00000100:00100000:3.0:1786015572.485233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.485422:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280703872 00000100:00100000:0.0:1786015572.485438:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280703872 00000100:00100000:0.0:1786015572.485523:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1601 00000100:00100000:0.0:1786015572.485543:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+70:33489:x1872772280703872:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:0.0:1786015572.485578:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015572.485609:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c503da0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9481 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.485706:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503da7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.485724:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503da7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.485803:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503da7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.485822:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503dae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.485830:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.485837:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.485956:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503da7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.485965:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503da7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.485973:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503da7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.485980:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481665400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.485987:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503da7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.485996:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503da7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.486011:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015572.486014:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.486020:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503da7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.486027:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503da7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.486043:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.486049:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503dae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.486055:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503dae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.486060:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481665000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.486063:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503dae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.486069:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503dae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.486076:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff8b749302f000) 00010000:00010000:0.0:1786015572.486078:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.486081:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503dae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.486087:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503dae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.486129:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c503da0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9481 expref: 71 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.486146:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015572.486148:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.486151:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c503da0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9481 expref: 71 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.486479:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481665600, rc 0) 00000100:00100000:3.0:1786015572.486902:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+70:33489:x1872772280703872:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1366us (1682us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015572.486913:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1601 00000100:00100000:3.0:1786015572.492211:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.492314:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280704000 00000100:00100000:1.0:1786015572.492329:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280704000 00000100:00100000:1.0:1786015572.492405:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1602 00000100:00100000:1.0:1786015572.492416:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+70:33489:x1872772280704000:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:1.0:1786015572.492445:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015572.492475:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503db5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9488 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.492571:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503dbc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.492590:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503dbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.492603:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503dbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.492624:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503dc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.492632:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.492638:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.492755:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503dbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.492807:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503dbc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.492815:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503dbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.492823:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015572.492828:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503dbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.492837:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503dbc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.492851:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015572.492854:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015572.492860:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503dbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.492866:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503dbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.492881:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.492888:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503dc3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.492894:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.492899:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015572.492902:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.492908:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503dc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.492914:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff8b748f194000) 00010000:00010000:1.0:1786015572.492917:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015572.493112:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503dc3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.493122:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503dc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.493169:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503db5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9488 expref: 71 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.493182:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015572.493185:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015572.493189:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503db5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9488 expref: 71 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.493200:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920a00, rc 0) 00000100:00100000:2.0:1786015572.493433:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+70:33489:x1872772280704000:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1016us (1237us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015572.493443:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1602 00000100:00100000:2.0:1786015572.510946:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.511065:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280704128 00000100:00100000:3.0:1786015572.511080:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280704128 00000100:00100000:3.0:1786015572.511181:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1603 00000100:00100000:3.0:1786015572.511194:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+70:33490:x1872772280704128:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015572.511223:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015572.511253:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503dca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e948f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511348:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503dd1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511366:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511383:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511398:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503dd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511404:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511410:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511494:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511501:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503dd1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511508:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511515:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015572.511520:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511529:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503dd1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511544:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015572.511546:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.511553:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503dd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511559:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503dd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511573:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511579:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503dd8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511585:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511589:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015572.511592:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511597:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503dd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511603:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff8b7483ce2d00) 00010000:00010000:3.0:1786015572.511606:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.511608:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503dd8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511614:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503dd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511655:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503dca lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e948f expref: 71 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511671:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015572.511673:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.511676:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503dca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e948f expref: 71 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.511686:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbdc00, rc 0) 00000100:00100000:3.0:1786015572.511814:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+70:33490:x1872772280704128:12345-192.168.202.56@tcp:101:cp.0 Request processed in 623us (894us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015572.511823:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1603 00000100:00100000:3.0:1786015572.517808:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.517973:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280704256 00000100:00100000:0.0:1786015572.517986:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280704256 00000100:00100000:0.0:1786015572.518064:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1604 00000100:00100000:0.0:1786015572.518074:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+70:33490:x1872772280704256:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015572.518102:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015572.518138:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c503ddf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9496 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518247:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503de6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518265:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518279:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518296:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503ded lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518303:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518314:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518397:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518405:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503de6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518413:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503de6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518420:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481665000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.518425:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503de6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518434:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503de6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518449:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015572.518453:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.518458:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503de6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518466:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503de6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518480:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518485:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503ded lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518492:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518497:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481665400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.518500:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518506:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503ded lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518513:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff8b749302f000) 00010000:00010000:0.0:1786015572.518516:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.518519:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503ded lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518524:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503ded lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518565:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c503ddf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9496 expref: 71 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518576:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015572.518580:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.518584:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c503ddf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9496 expref: 71 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.518594:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481665600, rc 0) 00000100:00100000:0.0:1786015572.518679:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+70:33490:x1872772280704256:12345-192.168.202.56@tcp:101:cp.0 Request processed in 605us (941us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015572.518690:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1604 00000100:00100000:3.0:1786015572.524820:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.524940:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280704512 00000100:00100000:0.0:1786015572.524953:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280704512 00000100:00100000:0.0:1786015572.525025:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1605 00000100:00100000:0.0:1786015572.525036:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+70:33490:x1872772280704512:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015572.525065:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015572.525093:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503df4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e949d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.525278:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503dfb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.525295:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503d6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e946c expref: 112 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.525305:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503dfb lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.525344:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503d6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e946c expref: 112 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.525359:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503d6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e946c expref: 112 pid: 7673 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.525375:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381304a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304472576:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015572.525482:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1786015572.530000:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.530176:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381304a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304472576:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015572.530214:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503dfb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015572.530419:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280704640 00000100:00100000:3.0:1786015572.530429:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280704640 00010000:00010000:3.0:1786015572.530480:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503d6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e946c expref: 113 pid: 7673 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015572.530525:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 467 00000100:00100000:3.0:1786015572.530537:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+113:2354:x1872772280704640:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015572.530559:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015572.530568:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503d6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e946c expref: 113 pid: 7673 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.530583:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503d6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e946c expref: 113 pid: 7673 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.530612:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7e00/0xb1a5ef690c503d6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e946c expref: 113 pid: 7673 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.530633:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015572.530638:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503dfb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.530648:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503dfb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.530657:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503dfb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.530691:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015572.530827:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+112:2354:x1872772280704640:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 291us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015572.530835:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 467 00010000:00010000:0.0:1786015572.531137:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503dfb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.531146:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503dfb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.531188:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c503e02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.531201:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c503e02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.531211:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c503e02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786015572.531975:0:5796:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x20:0x0], index 0: 0 00010000:00010000:0.0:1786015572.532213:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503e09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.532226:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503e09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.532235:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503e09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.532285:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503dfb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.532293:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503dfb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.532301:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503dfb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.532307:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481664a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.532312:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503dfb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.532321:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503dfb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.532334:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015572.532338:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.532342:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503dfb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.532350:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503dfb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015572.532367:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec03f14e reply state 000000001eaad83d transno 4294968352 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c503e02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.532378:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786015572.532424:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503df4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e949d expref: 73 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.532440:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503e09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e949d expref: 72 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.532448:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8b749302fe00) 00010000:00010000:0.0:1786015572.532451:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015572.532454:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481665400, rc 0) 00000100:00100000:0.0:1786015572.532528:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+73:33490:x1872772280704512:12345-192.168.202.56@tcp:101:cp.0 Request processed in 7493us (7774us total) trans 4294968352 rc 0/0 00000100:00100000:0.0:1786015572.532537:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1605 00010000:00010000:0.0:1786015572.538454:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c503e02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.538479:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c503e02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.538487:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c503e02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.538494:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481665600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.538500:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c503e02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.538509:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c503e02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.538534:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff8b749302f000) 00010000:00010000:0.0:1786015572.538538:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.538543:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c503e02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.538550:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665600/0xb1a5ef690c503e02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015572.539876:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.541321:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280704768 00000100:00100000:3.0:1786015572.541338:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280704768 00000100:00100000:2.0:1786015572.541512:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 459 00000100:00100000:2.0:1786015572.541524:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2351:x1872772280704768:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015572.541551:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015572.541582:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002287730d/0xb1a5ef690c503e17 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e94a4 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015572.541617:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786015572.541646:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=807s v=(0 0) 00010000:00010000:2.0:1786015572.541652:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015572.541663:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002287730d/0xb1a5ef690c503e17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94a4 expref: 16 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.541694:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002287730d/0xb1a5ef690c503e17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94a4 expref: 16 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.541717:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906800, rc 0) 00000100:00100000:2.0:1786015572.542564:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+16:2351:x1872772280704768:12345-192.168.202.56@tcp:101:cp.0 Request processed in 1037us (2693us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015572.542574:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 459 00000100:00100000:1.0:1786015572.545937:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.546015:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.546272:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280705024 00000100:00100000:0.0:1786015572.546289:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280705024 00000100:00100000:0.0:1786015572.546372:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 460 00000100:00100000:0.0:1786015572.546385:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2353:x1872772280705024:12345-192.168.202.56@tcp:16:kworker.0 00000100:00100000:0.0:1786015572.546558:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2353:x1872772280705024:12345-192.168.202.56@tcp:16:kworker.0 Request processed in 175us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.546567:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 460 00000100:00100000:3.0:1786015572.546794:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280704896 00000100:00100000:3.0:1786015572.546801:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280704896 00002000:00100000:3.0:1786015572.546850:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->157) req@ffff8b74aa5a6300 x1872772280704896/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:418/0 lens 648/0 e 0 to 0 dl 1786015583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015572.546862:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aa5a6300 with x1872772280704896 ext(0->157) 00002000:00010000:3.0:1786015572.546870:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74aa5a6300 00000100:00100000:3.0:1786015572.546899:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 131 00000100:00100000:3.0:1786015572.546907:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2354:x1872772280704896:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:3.0:1786015572.547504:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+17:2354:x1872772280704896:12345-192.168.202.56@tcp:4:cp.0 Request processed in 596us (1487us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1786015572.547516:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 131 00002000:00100000:3.0:1786015572.547525:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->157) req@ffff8b74aa5a6300 x1872772280704896/t4294967393(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:418/0 lens 648/448 e 0 to 0 dl 1786015583 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015572.547534:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aa5a6300 with x1872772280704896 ext(0->157) 00002000:00010000:3.0:1786015572.547539:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74aa5a6300 00000100:00100000:3.0:1786015572.551719:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.551940:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280705152 00000100:00100000:0.0:1786015572.551955:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280705152 00000100:00100000:0.0:1786015572.552031:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 461 00000100:00100000:0.0:1786015572.552044:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+16:33490:x1872772280705152:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015572.552069:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015572.552095:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d06a128/0xb1a5ef690c503e1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e94ab expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.552151:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002287730d/0xb1a5ef690c503e17 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94a4 expref: 17 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.552321:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015572.552326:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015572.552334:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d06a128/0xb1a5ef690c503e1e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94ab expref: 17 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.552381:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002287730d/0xb1a5ef690c503e17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94a4 expref: 17 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.552398:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002287730d/0xb1a5ef690c503e17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94a4 expref: 17 pid: 6591 timeout: 907 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.552422:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304472704:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015572.552533:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb180 going to sleep for 11 seconds 00000100:00100000:0.0:1786015572.555309:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304472704:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015572.555363:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d06a128/0xb1a5ef690c503e1e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94ab expref: 17 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.555396:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481665600, rc 0) 00000100:00100000:0.0:1786015572.555483:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+17:33490:x1872772280705152:12345-192.168.202.56@tcp:101:cp.0 Request processed in 3440us (3778us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.555493:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 461 00000100:00100000:2.0:1786015572.559663:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.559815:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280705280 00000100:00100000:0.0:1786015572.559827:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280705280 00010000:00010000:0.0:1786015572.559882:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002287730d/0xb1a5ef690c503e17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94a4 expref: 17 pid: 6591 timeout: 907 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.559937:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 468 00000100:00100000:0.0:1786015572.559946:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+17:2353:x1872772280705280:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015572.559968:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015572.559997:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002287730d/0xb1a5ef690c503e17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94a4 expref: 17 pid: 6591 timeout: 907 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.560012:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002287730d/0xb1a5ef690c503e17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94a4 expref: 17 pid: 6591 timeout: 907 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.560046:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002287730d/0xb1a5ef690c503e17 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94a4 expref: 17 pid: 6591 timeout: 907 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.560067:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015572.560072:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015572.560082:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d06a128/0xb1a5ef690c503e1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94ab expref: 16 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.560093:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d06a128/0xb1a5ef690c503e1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94ab expref: 16 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.560299:0:5780:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008d06a128/0xb1a5ef690c503e1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94ab expref: 16 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.560318:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381304a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5780:1872772304472832:192.168.202.56@tcp:105: 00000100:00100000:0.0:1786015572.560417:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb180 going to sleep for 11 seconds 00000100:00100000:0.0:1786015572.563909:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381304a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5780:1872772304472832:192.168.202.56@tcp:105: 00010000:00010000:0.0:1786015572.563961:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015572.564044:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+16:2353:x1872772280705280:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 4096us (4395us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.564058:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 468 00000100:00100000:2.0:1786015572.567041:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.567529:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280705536 00000100:00100000:1.0:1786015572.567543:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280705536 00000100:00100000:1.0:1786015572.567637:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 330 00000100:00100000:1.0:1786015572.567658:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+72:33490:x1872772280705536:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:1.0:1786015572.568451:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+73:33490:x1872772280705536:12345-192.168.202.56@tcp:35:cp.0 Request processed in 800us (1421us total) trans 4294968353 rc 0/0 00000100:00100000:1.0:1786015572.568463:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 330 00000100:00100000:2.0:1786015572.628545:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.628912:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280705664 00000100:00100000:3.0:1786015572.628939:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280705664 00000100:00100000:3.0:1786015572.629018:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1606 00000100:00100000:3.0:1786015572.629029:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+112:33493:x1872772280705664:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1786015572.629057:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015572.629090:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503e25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e94b2 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.629348:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503e2c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.629366:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503e2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.629380:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503e2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.629397:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.629404:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.629415:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.629546:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503e3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.629555:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503e3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.629562:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503e3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015572.629606:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x34:0x0]: returning size 158 00000004:00200000:3.0:1786015572.629612:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015572.629633:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503e3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.629647:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503e3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.629657:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503e2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.629662:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503e2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.629669:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503e2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.629675:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015572.629679:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503e2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.630375:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503e2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.630397:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015572.630401:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.630408:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503e2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.630414:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503e2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.630431:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.630437:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.630444:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.630449:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015572.630453:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.630459:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.630465:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff8b7483ce2d00) 00010000:00010000:3.0:1786015572.630468:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.630471:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.630480:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.630536:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503e25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94b2 expref: 114 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.630553:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503e3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94b2 expref: 113 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.630562:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8b749302fe00) 00010000:00010000:3.0:1786015572.630564:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786015572.630567:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbdc00, rc 0) 00000100:00100000:2.0:1786015572.640835:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+113:33493:x1872772280705664:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 11790us (12288us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015572.640852:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1606 00000100:00100000:3.0:1786015572.646169:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.646321:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280705792 00000100:00100000:0.0:1786015572.646335:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280705792 00000100:00100000:0.0:1786015572.646414:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 462 00000100:00100000:0.0:1786015572.646426:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280705792:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015572.646453:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015572.646478:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000833b015b/0xb1a5ef690c503e41 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e94b9 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.646562:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304472960:192.168.202.56@tcp:106: 00000100:00100000:0.0:1786015572.646672:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb180 going to sleep for 11 seconds 00000100:00100000:1.0:1786015572.650621:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.650856:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280705920 00000100:00100000:0.0:1786015572.650873:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280705920 00000100:00100000:0.0:1786015572.650971:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 83 00000100:00100000:0.0:1786015572.650985:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748736a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:41677fca-39fb-471c-b582-96bce6540a36+113:2354:x1872772280705920:12345-192.168.202.56@tcp:63:ll_sa.0 00010000:00010000:0.0:1786015572.651064:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015572.651090:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503e48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e94c0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651373:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503e4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651392:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503e4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651405:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503e4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651423:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c503e56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651430:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c503e56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651440:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c503e56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651526:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503e4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651535:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503e4f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651542:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503e4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651548:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481665000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.651553:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503e4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651561:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503e4f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651573:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015572.651576:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.651581:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503e4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651587:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503e4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651603:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c503e56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651609:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c503e56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651615:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c503e56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651621:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481665200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.651623:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c503e56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651629:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c503e56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651636:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff8b749302f000) 00010000:00010000:0.0:1786015572.651638:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.651641:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c503e56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651658:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c503e56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651698:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503e48 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94c0 expref: 114 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651710:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015572.651713:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786015572.651717:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503e48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94c0 expref: 114 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.651726:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481664a00, rc -2) 00000100:00100000:3.0:1786015572.652666:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304473216:0@lo:400:kworker.0 00000100:00100000:3.0:1786015572.652807:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015572.652871:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304473728:0@lo:400:kworker.0 00000100:00100000:3.0:1786015572.652902:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015572.652949:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786015572.652956:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304473088:0@lo:400:kworker.0 00000100:00100000:3.0:1786015572.652991:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015572.653022:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304473600:0@lo:400:kworker.0 00000100:00100000:3.0:1786015572.653044:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015572.653074:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304473344:0@lo:400:kworker.0 00000100:00100000:3.0:1786015572.653098:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015572.653469:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015572.653477:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304473472:0@lo:400:kworker.0 00000100:00100000:3.0:1786015572.653505:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015572.653669:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304473216 00000100:00100000:1.0:1786015572.653679:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304473216 00000100:00100000:1.0:1786015572.653754:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304473600 00000100:00100000:1.0:1786015572.653758:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304473600 00000100:00100000:1.0:1786015572.653805:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304473344 00000100:00100000:1.0:1786015572.653808:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304473344 00000100:00100000:1.0:1786015572.653825:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:1.0:1786015572.653834:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304473216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015572.655542:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304473088 00000100:00100000:2.0:1786015572.655560:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304473088 00000100:00100000:2.0:1786015572.655630:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:2.0:1786015572.655640:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304473088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015572.656104:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1786015572.656128:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304473600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015572.657246:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748736a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:41677fca-39fb-471c-b582-96bce6540a36+113:2354:x1872772280705920:12345-192.168.202.56@tcp:63:ll_sa.0 Request processed in 6253us (6630us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786015572.657266:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 83 00000100:00100000:0.0:1786015572.657475:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304473728 00000100:00100000:0.0:1786015572.657485:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304473728 00000100:00100000:0.0:1786015572.657541:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304473472 00000100:00100000:0.0:1786015572.657545:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304473472 00000100:00100000:0.0:1786015572.657568:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:0.0:1786015572.657576:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304473728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015572.658373:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304473216:12345-0@lo:400:kworker.0 Request processed in 4535us (5560us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015572.658385:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:1.0:1786015572.658412:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1786015572.658422:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304473344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015572.658484:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304473344:12345-0@lo:400:kworker.0 Request processed in 65us (5385us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015572.658490:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1786015572.658517:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:1.0:1786015572.658526:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304473472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015572.658560:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304473472:12345-0@lo:400:kworker.0 Request processed in 36us (5054us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015572.658565:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:1.0:1786015572.658621:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304473472:0@lo:400:kworker.0 00000100:00100000:1.0:1786015572.658636:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304473344:0@lo:400:kworker.0 00000100:00080000:1.0:1786015572.659035:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015572.659043:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00010000:1.0:1786015572.659439:0:6590:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x20:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1786015572.659444:0:6590:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x20:0x0] updating lvb mtime: 0 -> 1786015572 00002000:00010000:1.0:1786015572.659447:0:6590:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x20:0x0] updating lvb atime: 0 -> 1786015572 00002000:00010000:1.0:1786015572.659450:0:6590:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x20:0x0] updating lvb ctime: 0 -> 1786015572 00000100:00100000:1.0:1786015572.659478:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304472960:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015572.659516:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000833b015b/0xb1a5ef690c503e41 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94b9 expref: 17 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.659546:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000833b015b/0xb1a5ef690c503e41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94b9 expref: 17 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.659562:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481664c00, rc 0) 00000100:00100000:1.0:1786015572.659614:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280705792:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 13190us (13459us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015572.659623:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 462 00000100:00100000:2.0:1786015572.665281:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304473088:12345-0@lo:400:kworker.0 Request processed in 9626us (12272us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015572.665303:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:2.0:1786015572.665466:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304473088:0@lo:400:kworker.0 00000100:00100000:1.0:1786015572.665797:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.665845:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280706048 00000100:00100000:1.0:1786015572.665854:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280706048 00000100:00100000:1.0:1786015572.665910:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1607 00000100:00100000:1.0:1786015572.665929:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+113:33493:x1872772280706048:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015572.665959:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015572.665990:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503e5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e94f8 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.666082:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503e64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.666098:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503e64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.667811:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503e64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015572.668069:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 7680 00000004:00200000:1.0:1786015572.668075:0:12526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 7 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015572.668576:0:12526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503e64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.668635:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503e5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94f8 expref: 115 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.670327:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503e64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94f8 expref: 114 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.670347:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015572.670351:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015572.670357:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920a00, rc 0) 00000100:00100000:1.0:1786015572.670483:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+114:33493:x1872772280706048:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 4562us (4686us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015572.670495:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1607 00000100:00100000:3.0:1786015572.675342:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304473600:12345-0@lo:400:kworker.0 Request processed in 17699us (20776us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015572.675366:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:2.0:1786015572.675606:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304473600:0@lo:400:kworker.0 00000100:00100000:2.0:1786015572.675629:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304473216:0@lo:400:kworker.0 00000100:00100000:3.0:1786015572.678898:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.679365:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280706176 00000100:00100000:1.0:1786015572.679379:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280706176 00000100:00100000:1.0:1786015572.679445:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 463 00000100:00100000:1.0:1786015572.679456:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280706176:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015572.679482:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015572.679504:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001933ae34/0xb1a5ef690c503e6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e94ff expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015572.679584:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304473856:192.168.202.56@tcp:106: 00000100:00100000:1.0:1786015572.679715:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359900 going to sleep for 11 seconds 00000100:00100000:0.0:1786015572.683328:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304473728:12345-0@lo:400:kworker.0 Request processed in 25736us (30407us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.683351:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:2.0:1786015572.683615:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304473728:0@lo:400:kworker.0 00000100:00100000:3.0:1786015572.691411:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304473856:192.168.202.56@tcp:106: 00010000:00010000:3.0:1786015572.691465:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001933ae34/0xb1a5ef690c503e6b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94ff expref: 17 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.691498:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001933ae34/0xb1a5ef690c503e6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94ff expref: 17 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.691512:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921a00, rc 0) 00000100:00100000:3.0:1786015572.691593:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280706176:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 12138us (12710us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015572.691605:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 463 00000100:00100000:1.0:1786015572.714271:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.717306:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280706432 00000100:00100000:2.0:1786015572.717330:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280706432 00000100:00100000:2.0:1786015572.717425:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1608 00000100:00100000:2.0:1786015572.717436:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+114:33493:x1872772280706432:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:3.0:1786015572.726613:0:7673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].51, 136 off15128 00000100:00100000:3.0:1786015572.727270:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+114:33493:x1872772280706432:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 9827us (13005us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015572.727286:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1608 00000100:00100000:2.0:1786015572.773085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.773320:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.774184:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280706688 00000100:00100000:3.0:1786015572.774202:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280706688 00000100:00100000:3.0:1786015572.774278:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 84 00000100:00100000:3.0:1786015572.774291:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:41677fca-39fb-471c-b582-96bce6540a36+114:2353:x1872772280706688:12345-192.168.202.56@tcp:63:ll_sa.0 00010000:00010000:3.0:1786015572.774348:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015572.774374:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503e72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e950d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.774450:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e79 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.774469:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.774484:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015572.778354:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280706560 00000100:00100000:1.0:1786015572.778384:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280706560 00000100:00100000:1.0:1786015572.778489:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1609 00000100:00100000:1.0:1786015572.778502:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+116:33496:x1872772280706560:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1786015572.778538:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015572.778571:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503e80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9506 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.778668:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c503e87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.778685:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c503e87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.778699:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c503e87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.778717:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503e8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.778724:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503e8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.778731:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503e8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.778877:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c503e87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.778885:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c503e87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.778891:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c503e87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.778898:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015572.778903:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c503e87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.778916:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c503e87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.778999:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015572.779003:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015572.779009:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c503e87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.779016:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c503e87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.779032:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503e8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.779038:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503e8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.779044:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503e8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.779049:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015572.779051:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503e8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.779058:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503e8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.779065:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff8b748f194000) 00010000:00010000:1.0:1786015572.779067:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015572.779071:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503e8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.779078:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503e8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.779128:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503e80 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9506 expref: 117 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.779141:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015572.779143:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015572.779147:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503e80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9506 expref: 117 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.779597:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920e00, rc 0) 00000100:00100000:0.0:1786015572.780324:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+116:33496:x1872772280706560:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1819us (7247us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015572.780337:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1609 00010000:00010000:0.0:1786015572.782962:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503e95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.782990:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503e95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.783004:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503e95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.783087:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.783105:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e79 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.783112:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.783125:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.783129:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.783136:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.783148:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015572.783151:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.783155:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.783160:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503e79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.783174:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503e95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.783180:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503e95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.783186:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503e95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.783190:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481664a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.783193:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503e95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.783198:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503e95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.783208:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x71bff0c5 (ffff8b749302f000) 00010000:00010000:0.0:1786015572.783210:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.783213:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503e95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.783218:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503e95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.783265:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503e72 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e950d expref: 115 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.783275:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015572.783277:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786015572.783281:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503e72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e950d expref: 115 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.783290:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbce00, rc -2) 00000100:00100000:0.0:1786015572.783381:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:41677fca-39fb-471c-b582-96bce6540a36+114:2353:x1872772280706688:12345-192.168.202.56@tcp:63:ll_sa.0 Request processed in 9091us (10069us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786015572.783391:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 84 00000100:00100000:2.0:1786015572.802140:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.803167:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280706816 00000100:00100000:3.0:1786015572.803181:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280706816 00000100:00100000:3.0:1786015572.803257:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1610 00000100:00100000:3.0:1786015572.803269:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+73:33497:x1872772280706816:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015572.803297:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015572.803319:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503e9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9514 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803394:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ea3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803408:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803420:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803440:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803446:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803467:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803537:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803545:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ea3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803551:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803556:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015572.803560:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803566:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ea3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803578:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015572.803580:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.803585:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ea3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803591:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ea3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803604:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803609:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803615:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803620:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015572.803623:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803629:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803635:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff8b7483ce2d00) 00010000:00010000:3.0:1786015572.803637:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.803640:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803645:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803688:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503e9c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9514 expref: 74 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803698:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015572.803700:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.803704:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503e9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9514 expref: 74 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.803713:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbde00, rc 0) 00000100:00100000:0.0:1786015572.804348:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+73:33497:x1872772280706816:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1077us (2223us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015572.804357:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1610 00000100:00100000:2.0:1786015572.812209:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.816318:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280706944 00000100:00100000:3.0:1786015572.816333:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280706944 00000100:00100000:3.0:1786015572.816424:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1611 00000100:00100000:3.0:1786015572.816434:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+73:33497:x1872772280706944:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015572.816457:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015572.816492:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503eb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e951b expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816562:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eb8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816577:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816588:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816602:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ebf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816610:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816616:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816687:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816695:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eb8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816702:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816709:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015572.816713:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816721:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eb8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816732:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015572.816735:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.816755:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816795:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503eb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816808:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816814:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ebf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816820:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ebf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816824:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbd600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015572.816828:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ebf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816833:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ebf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816840:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff8b7483ce2d00) 00010000:00010000:3.0:1786015572.816842:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.816844:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ebf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816850:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503ebf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816884:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503eb1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e951b expref: 74 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816895:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015572.816897:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.816900:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503eb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e951b expref: 74 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.816910:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbde00, rc 0) 00000100:00100000:3.0:1786015572.816980:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+73:33497:x1872772280706944:12345-192.168.202.56@tcp:101:rm.0 Request processed in 548us (4788us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015572.816988:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1611 00010000:00010000:2.0:1786015572.844029:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015572.852398:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.852592:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280707072 00000100:00100000:0.0:1786015572.852602:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280707072 00000100:00100000:0.0:1786015572.852682:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1612 00000100:00100000:0.0:1786015572.852692:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+73:33498:x1872772280707072:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015572.852713:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015572.852747:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c503ec6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9522 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.852866:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503ecd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.852882:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503ecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.852893:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503ecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.852914:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503ed4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.852922:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.852929:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.853010:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503ecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.853018:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503ecd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.853025:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503ecd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.853031:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481665000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.853036:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503ecd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.853044:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503ecd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.853056:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015572.853060:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.853065:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503ecd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.853071:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503ecd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.853086:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.853109:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503ed4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.853280:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.853287:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481664a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.853291:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.853297:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.853308:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff8b749302f000) 00010000:00010000:0.0:1786015572.853311:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.853314:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503ed4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.853319:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503ed4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.853366:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c503ec6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9522 expref: 74 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.853377:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015572.853379:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.853382:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c503ec6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9522 expref: 74 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.853391:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481665200, rc 0) 00000100:00100000:0.0:1786015572.853636:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+73:33498:x1872772280707072:12345-192.168.202.56@tcp:101:cp.0 Request processed in 944us (1246us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015572.853645:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1612 00000100:00100000:0.0:1786015572.865002:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015572.865331:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280707200 00000100:00100000:3.0:1786015572.865346:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280707200 00000100:00100000:3.0:1786015572.865430:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1613 00000100:00100000:3.0:1786015572.865442:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+73:33498:x1872772280707200:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015572.865471:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015572.865501:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503edb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9529 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.865608:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ee2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.865627:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.865642:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.865660:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ee9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.865667:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.865675:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.868648:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.868673:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ee2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.869310:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.869323:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015572.869329:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.869339:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ee2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.869363:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015572.869367:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015572.869373:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ee2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.869379:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ee2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.869402:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.869407:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ee9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.869412:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.869416:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015572.869419:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.869424:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ee9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.869431:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff8b7483ce2d00) 00010000:00010000:2.0:1786015572.869433:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015572.869435:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ee9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.869440:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ee9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.869506:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503edb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9529 expref: 74 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.869529:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015572.869534:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015572.869538:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503edb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9529 expref: 74 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.869549:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd600, rc 0) 00000100:00100000:2.0:1786015572.869657:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+73:33498:x1872772280707200:12345-192.168.202.56@tcp:101:cp.0 Request processed in 4215us (4670us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015572.869668:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1613 00000100:00100000:2.0:1786015572.876523:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.876627:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280707456 00000100:00100000:1.0:1786015572.876640:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280707456 00000100:00100000:1.0:1786015572.876719:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1614 00000100:00100000:1.0:1786015572.876748:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+73:33498:x1872772280707456:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015572.876806:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015572.876835:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503ef0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9530 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.877229:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503ef7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.877249:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503e64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94f8 expref: 113 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.877259:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503ef7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.877304:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503e64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94f8 expref: 113 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.877320:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503e64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94f8 expref: 113 pid: 12526 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015572.877337:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304473984:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015572.877450:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359180 going to sleep for 11 seconds 00000100:00100000:2.0:1786015572.885402:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304473984:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015572.885446:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503ef7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015572.891820:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.891994:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280707584 00000100:00100000:1.0:1786015572.892008:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280707584 00010000:00010000:1.0:1786015572.892066:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503e64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94f8 expref: 114 pid: 12526 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015572.892127:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 469 00000100:00100000:1.0:1786015572.892139:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+114:2353:x1872772280707584:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015572.892370:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015572.892382:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503e64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94f8 expref: 114 pid: 12526 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.892398:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503e64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94f8 expref: 114 pid: 12526 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.892427:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c503e64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94f8 expref: 114 pid: 12526 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.892449:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015572.892455:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503ef7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.892468:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503ef7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.892478:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503ef7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.893374:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015572.893461:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41677fca-39fb-471c-b582-96bce6540a36+113:2353:x1872772280707584:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1321us (1653us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015572.893473:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 469 00010000:00010000:2.0:1786015572.893851:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503ef7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.893862:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503ef7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.893896:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503efe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.893910:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503efe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.893930:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503efe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786015572.899429:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23:0x0], index 1: 0 00010000:00010000:2.0:1786015572.900373:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c503f05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.900398:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c503f05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.900412:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c503f05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.900462:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503ef7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.900469:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503ef7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.900476:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503ef7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.900483:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015572.900488:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503ef7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.900496:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503ef7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.900509:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015572.900512:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015572.900518:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503ef7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.900525:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c503ef7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786015572.900542:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000019c6357f reply state 0000000075e182d8 transno 4294968354 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503efe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015572.900554:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786015572.900607:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920e00/0xb1a5ef690c503ef0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9530 expref: 76 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.900624:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c503f05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9530 expref: 75 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.900632:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8b7487f06500) 00010000:00010000:2.0:1786015572.900634:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015572.900637:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906800, rc 0) 00000100:00100000:2.0:1786015572.900789:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+76:33498:x1872772280707456:12345-192.168.202.56@tcp:101:cp.0 Request processed in 24058us (24281us total) trans 4294968354 rc 0/0 00000100:00100000:2.0:1786015572.900800:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1614 00010000:00010000:3.0:1786015572.907358:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503efe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.907382:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503efe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.907391:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503efe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.907398:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015572.907406:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503efe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.907414:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503efe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.907437:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff8b7487f06400) 00010000:00010000:3.0:1786015572.907442:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015572.907449:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503efe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015572.907456:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503efe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015572.917589:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.918241:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280707712 00000100:00100000:1.0:1786015572.918255:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280707712 00000100:00100000:1.0:1786015572.918342:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 464 00000100:00100000:1.0:1786015572.918355:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+17:2352:x1872772280707712:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015572.918378:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015572.918408:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c503f13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9537 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015572.918442:0:11384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786015572.918468:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=808s v=(0 0) 00010000:00010000:1.0:1786015572.918473:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015572.918484:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c503f13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9537 expref: 18 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.918505:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c503f13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9537 expref: 18 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.918536:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920a00, rc 0) 00000100:00100000:1.0:1786015572.918753:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+18:2352:x1872772280707712:12345-192.168.202.56@tcp:101:cp.0 Request processed in 399us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015572.918807:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 464 00000100:00100000:2.0:1786015572.925476:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015572.925711:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280707840 00000100:00100000:0.0:1786015572.925724:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280707840 00000100:00100000:0.0:1786015572.926013:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 85 00000100:00100000:0.0:1786015572.926026:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+75:2354:x1872772280707840:12345-192.168.202.56@tcp:63:ll_sa.0 00010000:00010000:0.0:1786015572.926122:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015572.926151:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c503f1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e953e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.926358:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503f21 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.926380:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503f21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.926395:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503f21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927010:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503f28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927033:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927047:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927134:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503f21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927142:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503f21 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927150:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503f21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927156:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481664a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.927160:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503f21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927167:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503f21 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927180:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015572.927184:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.927188:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503f21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927193:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503f21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927208:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927214:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503f28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927220:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503f28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927224:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481665000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015572.927227:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503f28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927233:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503f28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927240:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8b749302f000) 00010000:00010000:0.0:1786015572.927243:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015572.927246:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503f28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927251:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503f28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927297:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c503f1a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e953e expref: 76 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927309:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015572.927311:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786015572.927314:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c503f1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e953e expref: 76 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.927324:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481665200, rc -2) 00000100:00100000:0.0:1786015572.927426:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+75:2354:x1872772280707840:12345-192.168.202.56@tcp:63:ll_sa.0 Request processed in 1401us (1963us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786015572.927437:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 85 00000100:00100000:2.0:1786015572.942519:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.942623:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280707968 00000100:00100000:1.0:1786015572.942638:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280707968 00000100:00100000:1.0:1786015572.942715:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 465 00000100:00100000:1.0:1786015572.942744:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+18:33498:x1872772280707968:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015572.942816:0:22346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015572.942843:0:22346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503f2f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9576 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.942891:0:22346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c503f13 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9537 expref: 19 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015572.942902:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015572.942907:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015572.942913:0:22346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503f2f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9576 expref: 19 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.943094:0:22346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c503f13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9537 expref: 19 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.943131:0:22346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c503f13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9537 expref: 19 pid: 11384 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.943150:0:22346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22346:1872772304474112:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015572.943272:0:22346:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786015572.964384:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015572.970170:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280708096 00000100:00100000:2.0:1786015572.970197:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280708096 00010000:00010000:2.0:1786015572.970267:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c503f13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9537 expref: 20 pid: 11384 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015572.970333:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 470 00000100:00100000:2.0:1786015572.970346:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+20:2353:x1872772280708096:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015572.970369:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015572.970399:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c503f13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9537 expref: 20 pid: 11384 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.970423:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c503f13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9537 expref: 20 pid: 11384 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.970458:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015572.970464:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015572.970474:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503f2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9576 expref: 20 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.970487:0:17038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503f2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9576 expref: 20 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015572.970540:0:17038:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503f2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9576 expref: 20 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015572.970556:0:17038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1222680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17038:1872772304474240:192.168.202.56@tcp:105: 00000100:00100000:2.0:1786015572.970681:0:17038:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786015572.976020:0:17038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1222680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17038:1872772304474240:192.168.202.56@tcp:105: 00010000:00010000:2.0:1786015572.976060:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015572.976712:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+20:2353:x1872772280708096:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 6365us (12338us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015572.976726:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 470 00010000:00010000:0.0:1786015572.979178:0:22346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c503f13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9537 expref: 19 pid: 11384 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015572.979226:0:22346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22346:1872772304474112:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015572.979281:0:22346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503f2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9576 expref: 18 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015572.979304:0:22346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921600, rc 0) 00000100:00100000:0.0:1786015572.979401:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+18:33498:x1872772280707968:12345-192.168.202.56@tcp:101:cp.0 Request processed in 36676us (36897us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015572.979411:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 465 00000100:00100000:3.0:1786015572.999432:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015572.999864:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280708352 00000100:00100000:1.0:1786015572.999878:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280708352 00000100:00100000:1.0:1786015572.999988:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 331 00000100:00100000:1.0:1786015573.000000:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+75:33498:x1872772280708352:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:1.0:1786015573.000488:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+76:33498:x1872772280708352:12345-192.168.202.56@tcp:35:cp.0 Request processed in 489us (1070us total) trans 4294968355 rc 0/0 00000100:00100000:1.0:1786015573.000497:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 331 00000100:00100000:3.0:1786015573.041542:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.042211:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280708480 00000100:00100000:1.0:1786015573.042228:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280708480 00000100:00100000:1.0:1786015573.042308:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 86 00000100:00100000:1.0:1786015573.042320:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+76:2354:x1872772280708480:12345-192.168.202.56@tcp:63:ll_sa.0 00010000:00010000:1.0:1786015573.042409:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015573.042437:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c503f36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e957d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042515:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c503f3d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042532:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c503f3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042545:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c503f3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042561:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c503f44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042568:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c503f44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042575:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c503f44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042662:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c503f3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042671:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c503f3d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042677:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c503f3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042696:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015573.042701:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c503f3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042709:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c503f3d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042723:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015573.042727:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015573.042742:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c503f3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042749:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c503f3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042807:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c503f44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042814:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c503f44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042820:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c503f44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042835:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015573.042839:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c503f44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042845:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c503f44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042853:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8b748f194a00) 00010000:00010000:1.0:1786015573.042856:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015573.042858:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c503f44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042864:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c503f44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042902:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c503f36 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e957d expref: 77 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.042913:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015573.043374:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786015573.043381:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c503f36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e957d expref: 77 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.043395:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921200, rc -2) 00000100:00100000:0.0:1786015573.061050:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+76:2354:x1872772280708480:12345-192.168.202.56@tcp:63:ll_sa.0 Request processed in 18712us (19504us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786015573.061069:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 86 00000100:00100000:3.0:1786015573.088543:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.088932:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280708608 00000100:00100000:2.0:1786015573.088947:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280708608 00000100:00100000:2.0:1786015573.089025:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1615 00000100:00100000:2.0:1786015573.089037:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+113:33505:x1872772280708608:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015573.089068:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.089110:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c503f4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e95b5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089213:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f52 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089233:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089247:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089265:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c503f59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089272:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c503f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089279:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c503f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089414:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c503f60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089423:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c503f60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089431:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c503f60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015573.089480:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x35:0x0]: returning size 158 00000004:00200000:2.0:1786015573.089485:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015573.089508:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c503f60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089522:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c503f60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089532:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089538:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f52 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089545:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089551:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015573.089555:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089563:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089577:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015573.089581:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.089587:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089594:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089613:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c503f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089618:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c503f59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089623:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c503f59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089628:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015573.089631:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c503f59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089637:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c503f59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089644:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff8b7487f06400) 00010000:00010000:2.0:1786015573.089646:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.089649:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c503f59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.089655:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c503f59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.090291:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c503f4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95b5 expref: 115 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.090315:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c503f60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95b5 expref: 114 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.090327:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8b7487f06500) 00010000:00010000:2.0:1786015573.090330:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015573.090333:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47000, rc 0) 00000100:00100000:2.0:1786015573.090426:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+114:33505:x1872772280708608:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1390us (1896us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015573.090435:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1615 00000100:00100000:3.0:1786015573.100667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.103455:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280708736 00000100:00100000:0.0:1786015573.103477:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280708736 00000100:00100000:2.0:1786015573.104026:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 466 00000100:00100000:2.0:1786015573.104039:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280708736:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015573.104063:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.104089:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbe0f01d/0xb1a5ef690c503f67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e95bc expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015573.104177:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1222680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304474368:192.168.202.56@tcp:106: 00000100:00100000:2.0:1786015573.104306:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb4e40 going to sleep for 11 seconds 00002000:00010000:2.0:1786015573.107059:0:6592:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1786015573.107073:0:6592:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime: 0 -> 1786015573 00002000:00010000:2.0:1786015573.107076:0:6592:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime: 0 -> 1786015573 00002000:00010000:2.0:1786015573.107078:0:6592:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime: 0 -> 1786015573 00000100:00100000:2.0:1786015573.107183:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1222680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304474368:192.168.202.56@tcp:106: 00010000:00010000:2.0:1786015573.107232:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bbe0f01d/0xb1a5ef690c503f67 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95bc expref: 18 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.107264:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbe0f01d/0xb1a5ef690c503f67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95bc expref: 18 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.107288:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47c00, rc 0) 00000100:00100000:2.0:1786015573.107436:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280708736:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3399us (6782us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015573.107448:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 466 00000100:00100000:3.0:1786015573.116654:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.117390:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280708864 00000100:00100000:2.0:1786015573.117406:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280708864 00000100:00100000:2.0:1786015573.117482:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1616 00000100:00100000:2.0:1786015573.117495:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+114:33505:x1872772280708864:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015573.117593:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.117623:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c503f6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e95c3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.118440:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503f75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.118463:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.119288:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786015573.119387:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 7680 00000004:00200000:3.0:1786015573.119393:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 8 stripe count 1 MDT count 1 00000004:00010000:3.0:1786015573.119424:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.119481:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c503f6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95c3 expref: 116 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.119517:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503f75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95c3 expref: 115 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.119528:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015573.119532:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786015573.119537:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd600, rc 0) 00000100:00100000:3.0:1786015573.119643:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+115:33505:x1872772280708864:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 2149us (3003us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015573.119655:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1616 00000100:00100000:0.0:1786015573.126081:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.126347:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280708992 00000100:00100000:1.0:1786015573.126361:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280708992 00000100:00100000:1.0:1786015573.126434:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 467 00000100:00100000:1.0:1786015573.126446:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280708992:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015573.126483:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015573.126515:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006703c5f5/0xb1a5ef690c503f7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e95ca expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015573.126604:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304474496:192.168.202.56@tcp:106: 00000100:00100000:1.0:1786015573.126724:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c13593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015573.131697:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304474496:192.168.202.56@tcp:106: 00010000:00010000:0.0:1786015573.131807:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006703c5f5/0xb1a5ef690c503f7c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95ca expref: 18 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.131852:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006703c5f5/0xb1a5ef690c503f7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95ca expref: 18 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.131867:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921200, rc 0) 00000100:00100000:0.0:1786015573.131965:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280708992:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 5518us (5897us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015573.131975:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 467 00000100:00100000:3.0:1786015573.139483:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.140034:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280709248 00000100:00100000:2.0:1786015573.140048:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280709248 00000100:00100000:2.0:1786015573.140137:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1617 00000100:00100000:2.0:1786015573.140148:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+115:33505:x1872772280709248:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:2.0:1786015573.141307:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].52, 136 off15264 00000100:00100000:2.0:1786015573.141442:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+115:33505:x1872772280709248:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 1290us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015573.141453:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1617 00000100:00100000:3.0:1786015573.154239:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.154413:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280709376 00000100:00100000:2.0:1786015573.154428:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280709376 00000100:00100000:2.0:1786015573.154515:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1618 00000100:00100000:2.0:1786015573.154529:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+115:33506:x1872772280709376:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1786015573.154562:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.154592:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c503f83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e95d1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155219:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c503f8a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155239:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c503f8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155253:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c503f8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155271:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c503f91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155278:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c503f91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155285:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c503f91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155372:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c503f8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155381:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c503f8a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155388:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c503f8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155395:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015573.155400:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c503f8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155409:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c503f8a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155423:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015573.155426:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.155432:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c503f8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155439:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c503f8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155454:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c503f91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155460:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c503f91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155467:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c503f91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155472:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015573.155475:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c503f91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155481:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c503f91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155488:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8b7487f06400) 00010000:00010000:2.0:1786015573.155491:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.155494:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c503f91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155500:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c503f91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155655:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c503f83 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95d1 expref: 116 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.155667:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015573.155670:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.155674:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c503f83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95d1 expref: 116 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.156260:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47c00, rc 0) 00000100:00100000:3.0:1786015573.157392:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+115:33506:x1872772280709376:12345-192.168.202.56@tcp:101:bash.0 Request processed in 2855us (3157us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015573.157404:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1618 00000100:00100000:1.0:1786015573.169339:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786015573.169372:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304474624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015573.169468:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015573.169537:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304474624 00000100:00100000:1.0:1786015573.169547:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304474624 00000100:00100000:1.0:1786015573.169611:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1786015573.169621:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304474624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015573.169669:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 3407872 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015573.169722:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304474624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015573.169748:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1786015573.169838:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304474624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015573.174627:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.174881:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280709504 00000100:00100000:2.0:1786015573.174898:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280709504 00000100:00100000:2.0:1786015573.174987:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1619 00000100:00100000:2.0:1786015573.174999:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+76:33507:x1872772280709504:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1786015573.175028:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.175064:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c503f98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e95d8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175346:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175364:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175378:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175399:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c503fa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175406:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c503fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175412:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c503fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175501:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175509:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175517:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175525:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015573.175530:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175538:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175553:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015573.175556:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.175561:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175568:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c503f9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175584:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c503fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175590:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c503fa6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175596:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c503fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175601:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819bb800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015573.175603:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c503fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175609:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c503fa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175616:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8b7487f06900) 00010000:00010000:2.0:1786015573.175618:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.175620:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c503fa6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175625:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c503fa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175667:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c503f98 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95d8 expref: 77 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175678:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015573.175680:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.175684:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c503f98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95d8 expref: 77 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.175694:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906000, rc 0) 00000100:00100000:2.0:1786015573.176199:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+76:33507:x1872772280709504:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1199us (1584us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015573.176209:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1619 00000100:00100000:3.0:1786015573.179238:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.179403:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280709632 00000100:00100000:0.0:1786015573.179416:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280709632 00000100:00100000:0.0:1786015573.179487:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 87 00000100:00100000:0.0:1786015573.179499:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+76:2351:x1872772280709632:12345-192.168.202.56@tcp:63:ll_sa.0 00010000:00010000:0.0:1786015573.179545:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015573.179573:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503fad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e95df expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.179648:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503fb4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.179665:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503fb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.179677:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503fb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.179694:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503fbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.179701:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503fbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.179709:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503fbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.179850:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503fb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.179857:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503fb4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.179864:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503fb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.179874:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481664c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015573.179880:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503fb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.179888:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503fb4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.179903:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015573.179906:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015573.179911:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503fb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.180089:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c503fb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.180175:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503fbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.180183:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503fbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.180190:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503fbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.180195:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481665000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015573.180199:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503fbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.180206:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503fbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.180220:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x21330256 (ffff8b749302f000) 00010000:00010000:0.0:1786015573.180222:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015573.180225:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503fbb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.180232:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c503fbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.180271:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503fad lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95df expref: 77 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.180283:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015573.180286:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786015573.180290:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c503fad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95df expref: 77 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.180300:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481664a00, rc -2) 00000100:00100000:0.0:1786015573.180386:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+76:2351:x1872772280709632:12345-192.168.202.56@tcp:63:ll_sa.0 Request processed in 889us (1161us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786015573.180396:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 87 00000100:00100000:0.0:1786015573.186620:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015573.188060:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280709760 00000100:00100000:3.0:1786015573.188082:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280709760 00000100:00100000:3.0:1786015573.190731:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1620 00000100:00100000:3.0:1786015573.190799:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+76:33507:x1872772280709760:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1786015573.190830:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015573.190861:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503fc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e95e6 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015573.192389:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.193354:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280709888 00000100:00100000:2.0:1786015573.193369:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280709888 00000100:00100000:2.0:1786015573.193446:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 88 00000100:00100000:2.0:1786015573.193458:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+78:2353:x1872772280709888:12345-192.168.202.56@tcp:63:ll_sa.0 00010000:00010000:2.0:1786015573.193538:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.193562:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c503fc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e95ed expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.193631:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c503fd0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.193648:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c503fd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.193662:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c503fd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.194050:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503fde lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.194062:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503fde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.194069:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503fde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.194083:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503fe5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.194089:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.194095:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194197:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c503fd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194207:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c503fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194215:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c503fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194305:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c503fd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194314:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c503fd0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194322:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c503fd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194329:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819baa00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015573.194335:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c503fd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194344:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c503fd0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194358:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015573.194361:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.194367:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c503fd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194373:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c503fd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194388:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c503fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194394:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c503fd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194401:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c503fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194407:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383906000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015573.194410:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c503fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194416:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c503fd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194423:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x21330256 (ffff8b7487f06900) 00010000:00010000:2.0:1786015573.194425:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.194428:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c503fd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194433:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c503fd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194471:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c503fc9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95ed expref: 79 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194482:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015573.194484:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786015573.194488:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c503fc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95ed expref: 79 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.194497:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb800, rc -2) 00010000:00010000:3.0:1786015573.195081:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503fde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.195092:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503fde lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.195098:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503fde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.195347:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015573.195351:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503fde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.195363:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503fde lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.195375:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015573.195377:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015573.195381:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503fde lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.195386:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503fde lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.195400:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.195407:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503fe5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.195413:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.195419:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015573.195421:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.195428:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503fe5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.195434:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8b7483ce2c00) 00010000:00010000:3.0:1786015573.195436:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015573.195439:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503fe5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.195450:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503fe5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.195490:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503fc2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95e6 expref: 78 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.195499:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015573.195501:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015573.195504:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503fc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95e6 expref: 78 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.195528:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbde00, rc 0) 00000100:00100000:3.0:1786015573.195626:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+77:33507:x1872772280709760:12345-192.168.202.56@tcp:101:rm.0 Request processed in 4833us (9019us total) trans 0 rc 301/301 00000100:00100000:3.0:1786015573.195636:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1620 00000100:00100000:2.0:1786015573.195814:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+76:2353:x1872772280709888:12345-192.168.202.56@tcp:63:ll_sa.0 Request processed in 2359us (3431us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786015573.195836:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 88 00000100:00100000:1.0:1786015573.223129:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015573.223367:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280710016 00000100:00100000:3.0:1786015573.223382:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280710016 00000100:00100000:3.0:1786015573.223459:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1621 00000100:00100000:3.0:1786015573.223472:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+76:33508:x1872772280710016:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015573.223518:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015573.223549:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503fec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e95f4 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.223676:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ff3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.223695:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ff3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.223712:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ff3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.223730:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ffa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.223747:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.223756:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.223903:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ff3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.223921:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ff3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.223929:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ff3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.223936:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbce00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015573.223942:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ff3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.223951:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ff3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.223968:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015573.223971:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015573.223976:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ff3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.223984:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c503ff3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.224000:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.224006:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ffa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.224012:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ffa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.224018:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015573.224020:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ffa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.224026:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ffa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.224032:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8b7483ce2c00) 00010000:00010000:3.0:1786015573.224034:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015573.224036:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ffa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.224042:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c503ffa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.224084:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503fec lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95f4 expref: 77 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.225109:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015573.225119:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015573.225129:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c503fec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95f4 expref: 77 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.225147:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbde00, rc 0) 00000100:00100000:2.0:1786015573.225425:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+76:33508:x1872772280710016:12345-192.168.202.56@tcp:101:cp.0 Request processed in 1953us (2321us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015573.225437:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1621 00000100:00100000:0.0:1786015573.236494:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.241448:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280710144 00000100:00100000:2.0:1786015573.241472:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280710144 00000100:00100000:2.0:1786015573.241875:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1622 00000100:00100000:2.0:1786015573.241890:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+76:33508:x1872772280710144:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015573.241930:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.241962:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c504001 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e95fb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242062:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c504008 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242081:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c504008 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242095:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c504008 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242125:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50400f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242133:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50400f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242141:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50400f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242228:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c504008 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242249:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c504008 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242257:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c504008 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242264:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b46e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015573.242269:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c504008 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242278:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c504008 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242292:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015573.242295:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.242301:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c504008 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242308:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c504008 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242322:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50400f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242328:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50400f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242333:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50400f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242338:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015573.242341:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50400f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242347:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50400f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242353:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8b7487f06900) 00010000:00010000:2.0:1786015573.242356:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.242358:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50400f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242363:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47c00/0xb1a5ef690c50400f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242403:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c504001 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95fb expref: 77 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242414:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015573.242416:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.242421:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c504001 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95fb expref: 77 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.242431:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47600, rc 0) 00000100:00100000:2.0:1786015573.242642:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+76:33508:x1872772280710144:12345-192.168.202.56@tcp:101:cp.0 Request processed in 754us (6161us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015573.242651:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1622 00000100:00100000:1.0:1786015573.246270:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.248028:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280710400 00000100:00100000:0.0:1786015573.248047:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280710400 00000100:00100000:0.0:1786015573.248215:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1623 00000100:00100000:0.0:1786015573.248228:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+76:33508:x1872772280710400:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015573.248258:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015573.248291:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c504016 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9602 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.248509:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50401d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.249356:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503f75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95c3 expref: 114 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.249369:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50401d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.249426:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503f75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95c3 expref: 114 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.249443:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503f75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95c3 expref: 114 pid: 5794 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015573.249461:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381307800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304474752:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015573.249701:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb540 going to sleep for 11 seconds 00000100:00100000:0.0:1786015573.254286:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381307800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304474752:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015573.254326:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50401d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015573.254640:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.254929:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280710528 00000100:00100000:0.0:1786015573.254939:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280710528 00010000:00010000:0.0:1786015573.254989:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503f75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95c3 expref: 115 pid: 5794 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015573.255043:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 471 00000100:00100000:0.0:1786015573.255054:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+115:2353:x1872772280710528:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015573.255073:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015573.255081:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503f75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95c3 expref: 115 pid: 5794 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.255094:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503f75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95c3 expref: 115 pid: 5794 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.255239:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbd600/0xb1a5ef690c503f75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95c3 expref: 115 pid: 5794 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.255259:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015573.255265:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50401d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.255278:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50401d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.255288:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50401d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.255315:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015573.255379:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+114:2353:x1872772280710528:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 327us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015573.255387:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 471 00010000:00010000:1.0:1786015573.255488:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50401d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.255496:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50401d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.255523:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504024 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.255535:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.255543:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786015573.258345:0:12526:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21:0x0], index 0: 0 00010000:00010000:0.0:1786015573.258992:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c50402b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.259015:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c50402b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.259031:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c50402b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.259082:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50401d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.259090:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50401d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.259098:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50401d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.259173:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481665000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015573.259179:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50401d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.259187:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50401d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.259203:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015573.259206:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015573.259211:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50401d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.259218:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50401d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015573.259241:0:12526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000db695965 reply state 00000000ca7048d0 transno 4294968356 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015573.259252:0:12526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786015573.259299:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c504016 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9602 expref: 79 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.259316:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664c00/0xb1a5ef690c50402b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9602 expref: 78 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.259324:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff8b749302f000) 00010000:00010000:0.0:1786015573.259327:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015573.259329:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481664c00, rc 0) 00000100:00100000:0.0:1786015573.259485:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+79:33508:x1872772280710400:12345-192.168.202.56@tcp:101:cp.0 Request processed in 11258us (13227us total) trans 4294968356 rc 0/0 00000100:00100000:0.0:1786015573.259494:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1623 00000100:00100000:1.0:1786015573.263845:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015573.264387:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280710656 00000100:00100000:3.0:1786015573.264402:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280710656 00000100:00100000:3.0:1786015573.264483:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 468 00000100:00100000:3.0:1786015573.264494:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+16:2354:x1872772280710656:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:3.0:1786015573.264520:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015573.264549:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e688cd9f/0xb1a5ef690c504039 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9609 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015573.264586:0:14547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786015573.264612:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=808s v=(0 0) 00010000:00010000:3.0:1786015573.264617:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015573.264628:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e688cd9f/0xb1a5ef690c504039 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9609 expref: 17 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.264649:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e688cd9f/0xb1a5ef690c504039 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9609 expref: 17 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.264666:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bf9e7e00, rc 0) 00000100:00100000:3.0:1786015573.265030:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+17:2354:x1872772280710656:12345-192.168.202.56@tcp:101:cp.0 Request processed in 537us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015573.265041:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 468 00000100:00100000:1.0:1786015573.268583:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.268749:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280710784 00000100:00100000:2.0:1786015573.268795:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280710784 00000100:00100000:2.0:1786015573.268873:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 469 00000100:00100000:2.0:1786015573.268885:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+17:33508:x1872772280710784:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015573.268914:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.268951:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbe0f01d/0xb1a5ef690c504040 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9610 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.269001:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e688cd9f/0xb1a5ef690c504039 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9609 expref: 18 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.269012:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015573.269017:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015573.269023:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbe0f01d/0xb1a5ef690c504040 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9610 expref: 18 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.269069:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e688cd9f/0xb1a5ef690c504039 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9609 expref: 18 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.269085:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e688cd9f/0xb1a5ef690c504039 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9609 expref: 18 pid: 14547 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015573.269286:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1222680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304474880:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015573.269392:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74982a83c0 going to sleep for 11 seconds 00010000:00010000:0.0:1786015573.272573:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.272600:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504024 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.272610:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504024 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.272618:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015573.272624:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504024 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.272637:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504024 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.272660:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8b748f194a00) 00010000:00010000:0.0:1786015573.272664:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015573.272669:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504024 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.272675:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504024 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015573.273708:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.274139:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1222680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304474880:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015573.274183:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bbe0f01d/0xb1a5ef690c504040 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9610 expref: 18 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.274208:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384b47c00, rc 0) 00000100:00100000:2.0:1786015573.274284:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+18:33508:x1872772280710784:12345-192.168.202.56@tcp:101:cp.0 Request processed in 5400us (5714us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015573.274295:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 469 00000100:00100000:3.0:1786015573.276635:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280710912 00000100:00100000:3.0:1786015573.276657:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280710912 00010000:00010000:3.0:1786015573.276720:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e688cd9f/0xb1a5ef690c504039 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9609 expref: 18 pid: 14547 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015573.276809:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 472 00000100:00100000:3.0:1786015573.276830:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748821e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+18:2353:x1872772280710912:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015573.276851:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015573.276883:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e688cd9f/0xb1a5ef690c504039 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9609 expref: 18 pid: 14547 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.276900:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e688cd9f/0xb1a5ef690c504039 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9609 expref: 18 pid: 14547 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.277048:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e688cd9f/0xb1a5ef690c504039 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9609 expref: 18 pid: 14547 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.277071:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015573.277076:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015573.277086:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbe0f01d/0xb1a5ef690c504040 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9610 expref: 17 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.277245:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbe0f01d/0xb1a5ef690c504040 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9610 expref: 17 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.277308:0:6607:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bbe0f01d/0xb1a5ef690c504040 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9610 expref: 17 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015573.277325:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304475008:192.168.202.56@tcp:105: 00000100:00100000:3.0:1786015573.277422:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b7e16900 going to sleep for 11 seconds 00000100:00100000:3.0:1786015573.285852:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6607:1872772304475008:192.168.202.56@tcp:105: 00010000:00010000:3.0:1786015573.285893:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015573.285975:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748821e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+17:2353:x1872772280710912:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 9155us (12275us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015573.285989:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 472 00000100:00100000:1.0:1786015573.286585:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.286628:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280711168 00000100:00100000:1.0:1786015573.286637:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280711168 00000100:00100000:1.0:1786015573.286711:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 332 00000100:00100000:1.0:1786015573.286721:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+78:33508:x1872772280711168:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:1.0:1786015573.288555:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+79:33508:x1872772280711168:12345-192.168.202.56@tcp:35:cp.0 Request processed in 1823us (1961us total) trans 4294968357 rc 0/0 00000100:00100000:1.0:1786015573.288569:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 332 00000100:00100000:1.0:1786015573.337079:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.337394:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280711296 00000100:00100000:2.0:1786015573.337406:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280711296 00000100:00100000:2.0:1786015573.337475:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1624 00000100:00100000:2.0:1786015573.337484:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+114:33511:x1872772280711296:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015573.337536:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.337571:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c504047 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9617 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.337663:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50404e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.338182:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50404e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.338200:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50404e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.338225:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c504055 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.338233:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c504055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.338241:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c504055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.338381:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50405c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.338390:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50405c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.338397:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50405c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015573.338443:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x36:0x0]: returning size 158 00000004:00200000:2.0:1786015573.338449:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015573.338473:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50405c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.338486:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50405c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.338494:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50404e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.338499:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50404e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.338503:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50404e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.339081:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384b47600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015573.339085:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50404e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.339093:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50404e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.339168:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015573.339172:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.339179:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50404e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.339186:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47600/0xb1a5ef690c50404e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.339205:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c504055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.339212:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c504055 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.339218:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c504055 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.339222:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383907e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015573.339225:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c504055 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.339231:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c504055 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.339239:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8b7487f06900) 00010000:00010000:2.0:1786015573.339241:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.339245:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c504055 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.339250:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383907e00/0xb1a5ef690c504055 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.339307:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b46e00/0xb1a5ef690c504047 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9617 expref: 116 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.339325:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906000/0xb1a5ef690c50405c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9617 expref: 115 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.339333:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff8b749302f000) 00010000:00010000:2.0:1786015573.339336:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015573.339339:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383906000, rc 0) 00000100:00100000:2.0:1786015573.339442:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+115:33511:x1872772280711296:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1957us (2375us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015573.339450:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1624 00000100:00100000:3.0:1786015573.347609:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.348391:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280711552 00000100:00100000:2.0:1786015573.348404:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280711552 00000100:00100000:2.0:1786015573.348467:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 89 00000100:00100000:2.0:1786015573.348476:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:41677fca-39fb-471c-b582-96bce6540a36+115:2354:x1872772280711552:12345-192.168.202.56@tcp:63:ll_sa.0 00010000:00010000:2.0:1786015573.348556:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.348588:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c504063 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9625 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348658:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c50406a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348674:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c50406a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348702:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c50406a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348743:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504071 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348752:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348778:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348866:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c50406a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348872:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c50406a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348877:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c50406a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348881:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b73819baa00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015573.348885:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c50406a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348891:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c50406a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348902:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015573.348904:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.348908:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c50406a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348918:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819baa00/0xb1a5ef690c50406a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348929:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348934:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504071 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348938:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504071 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348940:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bfec3a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015573.348942:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504071 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348945:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504071 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348949:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff8b7487f06400) 00010000:00010000:2.0:1786015573.348950:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.348952:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504071 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348955:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504071 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348983:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c504063 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9625 expref: 116 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.348991:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015573.348992:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786015573.348995:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb800/0xb1a5ef690c504063 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9625 expref: 116 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.349005:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b73819bb800, rc -2) 00000100:00100000:2.0:1786015573.349082:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:41677fca-39fb-471c-b582-96bce6540a36+115:2354:x1872772280711552:12345-192.168.202.56@tcp:63:ll_sa.0 Request processed in 608us (1487us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786015573.349089:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 89 00000100:00100000:3.0:1786015573.363856:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.364236:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280711424 00000100:00100000:0.0:1786015573.364251:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280711424 00000100:00100000:0.0:1786015573.364334:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 470 00000100:00100000:0.0:1786015573.364347:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+16:2351:x1872772280711424:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015573.364374:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015573.364400:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026d9309c/0xb1a5ef690c504078 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e961e expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015573.364483:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381307800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304475136:192.168.202.56@tcp:106: 00000100:00100000:0.0:1786015573.364605:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb180 going to sleep for 11 seconds 00002000:00010000:0.0:1786015573.373444:0:11384:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x21:0x0] updating lvb size: 0 -> 158 00002000:00010000:0.0:1786015573.373457:0:11384:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x21:0x0] updating lvb mtime: 0 -> 1786015573 00002000:00010000:0.0:1786015573.373460:0:11384:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x21:0x0] updating lvb atime: 0 -> 1786015573 00002000:00010000:0.0:1786015573.373462:0:11384:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x21:0x0] updating lvb ctime: 0 -> 1786015573 00000100:00100000:0.0:1786015573.373497:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381307800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304475136:192.168.202.56@tcp:106: 00010000:00010000:0.0:1786015573.375598:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000026d9309c/0xb1a5ef690c504078 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e961e expref: 17 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.375639:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026d9309c/0xb1a5ef690c504078 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e961e expref: 17 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.375658:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481664a00, rc 0) 00000100:00100000:0.0:1786015573.375831:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+16:2351:x1872772280711424:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 11478us (11981us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015573.375842:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 470 00000100:00100000:3.0:1786015573.385269:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.385644:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280711680 00000100:00100000:1.0:1786015573.385657:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280711680 00000100:00100000:1.0:1786015573.386046:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1625 00000100:00100000:1.0:1786015573.386060:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+115:33511:x1872772280711680:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015573.386088:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015573.386127:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c50407f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e965d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.386287:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c504086 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.386306:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c504086 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.386321:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c504086 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015573.386400:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 7680 00000004:00200000:1.0:1786015573.386404:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 9 stripe count 1 MDT count 1 00000004:00010000:1.0:1786015573.386428:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c504086 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.386456:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c50407f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e965d expref: 117 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.386477:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c504086 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e965d expref: 116 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.386487:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015573.386490:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786015573.386493:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921c00, rc 0) 00000100:00100000:1.0:1786015573.386706:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+116:33511:x1872772280711680:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 647us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015573.386714:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1625 00000100:00100000:2.0:1786015573.394313:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.394438:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280711808 00000100:00100000:1.0:1786015573.394451:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280711808 00000100:00100000:1.0:1786015573.394537:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 471 00000100:00100000:1.0:1786015573.394550:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+16:2351:x1872772280711808:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015573.394576:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015573.394602:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50408d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9664 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015573.395005:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304475264:192.168.202.56@tcp:106: 00000100:00100000:0.0:1786015573.395691:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359840 going to sleep for 11 seconds 00000100:00100000:0.0:1786015573.398462:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14547:1872772304475264:192.168.202.56@tcp:106: 00010000:00010000:0.0:1786015573.398583:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50408d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9664 expref: 17 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.398616:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002626c593/0xb1a5ef690c50408d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9664 expref: 17 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.398632:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920c00, rc 0) 00000100:00100000:0.0:1786015573.398805:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+16:2351:x1872772280711808:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 4257us (4507us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015573.398816:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 471 00000100:00100000:1.0:1786015573.403386:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.403481:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280712064 00000100:00100000:0.0:1786015573.403493:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280712064 00000100:00100000:0.0:1786015573.403570:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1626 00000100:00100000:0.0:1786015573.403581:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+116:33511:x1872772280712064:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:0.0:1786015573.406050:0:12526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].53, 136 off15400 00000100:00100000:0.0:1786015573.406441:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+116:33511:x1872772280712064:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 2852us (3062us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015573.406456:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1626 00000100:00100000:2.0:1786015573.421378:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.421433:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.423703:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280712192 00000100:00100000:0.0:1786015573.423725:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280712192 00000100:00100000:0.0:1786015573.423883:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1627 00000100:00100000:0.0:1786015573.423899:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+116:33514:x1872772280712192:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1786015573.423941:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015573.423974:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c504094 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e966b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424066:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50409b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424085:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50409b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424109:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50409b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424128:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424136:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424143:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424673:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50409b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424739:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50409b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424748:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50409b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424755:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481665000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015573.424790:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50409b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424799:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50409b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424814:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015573.424817:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015573.424823:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50409b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424830:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c50409b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424848:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424853:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424860:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424866:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481665200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015573.424869:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424875:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424883:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff8b749302f300) 00010000:00010000:0.0:1786015573.424886:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015573.424889:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424895:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424950:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c504094 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e966b expref: 117 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424962:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015573.424964:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015573.424968:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c504094 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e966b expref: 117 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.424981:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481664a00, rc 0) 00000100:00100000:0.0:1786015573.425059:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+116:33514:x1872772280712192:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1163us (3694us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015573.425068:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1627 00000100:00100000:3.0:1786015573.429014:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280712320 00000100:00100000:3.0:1786015573.429037:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280712320 00000100:00100000:0.0:1786015573.434855:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 90 00000100:00100000:0.0:1786015573.434875:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:41677fca-39fb-471c-b582-96bce6540a36+116:2353:x1872772280712320:12345-192.168.202.56@tcp:63:ll_sa.0 00010000:00010000:0.0:1786015573.435340:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015573.435370:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c5040a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9672 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.435450:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.435469:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.435483:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.435500:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c5040b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.435992:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c5040b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.436003:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c5040b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.437496:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.437590:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.437599:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.437611:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481665200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015573.437616:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.437624:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.437644:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015573.437648:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015573.437654:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.437661:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665200/0xb1a5ef690c5040b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.438411:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c5040b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.438424:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c5040b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.438431:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c5040b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.438436:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7481665000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015573.438440:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c5040b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.438448:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c5040b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.438465:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xae1c5c33 (ffff8b749302f300) 00010000:00010000:0.0:1786015573.438473:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015573.438477:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c5040b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.438484:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665000/0xb1a5ef690c5040b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.438562:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c5040a9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9672 expref: 117 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.438575:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015573.438577:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786015573.438581:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481664a00/0xb1a5ef690c5040a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9672 expref: 117 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.438593:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7481664a00, rc -2) 00000100:00100000:0.0:1786015573.442484:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:41677fca-39fb-471c-b582-96bce6540a36+116:2353:x1872772280712320:12345-192.168.202.56@tcp:63:ll_sa.0 Request processed in 7594us (21030us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786015573.442525:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 90 00000100:00100000:2.0:1786015573.449119:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.449257:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280712448 00000100:00100000:0.0:1786015573.449271:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280712448 00000100:00100000:0.0:1786015573.449354:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1628 00000100:00100000:0.0:1786015573.449366:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+79:33515:x1872772280712448:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:0.0:1786015573.449403:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015573.449436:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5040be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9679 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.449575:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d800/0xb1a5ef690c5040c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.449594:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d800/0xb1a5ef690c5040c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.449608:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d800/0xb1a5ef690c5040c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.449628:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833de00/0xb1a5ef690c5040cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.449636:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833de00/0xb1a5ef690c5040cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.449643:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833de00/0xb1a5ef690c5040cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.449751:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d800/0xb1a5ef690c5040c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.449783:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d800/0xb1a5ef690c5040c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.449792:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d800/0xb1a5ef690c5040c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.449800:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833d800 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015573.449805:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d800/0xb1a5ef690c5040c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.450079:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d800/0xb1a5ef690c5040c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.450098:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015573.450102:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015573.450108:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d800/0xb1a5ef690c5040c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.450115:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d800/0xb1a5ef690c5040c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.450131:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833de00/0xb1a5ef690c5040cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.450137:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833de00/0xb1a5ef690c5040cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.450143:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833de00/0xb1a5ef690c5040cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.450219:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833de00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015573.450223:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833de00/0xb1a5ef690c5040cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.450230:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833de00/0xb1a5ef690c5040cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.450238:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff8b749302f800) 00010000:00010000:0.0:1786015573.450240:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015573.450243:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833de00/0xb1a5ef690c5040cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.450254:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833de00/0xb1a5ef690c5040cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.450303:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5040be lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9679 expref: 80 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.450316:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015573.450318:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015573.450322:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386be00/0xb1a5ef690c5040be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9679 expref: 80 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.450332:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b738386be00, rc 0) 00000100:00100000:0.0:1786015573.456381:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+79:33515:x1872772280712448:12345-192.168.202.56@tcp:101:rm.0 Request processed in 6998us (7269us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015573.456399:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1628 00000100:00100000:1.0:1786015573.463269:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.463412:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280712576 00000100:00100000:0.0:1786015573.463425:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280712576 00000100:00100000:0.0:1786015573.463501:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1629 00000100:00100000:0.0:1786015573.463531:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+79:33515:x1872772280712576:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:0.0:1786015573.463560:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015573.463588:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5040d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9680 expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.463721:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5040da lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.463748:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5040da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.463796:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5040da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.463816:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5040e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.463825:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5040e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.463832:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5040e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.463929:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5040da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.463937:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5040da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.463944:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5040da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.463951:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833c200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015573.463956:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5040da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.463966:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5040da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.463982:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015573.463985:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015573.463991:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5040da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.463999:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5040da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.464013:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5040e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.464019:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5040e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.464026:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5040e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.464031:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833cc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015573.464034:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5040e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.464040:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5040e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.464048:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff8b749302fc00) 00010000:00010000:0.0:1786015573.464050:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015573.464053:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5040e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.464058:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5040e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.464101:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5040d3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9680 expref: 80 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.464116:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015573.464119:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015573.464122:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5040d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9680 expref: 80 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.464132:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b748833c000, rc 0) 00000100:00100000:0.0:1786015573.464375:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+79:33515:x1872772280712576:12345-192.168.202.56@tcp:101:rm.0 Request processed in 851us (1120us total) trans 0 rc 301/301 00000100:00100000:0.0:1786015573.464384:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1629 00000040:00080000:0.0:1786015573.485143:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015573.485167:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015573.485230:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 53 count 12 00000040:00080000:0.0:1786015573.485242:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 2 00000100:00100000:0.0:1786015573.486422:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381304380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304475392:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786015573.486809:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015573.489960:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381304380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304475392:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786015573.491320:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.492334:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280712704 00000100:00100000:2.0:1786015573.492353:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280712704 00000100:00100000:2.0:1786015573.492443:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1630 00000100:00100000:2.0:1786015573.492457:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+79:33517:x1872772280712704:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015573.492502:0:7673:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x33:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786015573.494000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.494293:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280712832 00000100:00100000:0.0:1786015573.494304:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280712832 00000100:00100000:0.0:1786015573.494373:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1631 00000100:00100000:0.0:1786015573.494384:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+80:33518:x1872772280712832:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786015573.494417:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x34:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786015573.495089:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+80:33518:x1872772280712832:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 703us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015573.495110:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1631 00000100:00100000:2.0:1786015573.502990:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+79:33517:x1872772280712704:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 10515us (11659us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015573.503012:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1630 00000100:00100000:1.0:1786015573.504428:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.504565:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.505005:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280712960 00000100:00100000:2.0:1786015573.505019:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280712960 00000100:00100000:2.0:1786015573.505092:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280713088 00000100:00100000:2.0:1786015573.505096:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280713088 00000100:00100000:2.0:1786015573.505133:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1632 00000100:00100000:2.0:1786015573.505143:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+80:33519:x1872772280712960:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015573.505225:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x35:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015573.505361:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+80:33519:x1872772280712960:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 219us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015573.505373:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1632 00000100:00100000:2.0:1786015573.505393:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1633 00000100:00100000:2.0:1786015573.505400:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+79:33516:x1872772280713088:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015573.505411:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.505439:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2000/0xb1a5ef690c5040e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9687 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.505530:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2200/0xb1a5ef690c5040ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.505548:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2200/0xb1a5ef690c5040ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.505562:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2200/0xb1a5ef690c5040ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.505580:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2c00/0xb1a5ef690c5040f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.505588:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2c00/0xb1a5ef690c5040f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.505595:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2c00/0xb1a5ef690c5040f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.505678:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2200/0xb1a5ef690c5040ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.506070:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2200/0xb1a5ef690c5040ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.506082:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2200/0xb1a5ef690c5040ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.506089:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bfec2200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015573.506094:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2200/0xb1a5ef690c5040ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.506104:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2200/0xb1a5ef690c5040ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.506119:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015573.506122:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.506128:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2200/0xb1a5ef690c5040ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.506134:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2200/0xb1a5ef690c5040ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.506206:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2c00/0xb1a5ef690c5040f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.506213:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2c00/0xb1a5ef690c5040f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.506219:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2c00/0xb1a5ef690c5040f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.506224:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bfec2c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015573.506227:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2c00/0xb1a5ef690c5040f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.506239:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2c00/0xb1a5ef690c5040f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.506248:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff8b7487f06400) 00010000:00010000:2.0:1786015573.506250:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.506254:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2c00/0xb1a5ef690c5040f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.506259:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2c00/0xb1a5ef690c5040f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.506305:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2000/0xb1a5ef690c5040e8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9687 expref: 80 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.506317:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015573.506320:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.506323:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2000/0xb1a5ef690c5040e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9687 expref: 80 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.506332:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bfec2000, rc 0) 00000100:00100000:2.0:1786015573.506384:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+79:33516:x1872772280713088:12345-192.168.202.56@tcp:101:cp.0 Request processed in 983us (1817us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015573.506392:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1633 00000100:00100000:1.0:1786015573.511666:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.511728:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.511988:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280713344 00000100:00100000:2.0:1786015573.512003:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280713344 00000100:00100000:2.0:1786015573.512067:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280713600 00000100:00100000:2.0:1786015573.512070:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280713600 00000100:00100000:2.0:1786015573.512093:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1634 00000100:00100000:2.0:1786015573.512104:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+80:33517:x1872772280713344:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015573.512135:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.512178:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2600/0xb1a5ef690c5040fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e968e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.512326:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504104 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.512343:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504104 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.512358:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504104 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015573.512372:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x33:0x0]: returning size 158 00010000:00010000:2.0:1786015573.512569:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2600/0xb1a5ef690c5040fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e968e expref: 83 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.512595:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504104 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e968e expref: 82 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.512603:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8b749302f200) 00010000:00010000:2.0:1786015573.512606:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015573.512610:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bfec3400, rc 0) 00000100:00100000:2.0:1786015573.512693:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+82:33517:x1872772280713344:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 581us (1033us total) trans 4294968358 rc 0/0 00000100:00100000:2.0:1786015573.512702:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1634 00000100:00100000:2.0:1786015573.512740:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1635 00000100:00100000:2.0:1786015573.512750:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+81:33518:x1872772280713600:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015573.512796:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.512806:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3200/0xb1a5ef690c504112 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9695 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.512860:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3600/0xb1a5ef690c504119 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.512870:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3600/0xb1a5ef690c504119 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.512878:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3600/0xb1a5ef690c504119 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015573.512886:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x34:0x0]: returning size 158 00010000:00010000:2.0:1786015573.512947:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3200/0xb1a5ef690c504112 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9695 expref: 84 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.512960:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3600/0xb1a5ef690c504119 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9695 expref: 83 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.512967:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8b749302fe00) 00010000:00010000:2.0:1786015573.512970:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015573.512973:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bfec3600, rc 0) 00000100:00100000:2.0:1786015573.512996:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+83:33518:x1872772280713600:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 248us (1268us total) trans 4294968359 rc 0/0 00000100:00100000:2.0:1786015573.513002:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1635 00000100:00100000:1.0:1786015573.517337:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.517391:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.517424:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280713856 00000100:00100000:1.0:1786015573.517436:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280713856 00000100:00100000:1.0:1786015573.517488:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280713984 00000100:00100000:1.0:1786015573.517490:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280713984 00000100:00100000:1.0:1786015573.518866:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1636 00000100:00100000:1.0:1786015573.518892:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+84:33519:x1872772280713856:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015573.518938:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015573.518971:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c504127 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e969c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.519158:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50412e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.519176:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50412e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.519196:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50412e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786015573.519213:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x35:0x0]: returning size 158 00010000:00010000:1.0:1786015573.519395:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c504127 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e969c expref: 87 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.519419:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50412e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e969c expref: 86 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.519429:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8b7487f06500) 00010000:00010000:1.0:1786015573.519432:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786015573.519437:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920c00, rc 0) 00000100:00100000:1.0:1786015573.520650:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+86:33519:x1872772280713856:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1758us (3319us total) trans 4294968360 rc 0/0 00000100:00100000:3.0:1786015573.526062:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1637 00000100:00100000:3.0:1786015573.526281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015573.526331:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280714112 00000100:00100000:3.0:1786015573.526343:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280714112 00000100:00100000:3.0:1786015573.526403:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 472 00000100:00100000:3.0:1786015573.526412:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+17:2354:x1872772280714112:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015573.526473:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c50413c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.526522:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d06a128/0xb1a5ef690c503e1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94ab expref: 17 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.526534:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x20:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786015573.526540:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015573.526546:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c50413c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.526597:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d06a128/0xb1a5ef690c503e1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94ab expref: 17 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.526615:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d06a128/0xb1a5ef690c503e1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94ab expref: 17 pid: 11384 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015573.526635:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304475520:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015573.527128:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b7e16180 going to sleep for 11 seconds 00000100:00100000:3.0:1786015573.527233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015573.527363:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015573.527388:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280714368 00000100:00100000:3.0:1786015573.527393:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280714368 00000100:00100000:3.0:1786015573.527433:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 473 00000100:00100000:3.0:1786015573.527441:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+18:2353:x1872772280714368:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015573.527472:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c504143 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.527494:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0572f25/0xb1a5ef690c503ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e942d expref: 18 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.527501:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786015573.527504:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015573.527831:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c504143 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.527864:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0572f25/0xb1a5ef690c503ce3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e942d expref: 18 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.527878:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0572f25/0xb1a5ef690c503ce3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e942d expref: 18 pid: 6591 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015573.527892:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304475648:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015573.527940:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b7e16300 going to sleep for 11 seconds 00000100:00100000:2.0:1786015573.528113:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280714240 00000100:00100000:2.0:1786015573.528118:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280714240 00000100:00100000:2.0:1786015573.528170:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 80 00000100:00100000:2.0:1786015573.528179:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+87:2352:x1872772280714240:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015573.528192:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015573.528220:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3600/0xb1a5ef690c504119 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9695 expref: 87 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.528241:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8b749302fe00) 00010000:00010000:2.0:1786015573.528246:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015573.528284:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+86:2352:x1872772280714240:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 107us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015573.528292:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 80 00000100:00100000:2.0:1786015573.528320:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+85:33516:x1872772280713984:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015573.528341:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.528355:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2a00/0xb1a5ef690c50414a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e96a3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.528465:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c504151 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.528480:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c504151 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.528492:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c504151 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529284:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2e00/0xb1a5ef690c504158 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529297:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2e00/0xb1a5ef690c504158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529306:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2e00/0xb1a5ef690c504158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529405:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c504151 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529413:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c504151 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529421:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c504151 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529427:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bfec3c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015573.529433:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c504151 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529442:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c504151 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529451:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015573.529454:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.529458:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c504151 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529465:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c504151 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529479:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2e00/0xb1a5ef690c504158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529485:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2e00/0xb1a5ef690c504158 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529491:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2e00/0xb1a5ef690c504158 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529496:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bfec2e00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015573.529499:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2e00/0xb1a5ef690c504158 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529505:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2e00/0xb1a5ef690c504158 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529530:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff8b7487f06900) 00010000:00010000:2.0:1786015573.529533:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.529536:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2e00/0xb1a5ef690c504158 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529541:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2e00/0xb1a5ef690c504158 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529594:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2a00/0xb1a5ef690c50414a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96a3 expref: 86 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529605:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015573.529608:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015573.529611:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2a00/0xb1a5ef690c50414a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96a3 expref: 86 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.529621:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bfec2a00, rc 0) 00000100:00100000:2.0:1786015573.529673:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+85:33516:x1872772280713984:12345-192.168.202.56@tcp:101:cp.0 Request processed in 3593us (12280us total) trans 0 rc 301/301 00000100:00100000:2.0:1786015573.529698:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1637 00000100:00100000:1.0:1786015573.537582:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1636 00000100:00100000:0.0:1786015573.544140:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.544193:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.544233:0:17970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280714496 00000100:00100000:0.0:1786015573.544245:0:17970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280714496 00002000:00100000:0.0:1786015573.544316:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x20:0x0] (0->157) req@ffff8b7381307800 x1872772280714496/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:419/0 lens 648/0 e 0 to 0 dl 1786015584 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015573.544328:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381307800 with x1872772280714496 ext(0->157) 00010000:00010000:0.0:1786015573.544339:0:17970:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008d06a128/0xb1a5ef690c503e1e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94ab expref: 18 pid: 11384 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.544359:0:17970:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008d06a128/0xb1a5ef690c503e1e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94ab expref: 18 pid: 11384 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015573.544368:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b7381307800 00000100:00100000:0.0:1786015573.544401:0:17970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:0.0:1786015573.544411:0:17970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+18:2351:x1872772280714496:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:0.0:1786015573.545140:0:17970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+20:2351:x1872772280714496:12345-192.168.202.56@tcp:4:cp.0 Request processed in 727us (943us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1786015573.545151:0:17970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00002000:00100000:0.0:1786015573.545159:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x20:0x0] (0->157) req@ffff8b7381307800 x1872772280714496/t4294967379(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:419/0 lens 648/448 e 0 to 0 dl 1786015584 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015573.545168:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381307800 with x1872772280714496 ext(0->157) 00010000:00010000:0.0:1786015573.545174:0:17970:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008d06a128/0xb1a5ef690c503e1e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94ab expref: 20 pid: 11384 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.545186:0:17970:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008d06a128/0xb1a5ef690c503e1e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94ab expref: 20 pid: 11384 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015573.545194:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b7381307800 00000100:00100000:0.0:1786015573.545363:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.545391:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280714624 00000100:00100000:0.0:1786015573.545396:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280714624 00000100:00100000:0.0:1786015573.545441:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 474 00000100:00100000:0.0:1786015573.545448:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+19:2354:x1872772280714624:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786015573.545489:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c50415f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.545511:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503f2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9576 expref: 19 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.545520:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015573.545526:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015573.545530:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c50415f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.545573:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503f2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9576 expref: 19 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.545587:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503f2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9576 expref: 19 pid: 22346 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015573.545605:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304475776:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015573.545672:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015573.545712:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.545747:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280714752 00000100:00100000:0.0:1786015573.545751:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280714752 00000100:00100000:0.0:1786015573.545817:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 81 00000100:00100000:0.0:1786015573.545825:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+84:2352:x1872772280714752:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015573.545837:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015573.545865:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920c00/0xb1a5ef690c50412e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e969c expref: 84 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.545886:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8b7487f06500) 00010000:00010000:0.0:1786015573.545892:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015573.545916:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+83:2352:x1872772280714752:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 92us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015573.545923:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 81 00000100:00100000:0.0:1786015573.546047:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.546072:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.546091:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280714880 00000100:00100000:0.0:1786015573.546095:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280714880 00010000:00010000:0.0:1786015573.546112:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0572f25/0xb1a5ef690c503ce3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e942d expref: 20 pid: 6591 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015573.546135:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280715264 00000100:00100000:0.0:1786015573.546138:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280715264 00000100:00100000:0.0:1786015573.546161:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 473 00000100:00100000:0.0:1786015573.546168:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+20:2353:x1872772280714880:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015573.546177:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015573.546204:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0572f25/0xb1a5ef690c503ce3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e942d expref: 20 pid: 6591 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.546217:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0572f25/0xb1a5ef690c503ce3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e942d expref: 20 pid: 6591 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.546236:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015573.546241:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015573.546247:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c504143 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.546257:0:17038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c504143 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.546275:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015573.546296:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+20:2353:x1872772280714880:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 128us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015573.546303:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 473 00000100:00100000:0.0:1786015573.546317:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 82 00000100:00100000:0.0:1786015573.546323:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+83:2351:x1872772280715264:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015573.546331:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015573.546343:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504104 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e968e expref: 83 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.546354:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8b749302f200) 00010000:00010000:0.0:1786015573.546357:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015573.546374:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+82:2351:x1872772280715264:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 51us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015573.546381:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 82 00010000:00010000:0.0:1786015573.546481:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0572f25/0xb1a5ef690c503ce3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e942d expref: 19 pid: 6591 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015573.546493:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304475648:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015573.546517:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c504143 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.546528:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c504143 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.546535:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c504143 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.546562:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c504143 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.546571:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c504143 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.546579:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c504143 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.546588:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015573.546592:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c504143 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.546602:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c504143 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.546613:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c504143 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.546622:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f23b128/0xb1a5ef690c504143 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015573.546675:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+18:2353:x1872772280714368:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 19235us (19311us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015573.546683:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 473 00000100:00100000:2.0:1786015573.547311:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280715136 00000100:00100000:2.0:1786015573.547320:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280715136 00000100:00100000:2.0:1786015573.547371:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1638 00000100:00100000:2.0:1786015573.547380:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+82:33516:x1872772280715136:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:2.0:1786015573.547410:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.547431:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3200/0xb1a5ef690c504166 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e96aa expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.547609:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2600/0xb1a5ef690c50416d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.547627:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c504086 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e965d expref: 115 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.547636:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2600/0xb1a5ef690c50416d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.547668:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c504086 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e965d expref: 115 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.547681:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c504086 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e965d expref: 115 pid: 5795 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015573.547694:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1220700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304475904:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015573.547804:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74982a83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015573.550383:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6592:1872772304475520:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015573.550427:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c50413c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015573.559936:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.560017:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280715392 00000100:00100000:1.0:1786015573.560032:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280715392 00000100:00100000:2.0:1786015573.560047:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:1.0:1786015573.560091:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d06a128/0xb1a5ef690c503e1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94ab expref: 20 pid: 11384 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015573.560253:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280715520 00000100:00100000:3.0:1786015573.560258:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280715520 00002000:00100000:3.0:1786015573.560303:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (0->157) req@ffff8b74c1220a80 x1872772280715520/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:419/0 lens 648/0 e 0 to 0 dl 1786015584 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015573.560314:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c1220a80 with x1872772280715520 ext(0->157) 00010000:00010000:3.0:1786015573.560323:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503f2f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9576 expref: 18 pid: 22346 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.560337:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503f2f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9576 expref: 18 pid: 22346 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015573.560346:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b74c1220a80 00000100:00100000:3.0:1786015573.560375:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:3.0:1786015573.560386:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+18:2354:x1872772280715520:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:3.0:1786015573.561111:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+20:2354:x1872772280715520:12345-192.168.202.56@tcp:4:cp.0 Request processed in 722us (1058us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1786015573.561121:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 22 00002000:00100000:3.0:1786015573.561130:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (0->157) req@ffff8b74c1220a80 x1872772280715520/t4294967394(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:419/0 lens 648/448 e 0 to 0 dl 1786015584 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015573.561139:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c1220a80 with x1872772280715520 ext(0->157) 00000100:00100000:2.0:1786015573.561207:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 474 00000100:00100000:2.0:1786015573.561221:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+20:2352:x1872772280715392:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015573.561241:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015573.561268:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d06a128/0xb1a5ef690c503e1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94ab expref: 20 pid: 11384 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.561286:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d06a128/0xb1a5ef690c503e1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94ab expref: 20 pid: 11384 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.561314:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d06a128/0xb1a5ef690c503e1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94ab expref: 20 pid: 11384 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.561335:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786015573.561341:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786015573.561348:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c50413c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.561360:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c50413c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.561394:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015573.561419:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+19:2352:x1872772280715392:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 202us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015573.561427:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 474 00010000:00010000:3.0:1786015573.561845:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503f2f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9576 expref: 20 pid: 22346 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.561861:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503f2f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9576 expref: 20 pid: 22346 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015573.561869:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b74c1220a80 00000100:00100000:3.0:1786015573.561949:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14547:1872772304475776:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015573.562325:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c50413c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.562339:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c50413c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.562384:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c50413c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.562394:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c50413c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.562403:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c50413c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.562411:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbde00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015573.562417:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c50413c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.562428:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c50413c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.562446:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c50413c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.562454:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f4ff15f/0xb1a5ef690c50413c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.562877:0:14547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c50415f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015573.563050:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015573.563240:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280715776 00000100:00100000:3.0:1786015573.563249:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280715776 00000100:00100000:3.0:1786015573.563312:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1639 00000100:00100000:3.0:1786015573.563323:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+84:33517:x1872772280715776:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786015573.563453:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+18:2354:x1872772280714112:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 37041us (37172us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015573.563463:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 472 00000100:00100000:3.0:1786015573.565067:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+84:33517:x1872772280715776:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 1733us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015573.565081:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1639 00000100:00100000:2.0:1786015573.573024:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.573071:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.573171:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280716032 00000100:00100000:0.0:1786015573.573185:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280716032 00000100:00100000:0.0:1786015573.573259:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1640 00000100:00100000:0.0:1786015573.573270:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+84:33518:x1872772280716032:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015573.573407:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+84:33518:x1872772280716032:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 138us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015573.573415:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1640 00000100:00100000:1.0:1786015573.573918:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280716160 00000100:00100000:1.0:1786015573.573926:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280716160 00010000:00010000:1.0:1786015573.573960:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503f2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9576 expref: 20 pid: 22346 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015573.574002:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 475 00000100:00100000:1.0:1786015573.574010:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+20:2352:x1872772280716160:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015573.574023:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015573.574055:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503f2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9576 expref: 20 pid: 22346 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.574067:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503f2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9576 expref: 20 pid: 22346 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.574094:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c503f2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9576 expref: 20 pid: 22346 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.574116:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015573.574121:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015573.574128:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c50415f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.574159:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c50415f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.574197:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015573.574242:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+19:2352:x1872772280716160:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 232us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015573.574249:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 475 00010000:00010000:0.0:1786015573.574790:0:14547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c50415f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.574802:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c50415f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.574841:0:14547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c50415f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.574851:0:14547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c50415f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.574860:0:14547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c50415f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.574868:0:14547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833cc00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015573.574873:0:14547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c50415f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.574885:0:14547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c50415f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.574904:0:14547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c50415f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.574913:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c50415f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015573.574984:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+18:2354:x1872772280714624:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 29534us (29618us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015573.574997:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 474 00000100:00100000:2.0:1786015573.575192:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.575820:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1220700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304475904:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015573.575852:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2600/0xb1a5ef690c50416d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015573.579309:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280716288 00000100:00100000:1.0:1786015573.579331:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280716288 00010000:00010000:1.0:1786015573.579397:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c504086 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e965d expref: 116 pid: 5795 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015573.579573:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 476 00000100:00100000:1.0:1786015573.579585:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748821f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+116:2353:x1872772280716288:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015573.579606:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015573.579615:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c504086 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e965d expref: 116 pid: 5795 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.579631:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c504086 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e965d expref: 116 pid: 5795 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.579669:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921c00/0xb1a5ef690c504086 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e965d expref: 116 pid: 5795 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.579688:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015573.579694:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2600/0xb1a5ef690c50416d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.579706:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2600/0xb1a5ef690c50416d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.579714:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2600/0xb1a5ef690c50416d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.579756:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015573.579789:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:0.0:1786015573.579847:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2600/0xb1a5ef690c50416d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.579857:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2600/0xb1a5ef690c50416d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.579889:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c504174 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.579901:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c504174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.579910:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c504174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786015573.580650:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24:0x0], index 1: 0 00010000:00010000:0.0:1786015573.580934:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d800/0xb1a5ef690c50417b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.580945:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d800/0xb1a5ef690c50417b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.580955:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d800/0xb1a5ef690c50417b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.580999:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2600/0xb1a5ef690c50416d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.581008:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2600/0xb1a5ef690c50416d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.581014:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2600/0xb1a5ef690c50416d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.581021:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bfec2600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015573.581025:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2600/0xb1a5ef690c50416d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.581034:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2600/0xb1a5ef690c50416d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.581046:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015573.581049:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015573.581053:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2600/0xb1a5ef690c50416d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.581059:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2600/0xb1a5ef690c50416d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015573.581072:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000643316bb reply state 0000000094419e4a transno 4294968361 ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c504174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015573.581081:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786015573.581124:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3200/0xb1a5ef690c504166 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96aa expref: 85 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.581140:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d800/0xb1a5ef690c50417b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96aa expref: 84 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.581154:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8b749302f100) 00010000:00010000:0.0:1786015573.581157:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015573.581160:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b748833d800, rc 0) 00000100:00100000:3.0:1786015573.581902:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280716416 00000100:00100000:3.0:1786015573.581926:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280716416 00000100:00100000:3.0:1786015573.581998:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 475 00000100:00100000:3.0:1786015573.582008:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+18:2352:x1872772280716416:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015573.582029:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015573.582052:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac472ba5/0xb1a5ef690c504189 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e96b1 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015573.582081:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 158, mtime: 0x6a746f54, atime: 0x0, ctime: 0x6a746f54, blocks: 0x1 00010000:00010000:3.0:1786015573.582119:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=808s v=(0 0) 00010000:00010000:3.0:1786015573.582125:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015573.582136:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac472ba5/0xb1a5ef690c504189 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96b1 expref: 19 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.582165:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac472ba5/0xb1a5ef690c504189 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96b1 expref: 19 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.582181:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbd600, rc 0) 00000100:00100000:1.0:1786015573.586042:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748821f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+115:2353:x1872772280716288:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 6436us (10828us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015573.586063:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 476 00000100:00100000:0.0:1786015573.591360:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+85:33516:x1872772280715136:12345-192.168.202.56@tcp:101:cp.0 Request processed in 43962us (47215us total) trans 4294968361 rc 0/0 00000100:00100000:0.0:1786015573.591380:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1638 00000100:00100000:3.0:1786015573.592495:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+19:2352:x1872772280716416:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 10477us (12723us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015573.592510:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 475 00000100:00100000:2.0:1786015573.592964:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.593110:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.593140:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280716800 00000100:00100000:2.0:1786015573.593623:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280716800 00000100:00100000:2.0:1786015573.593697:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1641 00000100:00100000:2.0:1786015573.593708:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+85:33519:x1872772280716800:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786015573.594287:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280716544 00000100:00100000:0.0:1786015573.594296:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280716544 00000100:00100000:0.0:1786015573.594334:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 476 00000100:00100000:0.0:1786015573.594342:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+18:2353:x1872772280716544:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015573.594363:0:22346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015573.594391:0:22346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017e465ed/0xb1a5ef690c504190 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e96b8 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015573.594425:0:22346:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 158, mtime: 0x6a746f54, atime: 0x0, ctime: 0x6a746f54, blocks: 0x1 00010000:00010000:0.0:1786015573.594451:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=808s v=(0 0) 00010000:00010000:0.0:1786015573.594456:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015573.594467:0:22346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017e465ed/0xb1a5ef690c504190 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96b8 expref: 19 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.594488:0:22346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000017e465ed/0xb1a5ef690c504190 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96b8 expref: 19 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.594503:0:22346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b748833d400, rc 0) 00000100:00100000:0.0:1786015573.594998:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+19:2353:x1872772280716544:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 654us (2034us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015573.595007:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 476 00000100:00100000:2.0:1786015573.595303:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+85:33519:x1872772280716800:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 1596us (2190us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015573.595313:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1641 00010000:00010000:3.0:1786015573.599128:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c504174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.599236:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c504174 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.599245:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c504174 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.599252:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833c000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015573.599258:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c504174 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.599270:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c504174 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.599293:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff8b749302f400) 00010000:00010000:3.0:1786015573.599297:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015573.599303:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c504174 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.599310:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c504174 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015573.608000:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.608060:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.608070:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280716928 00000100:00100000:1.0:1786015573.608088:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280716928 00000100:00100000:2.0:1786015573.608093:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.608155:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280717312 00000100:00100000:1.0:1786015573.608158:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280717312 00000100:00100000:1.0:1786015573.608181:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 477 00000100:00100000:2.0:1786015573.608409:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.608432:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280717184 00000100:00100000:2.0:1786015573.608435:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280717184 00000100:00100000:2.0:1786015573.608466:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280717568 00000100:00100000:2.0:1786015573.608469:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280717568 00000100:00100000:2.0:1786015573.608487:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1642 00000100:00100000:2.0:1786015573.608495:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+85:33517:x1872772280717184:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015573.608657:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+85:33517:x1872772280717184:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 162us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015573.608666:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1642 00000100:00100000:2.0:1786015573.608686:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1643 00000100:00100000:2.0:1786015573.608693:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+84:33518:x1872772280717568:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015573.608737:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+84:33518:x1872772280717568:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 35us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015573.608744:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1643 00000100:00100000:1.0:1786015573.609027:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+20:2353:x1872772280716928:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:1.0:1786015573.609042:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015573.609114:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c504197 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e96bf expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786015573.609152:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786015573.609174:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=808s v=(0 0) 00010000:00010000:1.0:1786015573.609180:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1786015573.609486:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 478 00000100:00100000:2.0:1786015573.609497:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+21:2353:x1872772280717312:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015573.609505:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.609780:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000052c48d5/0xb1a5ef690c50419e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e96c6 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015573.609801:0:14547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 158, mtime: 0x6a746f55, atime: 0x0, ctime: 0x6a746f55, blocks: 0x1 00010000:00010000:2.0:1786015573.609813:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=808s v=(0 0) 00010000:00010000:2.0:1786015573.609826:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015573.609835:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000052c48d5/0xb1a5ef690c50419e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96c6 expref: 22 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.609840:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c504197 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96bf expref: 22 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.609855:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000052c48d5/0xb1a5ef690c50419e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96c6 expref: 22 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.609858:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c504197 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96bf expref: 22 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.609872:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bfec2c00, rc 0) 00010000:00010000:1.0:1786015573.609872:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921600, rc 0) 00000100:00100000:1.0:1786015573.609918:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+22:2353:x1872772280716928:12345-192.168.202.56@tcp:101:cp.0 Request processed in 1728us (1935us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015573.609925:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 477 00000100:00100000:2.0:1786015573.610380:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+21:2353:x1872772280717312:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 883us (2283us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015573.610387:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 478 00000100:00100000:3.0:1786015573.616456:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015573.616502:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.616520:0:17969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280717696 00000100:00100000:1.0:1786015573.616533:0:17969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280717696 00000100:00100000:3.0:1786015573.616543:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280717952 00000100:00100000:3.0:1786015573.616547:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280717952 00000100:00100000:3.0:1786015573.616596:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1644 00002000:00100000:1.0:1786015573.616597:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x20:0x0] (0->4095) req@ffff8b74aa5a4e00 x1872772280717696/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:419/0 lens 488/0 e 0 to 0 dl 1786015584 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1786015573.616607:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+84:33519:x1872772280717952:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00002000:00100000:1.0:1786015573.616609:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aa5a4e00 with x1872772280717696 ext(0->4095) 00002000:00010000:1.0:1786015573.616616:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74aa5a4e00 00000100:00100000:1.0:1786015573.616699:0:17969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 132 00000100:00100000:1.0:1786015573.616709:0:17969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+19:2354:x1872772280717696:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1786015573.616759:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+84:33519:x1872772280717952:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 152us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015573.616785:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1644 00000100:00100000:3.0:1786015573.616837:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.616960:0:17969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+19:2354:x1872772280717696:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 252us (520us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786015573.616967:0:17969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 132 00002000:00100000:1.0:1786015573.621007:0:17969:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x20:0x0] (0->4095) req@ffff8b74aa5a4e00 x1872772280717696/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:419/0 lens 488/4536 e 0 to 0 dl 1786015584 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015573.621023:0:17969:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74aa5a4e00 with x1872772280717696 ext(0->4095) 00002000:00010000:1.0:1786015573.621034:0:17969:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b74aa5a4e00 00000100:00100000:0.0:1786015573.621860:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280718080 00000100:00100000:0.0:1786015573.621875:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280718080 00000100:00100000:0.0:1786015573.622059:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 479 00000100:00100000:0.0:1786015573.622070:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+21:33516:x1872772280718080:12345-192.168.202.56@tcp:101:cp.0 00010000:00010000:0.0:1786015573.622091:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015573.622858:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c5041a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e96cd expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.622909:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c504197 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96bf expref: 22 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.622929:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015573.622934:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015573.622941:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c5041a5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96cd expref: 22 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.622987:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c504197 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96bf expref: 22 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.623008:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c504197 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96bf expref: 22 pid: 6592 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015573.623025:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304476032:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015573.623131:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb180 going to sleep for 11 seconds 00000100:00100000:2.0:1786015573.630580:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.630670:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.631059:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.631084:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280718464 00000100:00100000:2.0:1786015573.631096:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280718464 00000100:00100000:2.0:1786015573.631164:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1645 00000100:00100000:2.0:1786015573.631176:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+84:33518:x1872772280718464:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015573.631205:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.631234:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2400/0xb1a5ef690c5041ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e96d4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.631283:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2800/0xb1a5ef690c5041b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.631309:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2800/0xb1a5ef690c5041b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.631323:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2800/0xb1a5ef690c5041b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.631465:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2400/0xb1a5ef690c5041ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96d4 expref: 86 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.631485:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2800/0xb1a5ef690c5041b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96d4 expref: 85 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.631494:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8b749302fe00) 00010000:00010000:2.0:1786015573.631497:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015573.631502:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bfec2800, rc 0) 00000100:00100000:2.0:1786015573.631572:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+85:33518:x1872772280718464:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 398us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015573.631584:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1645 00000100:00100000:2.0:1786015573.631647:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.632163:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304476032:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015573.632205:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c5041a5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96cd expref: 22 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.632227:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b748833cc00, rc 0) 00000100:00100000:1.0:1786015573.632266:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+22:33516:x1872772280718080:12345-192.168.202.56@tcp:101:cp.0 Request processed in 10198us (15429us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015573.632274:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 479 00000100:00100000:1.0:1786015573.632315:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280718592 00000100:00100000:1.0:1786015573.632321:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280718592 00010000:00010000:1.0:1786015573.632351:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c504197 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96bf expref: 22 pid: 6592 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015573.632377:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 477 00000100:00100000:1.0:1786015573.632386:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+22:2354:x1872772280718592:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015573.632398:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015573.632426:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c504197 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96bf expref: 22 pid: 6592 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.632440:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c504197 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96bf expref: 22 pid: 6592 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.632463:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004affeb6d/0xb1a5ef690c504197 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96bf expref: 22 pid: 6592 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.632477:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015573.632482:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015573.632492:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c5041a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96cd expref: 21 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.632503:0:17038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c5041a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96cd expref: 21 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.632544:0:17038:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c5041a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96cd expref: 21 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015573.632562:0:17038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17038:1872772304476160:192.168.202.56@tcp:105: 00000100:00100000:1.0:1786015573.632625:0:17038:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c13593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015573.632830:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280718208 00000100:00100000:0.0:1786015573.632837:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280718208 00002000:00100000:0.0:1786015573.632875:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (0->4095) req@ffff8b74b8979f80 x1872772280718208/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:419/0 lens 488/0 e 0 to 0 dl 1786015584 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015573.632886:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74b8979f80 with x1872772280718208 ext(0->4095) 00002000:00010000:0.0:1786015573.632892:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74b8979f80 00000100:00100000:0.0:1786015573.632916:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280718336 00000100:00100000:0.0:1786015573.632920:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280718336 00002000:00100000:0.0:1786015573.632935:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (0->4095) req@ffff8b74b897a300 x1872772280718336/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:419/0 lens 488/0 e 0 to 0 dl 1786015584 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015573.632943:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74b897a300 with x1872772280718336 ext(0->4095) 00002000:00010000:0.0:1786015573.632946:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74b897a300 00000100:00100000:0.0:1786015573.632966:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 133 00000100:00100000:0.0:1786015573.632975:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+23:2351:x1872772280718208:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1786015573.633188:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+23:2351:x1872772280718208:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 214us (2625us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786015573.633196:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 133 00002000:00100000:0.0:1786015573.633202:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (0->4095) req@ffff8b74b8979f80 x1872772280718208/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:419/0 lens 488/4536 e 0 to 0 dl 1786015584 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015573.633210:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74b8979f80 with x1872772280718208 ext(0->4095) 00002000:00010000:0.0:1786015573.633212:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74b8979f80 00000100:00100000:0.0:1786015573.633226:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 134 00000100:00100000:0.0:1786015573.633233:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+22:2354:x1872772280718336:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1786015573.634119:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+22:2354:x1872772280718336:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 880us (3442us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786015573.634128:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 134 00002000:00100000:0.0:1786015573.634136:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x23:0x0] (0->4095) req@ffff8b74b897a300 x1872772280718336/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:419/0 lens 488/4536 e 0 to 0 dl 1786015584 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015573.634146:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74b897a300 with x1872772280718336 ext(0->4095) 00002000:00010000:0.0:1786015573.634150:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74b897a300 00000100:00100000:3.0:1786015573.637948:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015573.638021:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015573.638050:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015573.638080:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280718720 00000100:00100000:3.0:1786015573.638092:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280718720 00000100:00100000:3.0:1786015573.638150:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280719104 00000100:00100000:3.0:1786015573.638154:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280719104 00000100:00100000:3.0:1786015573.638184:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1646 00000100:00100000:3.0:1786015573.638194:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+86:33518:x1872772280718720:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015573.638240:0:7673:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x34:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015573.638391:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+86:33518:x1872772280718720:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 197us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015573.638399:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1646 00000100:00100000:3.0:1786015573.638422:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1647 00000100:00100000:3.0:1786015573.638428:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+85:33517:x1872772280719104:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015573.638439:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015573.638468:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5041ba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e96db expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.638505:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5041c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.638522:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5041c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.638542:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5041c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015573.638880:0:17038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:17038:1872772304476160:192.168.202.56@tcp:105: 00010000:00010000:0.0:1786015573.638913:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015573.638960:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+21:2354:x1872772280718592:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 6575us (7321us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015573.638972:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 477 00010000:00010000:3.0:1786015573.639232:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbce00/0xb1a5ef690c5041ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96db expref: 87 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.639254:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5041c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96db expref: 86 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.639264:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8b749302f200) 00010000:00010000:3.0:1786015573.639268:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786015573.639272:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384bbde00, rc 0) 00000100:00100000:3.0:1786015573.639484:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+86:33517:x1872772280719104:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1054us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015573.639491:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1647 00000100:00100000:1.0:1786015573.639572:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280718976 00000100:00100000:1.0:1786015573.639579:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280718976 00000100:00100000:1.0:1786015573.639653:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 333 00000100:00100000:1.0:1786015573.639662:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+86:33516:x1872772280718976:12345-192.168.202.56@tcp:35:cp.0 00000100:00100000:1.0:1786015573.642840:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+87:33516:x1872772280718976:12345-192.168.202.56@tcp:35:cp.0 Request processed in 3152us (4790us total) trans 4294968362 rc 0/0 00000100:00100000:1.0:1786015573.642862:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 333 00000100:00100000:2.0:1786015573.664147:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.664281:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280719232 00000100:00100000:0.0:1786015573.664362:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280719232 00000100:00100000:0.0:1786015573.664442:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1648 00000100:00100000:0.0:1786015573.664454:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+87:33519:x1872772280719232:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015573.664484:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015573.664514:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833ca00/0xb1a5ef690c5041c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e96e2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.664559:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833ce00/0xb1a5ef690c5041cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.664577:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833ce00/0xb1a5ef690c5041cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.664596:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833ce00/0xb1a5ef690c5041cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015573.664727:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.665786:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015573.666158:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280719488 00000100:00100000:3.0:1786015573.666168:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280719488 00000100:00100000:3.0:1786015573.666276:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1649 00000100:00100000:3.0:1786015573.666286:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+89:33517:x1872772280719488:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015573.666424:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x33:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015573.666555:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+89:33517:x1872772280719488:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 269us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015573.666563:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1649 00000100:00100000:1.0:1786015573.667583:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280719360 00000100:00100000:1.0:1786015573.667593:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280719360 00000100:00100000:1.0:1786015573.667656:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 480 00000100:00100000:1.0:1786015573.667665:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+19:2353:x1872772280719360:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015573.667713:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a0dd624/0xb1a5ef690c5041d6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.667750:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015573.667755:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015573.667782:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a0dd624/0xb1a5ef690c5041d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.667797:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a0dd624/0xb1a5ef690c5041d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.667838:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a0dd624/0xb1a5ef690c5041d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.667847:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a0dd624/0xb1a5ef690c5041d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.667856:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a0dd624/0xb1a5ef690c5041d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.667863:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921c00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015573.667868:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a0dd624/0xb1a5ef690c5041d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.667877:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a0dd624/0xb1a5ef690c5041d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.667893:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a0dd624/0xb1a5ef690c5041d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.667902:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a0dd624/0xb1a5ef690c5041d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015573.668066:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+19:2353:x1872772280719360:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 401us (3339us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015573.668072:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 480 00010000:00010000:0.0:1786015573.674149:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833ca00/0xb1a5ef690c5041c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96e2 expref: 89 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.675470:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833ce00/0xb1a5ef690c5041cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96e2 expref: 88 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.675494:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8b7487f06500) 00010000:00010000:0.0:1786015573.675498:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015573.675503:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b748833ce00, rc 0) 00000100:00100000:0.0:1786015573.675667:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+88:33519:x1872772280719232:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 11211us (11529us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015573.675678:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1648 00000100:00100000:2.0:1786015573.701168:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015573.702590:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280719744 00000100:00100000:3.0:1786015573.702608:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280719744 00000100:00100000:3.0:1786015573.702713:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1650 00000100:00100000:3.0:1786015573.702736:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+88:33518:x1872772280719744:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786015573.702888:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5041dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.703193:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2800/0xb1a5ef690c5041b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96d4 expref: 88 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.703206:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5041dd lrc: 4/0,1 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.703256:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2800/0xb1a5ef690c5041b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96d4 expref: 88 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.703274:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2800/0xb1a5ef690c5041b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96d4 expref: 88 pid: 5795 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015573.703292:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304476288:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015573.703410:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b7e16300 going to sleep for 11 seconds 00000100:00100000:3.0:1786015573.703478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015573.703528:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280719872 00000100:00100000:3.0:1786015573.703533:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280719872 00000100:00100000:3.0:1786015573.703565:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 481 00000100:00100000:3.0:1786015573.703572:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+21:2354:x1872772280719872:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015573.703605:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c5041e4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.703620:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015573.703626:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015573.703632:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c5041e4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.703656:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c5041e4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.705891:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c5041e4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.706031:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c5041e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.706042:0:11384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c5041e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.706050:0:11384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bf9e7e00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015573.706055:0:11384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c5041e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.706066:0:11384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c5041e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.706089:0:11384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c5041e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.706097:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e688cd9f/0xb1a5ef690c5041e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015573.706214:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+21:2354:x1872772280719872:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 2635us (2728us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015573.706225:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 481 00000100:00100000:1.0:1786015573.726716:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.726997:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304476288:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015573.727034:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5041dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015573.727233:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280720128 00000100:00100000:3.0:1786015573.727244:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280720128 00000100:00100000:3.0:1786015573.727315:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1651 00000100:00100000:3.0:1786015573.727327:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+89:33517:x1872772280720128:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786015573.727439:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5041eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.727458:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5041c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96db expref: 89 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.727469:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5041eb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.727514:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5041c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96db expref: 89 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.727529:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5041c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96db expref: 89 pid: 7673 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015573.727546:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304476416:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015573.727653:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b7e16180 going to sleep for 11 seconds 00000100:00100000:3.0:1786015573.746062:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304476416:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015573.746106:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5041eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015573.746214:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.746250:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.746279:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.746374:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280720512 00000100:00100000:1.0:1786015573.746385:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280720512 00000100:00100000:1.0:1786015573.746461:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1652 00000100:00100000:1.0:1786015573.746470:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+90:33519:x1872772280720512:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786015573.746512:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x35:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786015573.746645:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+90:33519:x1872772280720512:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 175us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015573.746654:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1652 00000100:00100000:3.0:1786015573.747374:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280720384 00000100:00100000:3.0:1786015573.747384:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280720384 00010000:00010000:3.0:1786015573.747419:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5041c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96db expref: 90 pid: 7673 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015573.747455:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280720256 00000100:00100000:3.0:1786015573.747459:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280720256 00010000:00010000:3.0:1786015573.747474:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2800/0xb1a5ef690c5041b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96d4 expref: 91 pid: 5795 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015573.747499:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 478 00000100:00100000:3.0:1786015573.747507:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+91:2353:x1872772280720384:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015573.747521:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015573.747529:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5041c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96db expref: 91 pid: 7673 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.747542:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5041c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96db expref: 91 pid: 7673 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.747570:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbde00/0xb1a5ef690c5041c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96db expref: 91 pid: 7673 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.747590:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8b749302f200) 00010000:00010000:3.0:1786015573.747595:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5041eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.747611:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5041eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.747619:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5041eb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.747645:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015573.747688:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+90:2353:x1872772280720384:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 182us (1788us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015573.747695:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 478 00000100:00100000:3.0:1786015573.747713:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 479 00000100:00100000:3.0:1786015573.747719:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+89:2351:x1872772280720256:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015573.747807:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015573.747823:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2800/0xb1a5ef690c5041b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96d4 expref: 89 pid: 5795 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.747835:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2800/0xb1a5ef690c5041b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96d4 expref: 89 pid: 5795 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.747848:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2800/0xb1a5ef690c5041b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96d4 expref: 89 pid: 5795 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.747858:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8b749302fe00) 00010000:00010000:3.0:1786015573.747863:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5041dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.747870:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5041dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.747877:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5041dd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.747893:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015573.748166:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5041eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.748175:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5041eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.748435:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5041eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.748445:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5041eb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.748452:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5041eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.748464:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015573.748468:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5041eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.748476:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5041eb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.748487:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8b749302f200) 00010000:00010000:0.0:1786015573.748490:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015573.748494:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5041eb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.748500:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c5041eb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015573.748624:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+89:33517:x1872772280720128:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 21298us (21923us total) trans 4294968363 rc 0/0 00000100:00100000:0.0:1786015573.748633:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1651 00000100:00100000:3.0:1786015573.749018:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+88:2351:x1872772280720256:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 193us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015573.749027:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 479 00010000:00010000:2.0:1786015573.749335:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5041dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.749344:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5041dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.749479:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5041dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.749487:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5041dd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.749493:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5041dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.749499:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384bbc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015573.749504:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5041dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.749511:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5041dd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.749522:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8b749302fe00) 00010000:00010000:2.0:1786015573.749525:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786015573.749529:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5041dd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.749534:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbc200/0xb1a5ef690c5041dd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015573.759810:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+88:33518:x1872772280719744:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 57067us (58639us total) trans 4294968364 rc 0/0 00000100:00100000:3.0:1786015573.759838:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1650 00000100:00100000:0.0:1786015573.765248:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.765332:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015573.765618:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280720896 00000100:00100000:3.0:1786015573.765631:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280720896 00000100:00100000:3.0:1786015573.765740:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 334 00000100:00100000:3.0:1786015573.765752:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+88:33518:x1872772280720896:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786015573.766126:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+89:33518:x1872772280720896:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 376us (792us total) trans 4294968365 rc 0/0 00000100:00100000:3.0:1786015573.766135:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 334 00000100:00100000:1.0:1786015573.766946:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280720640 00000100:00100000:1.0:1786015573.766960:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280720640 00000100:00100000:1.0:1786015573.767017:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 482 00000100:00100000:1.0:1786015573.767026:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+21:2352:x1872772280720640:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015573.767077:0:22346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5041f2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.767100:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786015573.767105:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015573.767114:0:22346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5041f2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.767133:0:22346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5041f2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.767490:0:22346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5041f2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.767501:0:22346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5041f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.767510:0:22346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5041f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.767519:0:22346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015573.767524:0:22346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5041f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.767533:0:22346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5041f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.767554:0:22346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5041f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.767562:0:22346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5041f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015573.767647:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+21:2352:x1872772280720640:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 622us (2415us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015573.767655:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 482 00000100:00100000:0.0:1786015573.769399:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.769479:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280721152 00000100:00100000:2.0:1786015573.769492:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280721152 00000100:00100000:2.0:1786015573.769573:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 335 00000100:00100000:2.0:1786015573.769585:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916a2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+89:33517:x1872772280721152:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786015573.770124:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916a2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+90:33517:x1872772280721152:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 538us (732us total) trans 4294968366 rc 0/0 00000100:00100000:2.0:1786015573.770133:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 335 00000100:00100000:0.0:1786015573.772788:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.773062:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280721408 00000100:00100000:2.0:1786015573.773075:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280721408 00000100:00100000:2.0:1786015573.773158:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1653 00000100:00100000:2.0:1786015573.773170:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+90:33519:x1872772280721408:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1786015573.773599:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c5041f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.773624:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833ce00/0xb1a5ef690c5041cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96e2 expref: 90 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.773635:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c5041f9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.773685:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833ce00/0xb1a5ef690c5041cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96e2 expref: 90 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.773702:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833ce00/0xb1a5ef690c5041cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96e2 expref: 90 pid: 5794 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015573.773720:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8979500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304476544:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015573.775848:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb000 going to sleep for 11 seconds 00000100:00100000:3.0:1786015573.784851:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.785070:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280721536 00000100:00100000:0.0:1786015573.785085:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280721536 00000100:00100000:0.0:1786015573.785168:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1654 00000100:00100000:0.0:1786015573.785180:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+115:33522:x1872772280721536:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1786015573.785210:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015573.785240:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c800/0xb1a5ef690c504200 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e96e9 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.785360:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504207 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.785378:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504207 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.785397:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504207 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.785415:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c400/0xb1a5ef690c50420e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.785422:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c400/0xb1a5ef690c50420e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.785429:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c400/0xb1a5ef690c50420e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.785558:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d000/0xb1a5ef690c504215 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.785567:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d000/0xb1a5ef690c504215 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.785575:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d000/0xb1a5ef690c504215 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015573.785618:0:7673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x37:0x0]: returning size 158 00000004:00200000:0.0:1786015573.785624:0:7673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786015573.785646:0:7673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d000/0xb1a5ef690c504215 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.785664:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d000/0xb1a5ef690c504215 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.785674:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504207 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.785682:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504207 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.785690:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504207 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.785697:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833da00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015573.785702:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504207 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.785711:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504207 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.786001:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015573.786005:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015573.786011:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504207 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.786019:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504207 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.786035:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c400/0xb1a5ef690c50420e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.786041:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c400/0xb1a5ef690c50420e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.786048:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c400/0xb1a5ef690c50420e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.786053:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833c400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015573.786056:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c400/0xb1a5ef690c50420e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.786062:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c400/0xb1a5ef690c50420e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.786069:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff8b749302f300) 00010000:00010000:0.0:1786015573.786072:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015573.786074:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c400/0xb1a5ef690c50420e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.786080:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c400/0xb1a5ef690c50420e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.786118:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c800/0xb1a5ef690c504200 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96e9 expref: 117 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.786134:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d000/0xb1a5ef690c504215 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96e9 expref: 116 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.786263:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8b749302f100) 00010000:00010000:0.0:1786015573.786267:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015573.786270:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b748833d000, rc 0) 00000100:00100000:0.0:1786015573.786490:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+116:33522:x1872772280721536:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1312us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015573.786503:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1654 00000100:00100000:2.0:1786015573.790547:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015573.790650:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8979500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304476544:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015573.790686:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c5041f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015573.790788:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280721664 00000100:00100000:0.0:1786015573.790798:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280721664 00010000:00010000:0.0:1786015573.790850:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833ce00/0xb1a5ef690c5041cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96e2 expref: 91 pid: 5794 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015573.790895:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 480 00000100:00100000:0.0:1786015573.790906:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+91:2354:x1872772280721664:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015573.790935:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015573.790944:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833ce00/0xb1a5ef690c5041cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96e2 expref: 91 pid: 5794 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.790958:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833ce00/0xb1a5ef690c5041cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96e2 expref: 91 pid: 5794 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.790989:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833ce00/0xb1a5ef690c5041cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96e2 expref: 91 pid: 5794 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.791007:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8b7487f06500) 00010000:00010000:0.0:1786015573.791014:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c5041f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.791026:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c5041f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.791035:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c5041f9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.791064:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015573.791145:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+90:2354:x1872772280721664:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 240us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015573.791153:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 480 00010000:00010000:3.0:1786015573.791376:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c5041f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.791385:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c5041f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.791658:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c5041f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.791668:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c5041f9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.791675:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c5041f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.791682:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bfec3c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015573.791687:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c5041f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.791696:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c5041f9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.791707:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8b7487f06500) 00010000:00010000:3.0:1786015573.791710:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786015573.791715:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c5041f9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.791722:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c5041f9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015573.791900:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+90:33519:x1872772280721408:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 18732us (19152us total) trans 4294968367 rc 0/0 00000100:00100000:3.0:1786015573.791923:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1653 00000040:00080000:0.0:1786015573.793539:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015573.793550:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015573.793595:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 54 count 12 00000040:00080000:0.0:1786015573.793605:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015573.794298:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.794710:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9ac000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304476672:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786015573.794849:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74853d03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015573.795818:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280721792 00000100:00100000:1.0:1786015573.795831:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280721792 00000100:00100000:1.0:1786015573.795895:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 483 00000100:00100000:1.0:1786015573.795916:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2352:x1872772280721792:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015573.795939:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015573.795963:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c50421c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e96f0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015573.796030:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304476800:192.168.202.56@tcp:106: 00000100:00100000:1.0:1786015573.796107:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359180 going to sleep for 11 seconds 00000100:00100000:3.0:1786015573.796825:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.797483:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280722048 00000100:00100000:1.0:1786015573.797494:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280722048 00000100:00100000:1.0:1786015573.797574:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 336 00000100:00100000:1.0:1786015573.797585:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+91:33519:x1872772280722048:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786015573.797972:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+92:33519:x1872772280722048:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 388us (1148us total) trans 4294968368 rc 0/0 00000100:00100000:1.0:1786015573.797981:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 336 00000100:00100000:3.0:1786015573.805361:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.805631:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9ac000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304476672:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786015573.806018:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280722176 00000100:00100000:2.0:1786015573.806028:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280722176 00000100:00100000:2.0:1786015573.806107:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1655 00000100:00100000:2.0:1786015573.806118:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+91:33523:x1872772280722176:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015573.806170:0:12526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x36:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015573.806318:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+91:33523:x1872772280722176:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 202us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015573.806327:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1655 00002000:00010000:1.0:1786015573.808185:0:6592:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1786015573.808195:0:6592:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb mtime: 0 -> 1786015573 00002000:00010000:1.0:1786015573.808197:0:6592:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb atime: 0 -> 1786015573 00002000:00010000:1.0:1786015573.808199:0:6592:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb ctime: 0 -> 1786015573 00000100:00100000:1.0:1786015573.808229:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304476800:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015573.808277:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c50421c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96f0 expref: 18 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.808309:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c50421c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96f0 expref: 18 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.808326:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920200, rc 0) 00000100:00100000:1.0:1786015573.808396:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2352:x1872772280721792:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 12490us (14104us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015573.808406:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 483 00000100:00100000:3.0:1786015573.813939:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.814053:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280722432 00000100:00100000:2.0:1786015573.814068:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280722432 00000100:00100000:2.0:1786015573.814147:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1656 00000100:00100000:2.0:1786015573.814159:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+91:33523:x1872772280722432:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015573.814204:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.814236:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2a00/0xb1a5ef690c504223 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e96f7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.814378:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50422a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.814394:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50422a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.814409:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50422a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015573.814423:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x36:0x0]: returning size 158 00010000:00010000:2.0:1786015573.814593:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2a00/0xb1a5ef690c504223 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96f7 expref: 94 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.814615:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50422a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96f7 expref: 93 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.814625:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff8b749302f000) 00010000:00010000:2.0:1786015573.814629:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786015573.814633:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bfec3400, rc 0) 00000100:00100000:2.0:1786015573.814723:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+93:33523:x1872772280722432:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 566us (799us total) trans 4294968369 rc 0/0 00000100:00100000:2.0:1786015573.814743:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1656 00000100:00100000:3.0:1786015573.818538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.818636:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280722560 00000100:00100000:2.0:1786015573.818651:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280722560 00000100:00100000:2.0:1786015573.818746:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1657 00000100:00100000:2.0:1786015573.818795:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+116:33522:x1872772280722560:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1786015573.818832:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.818862:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3e00/0xb1a5ef690c504238 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e96fe expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.818994:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3800/0xb1a5ef690c50423f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.819011:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3800/0xb1a5ef690c50423f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.819025:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3800/0xb1a5ef690c50423f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786015573.819098:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 7680 00000004:00200000:2.0:1786015573.819102:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 10 stripe count 1 MDT count 1 00000004:00010000:2.0:1786015573.819127:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3800/0xb1a5ef690c50423f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.819170:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3e00/0xb1a5ef690c504238 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96fe expref: 118 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.819191:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3800/0xb1a5ef690c50423f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96fe expref: 117 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.819201:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:2.0:1786015573.819204:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786015573.819208:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bfec3800, rc 0) 00000100:00100000:2.0:1786015573.819278:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+117:33522:x1872772280722560:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 522us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015573.819285:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1657 00000100:00100000:1.0:1786015573.823112:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.823161:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015573.823286:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280722688 00000100:00100000:3.0:1786015573.823301:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280722688 00000100:00100000:3.0:1786015573.823376:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 484 00000100:00100000:3.0:1786015573.823387:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+19:2353:x1872772280722688:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786015573.823452:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fffe0ac0/0xb1a5ef690c504246 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.823478:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbe0f01d/0xb1a5ef690c504040 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9610 expref: 19 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.823489:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x21:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786015573.823493:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786015573.823499:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fffe0ac0/0xb1a5ef690c504246 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.823546:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bbe0f01d/0xb1a5ef690c504040 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9610 expref: 19 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.823564:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bbe0f01d/0xb1a5ef690c504040 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9610 expref: 19 pid: 6591 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015573.823581:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304476928:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015573.823682:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b7e16180 going to sleep for 11 seconds 00000100:00100000:0.0:1786015573.828980:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280722816 00000100:00100000:0.0:1786015573.829002:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280722816 00000100:00100000:0.0:1786015573.829113:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 83 00000100:00100000:0.0:1786015573.829126:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+93:2354:x1872772280722816:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015573.830596:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015573.830652:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50422a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96f7 expref: 93 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.830680:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff8b749302f000) 00010000:00010000:0.0:1786015573.830686:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015573.830827:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+92:2354:x1872772280722816:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1702us (7663us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015573.830837:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 83 00000100:00100000:3.0:1786015573.831211:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.831254:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280722944 00000100:00100000:1.0:1786015573.831263:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280722944 00000100:00100000:3.0:1786015573.831299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.831318:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 485 00000100:00100000:1.0:1786015573.831328:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280722944:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1786015573.831349:0:22346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015573.831371:0:22346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c50424d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9705 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015573.831401:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304476928:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015573.831432:0:11384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fffe0ac0/0xb1a5ef690c504246 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015573.831442:0:22346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22346:1872772304477056:192.168.202.56@tcp:106: 00000100:00100000:0.0:1786015573.831586:0:17970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280723072 00000100:00100000:0.0:1786015573.831592:0:17970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280723072 00002000:00100000:0.0:1786015573.831637:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x21:0x0] (0->157) req@ffff8b7381b29500 x1872772280723072/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:419/0 lens 648/0 e 0 to 0 dl 1786015584 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015573.831647:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381b29500 with x1872772280723072 ext(0->157) 00010000:00010000:0.0:1786015573.831655:0:17970:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bbe0f01d/0xb1a5ef690c504040 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9610 expref: 20 pid: 6591 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.831670:0:17970:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bbe0f01d/0xb1a5ef690c504040 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9610 expref: 20 pid: 6591 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015573.831680:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b7381b29500 00000100:00100000:0.0:1786015573.831707:0:17970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:0.0:1786015573.831715:0:17970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+20:2354:x1872772280723072:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:1.0:1786015573.831901:0:22346:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359180 going to sleep for 11 seconds 00000100:00100000:0.0:1786015573.832648:0:17970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+22:2354:x1872772280723072:12345-192.168.202.56@tcp:4:cp.0 Request processed in 929us (1343us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1786015573.832659:0:17970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 23 00002000:00100000:0.0:1786015573.832668:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x21:0x0] (0->157) req@ffff8b7381b29500 x1872772280723072/t4294967380(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:419/0 lens 648/448 e 0 to 0 dl 1786015584 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015573.832689:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381b29500 with x1872772280723072 ext(0->157) 00010000:00010000:0.0:1786015573.832699:0:17970:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bbe0f01d/0xb1a5ef690c504040 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9610 expref: 22 pid: 6591 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.832714:0:17970:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bbe0f01d/0xb1a5ef690c504040 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9610 expref: 22 pid: 6591 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786015573.832862:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8b7381b29500 00000100:00100000:1.0:1786015573.836920:0:22346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22346:1872772304477056:192.168.202.56@tcp:106: 00010000:00010000:1.0:1786015573.836970:0:22346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c50424d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9705 expref: 18 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.837005:0:22346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c50424d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9705 expref: 18 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.837021:0:22346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920200, rc 0) 00000100:00100000:1.0:1786015573.854394:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280722944:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 23047us (23164us total) trans 0 rc 301/301 00000100:00100000:1.0:1786015573.854414:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 485 00000100:00100000:2.0:1786015573.855101:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.855408:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.855448:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280723456 00000100:00100000:0.0:1786015573.855462:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280723456 00000100:00100000:0.0:1786015573.855547:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1658 00000100:00100000:0.0:1786015573.855559:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+117:33522:x1872772280723456:12345-192.168.202.56@tcp:58:lfs.0 00000100:00100000:1.0:1786015573.855664:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280723200 00000100:00100000:1.0:1786015573.855670:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280723200 00010000:00010000:2.0:1786015573.857496:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bbe0f01d/0xb1a5ef690c504040 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9610 expref: 22 pid: 6591 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015573.857572:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 481 00000100:00100000:2.0:1786015573.857584:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+22:2351:x1872772280723200:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015573.857603:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015573.857632:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bbe0f01d/0xb1a5ef690c504040 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9610 expref: 22 pid: 6591 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.857649:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bbe0f01d/0xb1a5ef690c504040 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9610 expref: 22 pid: 6591 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.857692:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbe0f01d/0xb1a5ef690c504040 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9610 expref: 22 pid: 6591 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.857714:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786015573.857721:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786015573.857739:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fffe0ac0/0xb1a5ef690c504246 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.857796:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fffe0ac0/0xb1a5ef690c504246 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.857845:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015573.858251:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+21:2351:x1872772280723200:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 667us (3151us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015573.858261:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 481 00010000:00010000:2.0:1786015573.858300:0:11384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fffe0ac0/0xb1a5ef690c504246 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.858310:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fffe0ac0/0xb1a5ef690c504246 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.858341:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fffe0ac0/0xb1a5ef690c504246 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.858351:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fffe0ac0/0xb1a5ef690c504246 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.858361:0:11384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fffe0ac0/0xb1a5ef690c504246 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.858374:0:11384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afca00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015573.858378:0:11384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fffe0ac0/0xb1a5ef690c504246 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.858394:0:11384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fffe0ac0/0xb1a5ef690c504246 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.858407:0:11384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fffe0ac0/0xb1a5ef690c504246 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.858415:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fffe0ac0/0xb1a5ef690c504246 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015573.858477:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+20:2353:x1872772280722688:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 35092us (35391us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015573.858487:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 484 00000040:00080000:0.0:1786015573.858592:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].54, 136 off15536 00000100:00100000:0.0:1786015573.858674:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+117:33522:x1872772280723456:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 3118us (3266us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015573.858683:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1658 00000100:00100000:3.0:1786015573.863750:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.864140:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280723712 00000100:00100000:1.0:1786015573.864154:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280723712 00000100:00100000:1.0:1786015573.864233:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1659 00000100:00100000:1.0:1786015573.864246:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+92:33523:x1872772280723712:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786015573.864403:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+92:33523:x1872772280723712:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 160us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015573.864411:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1659 00010000:00010000:2.0:1786015573.869796:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015573.870889:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.871131:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280723840 00000100:00100000:2.0:1786015573.871146:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280723840 00000100:00100000:2.0:1786015573.871228:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 486 00000100:00100000:2.0:1786015573.871242:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+20:2351:x1872772280723840:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015573.871270:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015573.871297:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000177f7c8/0xb1a5ef690c504254 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e970c expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015573.871332:0:14547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 158, mtime: 0x6a746f55, atime: 0x0, ctime: 0x6a746f55, blocks: 0x1 00010000:00010000:2.0:1786015573.871362:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1786015573.871368:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015573.871380:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000177f7c8/0xb1a5ef690c504254 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e970c expref: 21 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.871402:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000177f7c8/0xb1a5ef690c504254 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e970c expref: 21 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.871418:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bfec3e00, rc 0) 00000100:00100000:2.0:1786015573.871499:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+21:2351:x1872772280723840:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 260us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015573.871516:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 486 00000100:00100000:0.0:1786015573.877682:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015573.878060:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280724096 00000100:00100000:3.0:1786015573.878075:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280724096 00000100:00100000:3.0:1786015573.878167:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1660 00000100:00100000:3.0:1786015573.878180:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+92:33523:x1872772280724096:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786015573.878333:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+92:33523:x1872772280724096:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 155us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015573.878341:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1660 00000100:00100000:3.0:1786015573.885869:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.886013:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280724224 00000100:00100000:0.0:1786015573.886028:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280724224 00002000:00100000:0.0:1786015573.886111:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x21:0x0] (0->4095) req@ffff8b7381b28a80 x1872772280724224/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:419/0 lens 488/0 e 0 to 0 dl 1786015584 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015573.886126:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381b28a80 with x1872772280724224 ext(0->4095) 00002000:00010000:0.0:1786015573.886134:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7381b28a80 00000100:00100000:0.0:1786015573.886178:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 135 00000100:00100000:0.0:1786015573.886191:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+21:2351:x1872772280724224:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1786015573.886477:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+21:2351:x1872772280724224:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 287us (621us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786015573.886485:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 135 00002000:00100000:0.0:1786015573.886492:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x21:0x0] (0->4095) req@ffff8b7381b28a80 x1872772280724224/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:419/0 lens 488/4536 e 0 to 0 dl 1786015584 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786015573.887205:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b7381b28a80 with x1872772280724224 ext(0->4095) 00002000:00010000:0.0:1786015573.887212:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b7381b28a80 00000100:00100000:0.0:1786015573.903240:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015573.905158:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280724352 00000100:00100000:1.0:1786015573.905179:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280724352 00000100:00100000:1.0:1786015573.905322:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1661 00000100:00100000:1.0:1786015573.905335:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+92:33523:x1872772280724352:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786015573.905364:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015573.905393:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50425b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9713 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.905442:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c504262 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.905459:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c504262 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.905473:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c504262 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.905608:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c50425b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9713 expref: 94 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.905633:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c504262 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9713 expref: 93 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015573.905642:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff8b749302f000) 00010000:00010000:1.0:1786015573.905646:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786015573.905649:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921600, rc 0) 00000100:00100000:1.0:1786015573.908404:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+93:33523:x1872772280724352:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 428us (2583us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015573.908426:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1661 00000100:00100000:2.0:1786015573.931370:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015573.931497:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280724480 00000100:00100000:3.0:1786015573.931510:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280724480 00000100:00100000:3.0:1786015573.931589:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1662 00000100:00100000:3.0:1786015573.931601:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+93:33523:x1872772280724480:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786015573.931647:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x36:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786015573.931864:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+93:33523:x1872772280724480:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 265us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015573.931874:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1662 00000100:00100000:3.0:1786015573.946152:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.946600:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280724608 00000100:00100000:2.0:1786015573.946615:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280724608 00000100:00100000:2.0:1786015573.946708:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 487 00000100:00100000:2.0:1786015573.946719:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+21:2354:x1872772280724608:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786015573.946841:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c98c21d/0xb1a5ef690c504269 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.946864:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015573.946869:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015573.946876:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c98c21d/0xb1a5ef690c504269 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.946893:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c98c21d/0xb1a5ef690c504269 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.949048:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c98c21d/0xb1a5ef690c504269 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.949074:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c98c21d/0xb1a5ef690c504269 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.949085:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c98c21d/0xb1a5ef690c504269 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.949105:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bfec3a00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015573.949111:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c98c21d/0xb1a5ef690c504269 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.949121:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c98c21d/0xb1a5ef690c504269 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.949144:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c98c21d/0xb1a5ef690c504269 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.949152:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c98c21d/0xb1a5ef690c504269 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015573.949296:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+21:2354:x1872772280724608:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 2572us (3153us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015573.949308:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 487 00000100:00100000:0.0:1786015573.973249:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015573.973473:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280724864 00000100:00100000:2.0:1786015573.973486:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280724864 00000100:00100000:2.0:1786015573.973568:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1663 00000100:00100000:2.0:1786015573.973581:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+93:33523:x1872772280724864:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1786015573.973702:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504270 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.973722:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c504262 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9713 expref: 93 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.973743:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504270 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.973842:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c504262 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9713 expref: 93 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015573.973858:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c504262 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9713 expref: 93 pid: 5794 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015573.973877:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304477184:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015573.974643:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb180 going to sleep for 11 seconds 00000100:00100000:2.0:1786015573.994850:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015573.995009:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304477184:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015573.995047:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504270 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015573.995382:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280724992 00000100:00100000:3.0:1786015573.995392:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280724992 00010000:00010000:3.0:1786015573.995439:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c504262 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9713 expref: 94 pid: 5794 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015573.995485:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 482 00000100:00100000:3.0:1786015573.995496:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748821d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+94:2354:x1872772280724992:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015573.995525:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015573.995534:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c504262 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9713 expref: 94 pid: 5794 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.995549:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c504262 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9713 expref: 94 pid: 5794 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.995578:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921600/0xb1a5ef690c504262 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9713 expref: 94 pid: 5794 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.995598:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff8b749302f000) 00010000:00010000:3.0:1786015573.995604:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504270 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.995616:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504270 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.995625:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504270 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015573.995658:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015573.995738:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748821d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+93:2354:x1872772280724992:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 231us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015573.995747:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 482 00010000:00010000:0.0:1786015573.996149:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504270 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.996158:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504270 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.996439:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504270 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.996448:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504270 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.996454:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504270 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.996461:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bfec3400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015573.996466:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504270 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.996475:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504270 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.996491:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff8b749302f000) 00010000:00010000:0.0:1786015573.996493:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015573.996497:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504270 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015573.996502:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504270 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015573.996670:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+93:33523:x1872772280724864:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 23090us (23433us total) trans 4294968370 rc 0/0 00000100:00100000:0.0:1786015573.996680:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1663 00000040:00080000:1.0:1786015573.997258:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015573.997264:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015573.997338:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 13 00000040:00080000:1.0:1786015573.997345:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015573.997601:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304477312:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786015573.997673:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359180 going to sleep for 11 seconds 00000100:00100000:3.0:1786015574.030966:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015574.031321:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1872772304477312:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786015574.033369:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280725120 00000100:00100000:2.0:1786015574.033391:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280725120 00000100:00100000:2.0:1786015574.033505:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1664 00000100:00100000:2.0:1786015574.033527:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+93:33533:x1872772280725120:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786015574.033580:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x37:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786015574.033798:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+93:33533:x1872772280725120:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 245us (2809us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015574.033810:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1664 00000100:00080000:1.0:1786015574.036647:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015574.037453:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015574.039424:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280725376 00000100:00100000:1.0:1786015574.039443:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280725376 00000100:00100000:1.0:1786015574.039543:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 337 00000100:00100000:1.0:1786015574.039564:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+93:33523:x1872772280725376:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786015574.040179:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015574.040353:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280725632 00000100:00100000:0.0:1786015574.040360:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280725632 00000100:00100000:0.0:1786015574.040410:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1665 00000100:00100000:0.0:1786015574.040420:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+94:33533:x1872772280725632:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786015574.040434:0:12526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015574.040462:0:12526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504277 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e971a expref: -99 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.040584:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c50427e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.040602:0:12526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c50427e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.040616:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c50427e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786015574.040631:0:12526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x37:0x0]: returning size 158 00010000:00010000:0.0:1786015574.040868:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504277 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e971a expref: 97 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.040892:0:12526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c50427e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e971a expref: 96 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.040901:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8b749302f100) 00010000:00010000:0.0:1786015574.040904:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786015574.041239:0:12526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b748833c000, rc 0) 00000100:00100000:0.0:1786015574.041320:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+96:33533:x1872772280725632:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 900us (1141us total) trans 4294968371 rc 0/0 00000100:00100000:0.0:1786015574.041329:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1665 00000100:00100000:1.0:1786015574.076168:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+96:33523:x1872772280725376:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 36595us (38702us total) trans 4294968372 rc 0/0 00000100:00100000:1.0:1786015574.076311:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 337 00000100:00100000:2.0:1786015574.077491:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015574.077667:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280725760 00000100:00100000:0.0:1786015574.077690:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280725760 00000100:00100000:0.0:1786015574.077835:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 84 00000100:00100000:0.0:1786015574.077848:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+96:2352:x1872772280725760:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015574.077870:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015574.077916:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c50427e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e971a expref: 96 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.077938:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8b749302f100) 00010000:00010000:0.0:1786015574.077944:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015574.096601:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+95:2352:x1872772280725760:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 18736us (19096us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015574.096623:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 84 00000100:00100000:2.0:1786015574.110215:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015574.114062:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280725888 00000100:00100000:0.0:1786015574.114086:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280725888 00000100:00080000:1.0:1786015574.114391:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015574.114712:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 488 00000100:00100000:0.0:1786015574.114740:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+21:2354:x1872772280725888:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786015574.115031:0:22346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d18f53ba/0xb1a5ef690c50428c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.115059:0:22346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c5041a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96cd expref: 21 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.115070:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x24:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786015574.115076:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786015574.115082:0:22346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d18f53ba/0xb1a5ef690c50428c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.115355:0:22346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c5041a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96cd expref: 21 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.115375:0:22346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c5041a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96cd expref: 21 pid: 6590 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015574.115393:0:22346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fde680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22346:1872772304477440:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015574.115503:0:22346:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74853d00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786015574.131332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015574.131567:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280726016 00000100:00100000:3.0:1786015574.131581:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280726016 00002000:00100000:3.0:1786015574.131649:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x24:0x0] (0->157) req@ffff8b738394b480 x1872772280726016/t0(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:420/0 lens 648/0 e 0 to 0 dl 1786015585 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015574.131669:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b738394b480 with x1872772280726016 ext(0->157) 00010000:00010000:3.0:1786015574.131682:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c5041a5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96cd expref: 22 pid: 6590 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015574.131704:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c5041a5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96cd expref: 22 pid: 6590 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015574.131713:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b738394b480 00000100:00100000:3.0:1786015574.131828:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:3.0:1786015574.131840:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+22:2354:x1872772280726016:12345-192.168.202.56@tcp:4:cp.0 00000100:00100000:3.0:1786015574.132932:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+24:2354:x1872772280726016:12345-192.168.202.56@tcp:4:cp.0 Request processed in 1087us (1609us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1786015574.132945:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 24 00002000:00100000:3.0:1786015574.132957:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x24:0x0] (0->157) req@ffff8b738394b480 x1872772280726016/t4294967395(0) o4->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:420/0 lens 648/448 e 0 to 0 dl 1786015585 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015574.132967:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b738394b480 with x1872772280726016 ext(0->157) 00010000:00010000:3.0:1786015574.132976:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c5041a5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96cd expref: 24 pid: 6590 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015574.132994:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c5041a5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96cd expref: 24 pid: 6590 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786015574.133002:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b738394b480 00000100:00100000:3.0:1786015574.133081:0:22346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fde680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22346:1872772304477440:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015574.136386:0:22346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d18f53ba/0xb1a5ef690c50428c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015574.145615:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015574.145833:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280726144 00000100:00100000:1.0:1786015574.145847:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280726144 00010000:00010000:1.0:1786015574.145902:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c5041a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96cd expref: 24 pid: 6590 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015574.146006:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 483 00000100:00100000:1.0:1786015574.146019:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+24:2353:x1872772280726144:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015574.146039:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015574.146070:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c5041a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96cd expref: 24 pid: 6590 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015574.146087:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c5041a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96cd expref: 24 pid: 6590 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015574.146129:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c5041a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96cd expref: 24 pid: 6590 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015574.146159:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015574.146164:0:17038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786015574.146171:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d18f53ba/0xb1a5ef690c50428c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015574.146303:0:17038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d18f53ba/0xb1a5ef690c50428c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015574.146347:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015574.146420:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+23:2353:x1872772280726144:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 404us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015574.146430:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 483 00010000:00010000:0.0:1786015574.148254:0:22346:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d18f53ba/0xb1a5ef690c50428c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.148279:0:22346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d18f53ba/0xb1a5ef690c50428c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.148327:0:22346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d18f53ba/0xb1a5ef690c50428c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.148337:0:22346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d18f53ba/0xb1a5ef690c50428c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.148347:0:22346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d18f53ba/0xb1a5ef690c50428c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.148356:0:22346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833d200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015574.148361:0:22346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d18f53ba/0xb1a5ef690c50428c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.148371:0:22346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d18f53ba/0xb1a5ef690c50428c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.148397:0:22346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d18f53ba/0xb1a5ef690c50428c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.148405:0:22346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d18f53ba/0xb1a5ef690c50428c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015574.148544:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+22:2354:x1872772280725888:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 33807us (38329us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015574.148568:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 488 00000100:00100000:2.0:1786015574.159506:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015574.161052:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280726400 00000100:00100000:1.0:1786015574.161069:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280726400 00000100:00100000:1.0:1786015574.161154:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1666 00000100:00100000:1.0:1786015574.161166:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+95:33533:x1872772280726400:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786015574.163743:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+95:33533:x1872772280726400:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 2552us (4226us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015574.163775:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1666 00000100:00100000:0.0:1786015574.202828:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015574.206428:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280726528 00000100:00100000:2.0:1786015574.206449:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280726528 00000100:00100000:2.0:1786015574.206543:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 489 00000100:00100000:2.0:1786015574.206564:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+22:2353:x1872772280726528:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786015574.206591:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015574.206620:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1d7b915/0xb1a5ef690c504293 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9721 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786015574.206652:0:14547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 158, mtime: 0x6a746f55, atime: 0x0, ctime: 0x6a746f55, blocks: 0x1 00010000:00010000:2.0:1786015574.207039:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=809s v=(0 0) 00010000:00010000:2.0:1786015574.207045:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015574.207056:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1d7b915/0xb1a5ef690c504293 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9721 expref: 23 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015574.207078:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d1d7b915/0xb1a5ef690c504293 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9721 expref: 23 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015574.207095:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bfec2800, rc 0) 00000100:00100000:2.0:1786015574.207256:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+23:2353:x1872772280726528:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 701us (4440us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015574.207268:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 489 00000100:00100000:0.0:1786015574.211348:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015574.211601:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280726784 00000100:00100000:2.0:1786015574.211613:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280726784 00000100:00100000:2.0:1786015574.211694:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1667 00000100:00100000:2.0:1786015574.211707:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+95:33533:x1872772280726784:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786015574.211951:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+95:33533:x1872772280726784:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 246us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015574.211960:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1667 00000100:00100000:0.0:1786015574.251311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015574.251461:0:17970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280726912 00000100:00100000:1.0:1786015574.251477:0:17970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280726912 00002000:00100000:1.0:1786015574.251534:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24:0x0] (0->4095) req@ffff8b74c0cf3b80 x1872772280726912/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:420/0 lens 488/0 e 0 to 0 dl 1786015585 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786015574.251546:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c0cf3b80 with x1872772280726912 ext(0->4095) 00002000:00010000:1.0:1786015574.251553:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74c0cf3b80 00000100:00100000:1.0:1786015574.251592:0:17970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 136 00000100:00100000:1.0:1786015574.252199:0:17970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+23:2351:x1872772280726912:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1786015574.253887:0:17970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+23:2351:x1872772280726912:12345-192.168.202.56@tcp:3:lhsmtool_posix.0 Request processed in 2271us (2579us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786015574.253905:0:17970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 136 00002000:00100000:3.0:1786015574.253921:0:17970:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24:0x0] (0->4095) req@ffff8b74c0cf3b80 x1872772280726912/t0(0) o3->60d0ccd6-6e87-411c-bc51-c64181e59585@192.168.202.56@tcp:420/0 lens 488/4536 e 0 to 0 dl 1786015585 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786015574.253933:0:17970:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8b74c0cf3b80 with x1872772280726912 ext(0->4095) 00002000:00010000:3.0:1786015574.253941:0:17970:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8b74c0cf3b80 00000100:00100000:0.0:1786015574.281355:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015574.282027:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280727040 00000100:00100000:3.0:1786015574.282043:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280727040 00000100:00100000:3.0:1786015574.282128:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1668 00000100:00100000:3.0:1786015574.282140:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+95:33533:x1872772280727040:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786015574.282171:0:7673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786015574.282376:0:7673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50429a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9728 expref: -99 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015574.282432:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5042a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015574.282451:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5042a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015574.282464:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5042a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015574.282759:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afca00/0xb1a5ef690c50429a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9728 expref: 97 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015574.282825:0:7673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5042a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9728 expref: 96 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015574.282835:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8b749302f100) 00010000:00010000:3.0:1786015574.282839:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786015574.282844:0:7673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7384afc200, rc 0) 00000100:00100000:3.0:1786015574.283085:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+96:33533:x1872772280727040:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 946us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015574.283103:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1668 00000100:00100000:2.0:1786015574.309895:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015574.310289:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280727168 00000100:00100000:1.0:1786015574.310305:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280727168 00000100:00100000:1.0:1786015574.310380:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1669 00000100:00100000:1.0:1786015574.310392:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+96:33533:x1872772280727168:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786015574.310438:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x37:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786015574.310599:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+96:33533:x1872772280727168:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 209us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015574.310608:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1669 00000100:00100000:0.0:1786015574.336394:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015574.337715:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280727296 00000100:00100000:1.0:1786015574.337787:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280727296 00000100:00100000:1.0:1786015574.337896:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 490 00000100:00100000:1.0:1786015574.338028:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+23:2352:x1872772280727296:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786015574.338264:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5042a8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015574.338288:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015574.338293:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015574.338301:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5042a8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015574.338318:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5042a8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015574.338370:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5042a8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015574.338380:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5042a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015574.338389:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5042a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015574.338397:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015574.338403:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5042a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015574.338414:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5042a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015574.338433:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5042a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015574.338442:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004efa5a1c/0xb1a5ef690c5042a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015574.340409:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+23:2352:x1872772280727296:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 2485us (4010us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015574.340425:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 490 00000100:00100000:1.0:1786015574.344535:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015574.345038:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280727552 00000100:00100000:0.0:1786015574.345052:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280727552 00000100:00100000:0.0:1786015574.345142:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1670 00000100:00100000:0.0:1786015574.345155:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+96:33533:x1872772280727552:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786015574.345279:0:12526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5042af lrc: 3/0,1 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.345303:0:12526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5042a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9728 expref: 96 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.345313:0:12526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5042af lrc: 4/0,1 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.345360:0:12526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5042a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9728 expref: 96 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.345378:0:12526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5042a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9728 expref: 96 pid: 7673 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015574.345397:0:12526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af068700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304477568:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015574.345522:0:12526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74853d0240 going to sleep for 11 seconds 00000100:00100000:0.0:1786015574.350192:0:12526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af068700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12526:1872772304477568:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015574.350239:0:12526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5042af lrc: 3/0,1 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015574.355743:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015574.355998:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280727680 00000100:00100000:3.0:1786015574.356014:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280727680 00010000:00010000:3.0:1786015574.356076:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5042a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9728 expref: 97 pid: 7673 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015574.356135:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 484 00000100:00100000:3.0:1786015574.356146:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+97:2354:x1872772280727680:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015574.356169:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015574.356191:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5042a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9728 expref: 97 pid: 7673 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015574.356208:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5042a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9728 expref: 97 pid: 7673 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015574.356241:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c5042a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9728 expref: 97 pid: 7673 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015574.356262:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8b749302f100) 00010000:00010000:3.0:1786015574.356268:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5042af lrc: 3/0,1 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015574.356279:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5042af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015574.356288:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5042af lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015574.356319:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015574.356380:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+96:2354:x1872772280727680:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 235us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015574.356388:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 484 00010000:00010000:0.0:1786015574.356785:0:12526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5042af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.356796:0:12526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5042af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.357085:0:12526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5042af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.357161:0:12526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5042af lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.357169:0:12526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5042af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.357176:0:12526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833c000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015574.357349:0:12526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5042af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.357358:0:12526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5042af lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.357372:0:12526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8b749302f100) 00010000:00010000:0.0:1786015574.357375:0:12526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786015574.357381:0:12526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5042af lrc: 2/0,0 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015574.357387:0:12526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5042af lrc: 0/0,0 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015574.357583:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+96:33533:x1872772280727552:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 12426us (13069us total) trans 4294968373 rc 0/0 00000100:00100000:0.0:1786015574.357595:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1670 00000040:00080000:3.0:1786015574.359597:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015574.359612:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015574.360152:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 13 00000040:00080000:3.0:1786015574.360166:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015574.394406:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015574.394538:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280727936 00000100:00100000:0.0:1786015574.394553:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280727936 00000100:00100000:0.0:1786015574.394662:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 338 00000100:00100000:0.0:1786015574.394673:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+96:33533:x1872772280727936:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786015574.395065:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+97:33533:x1872772280727936:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 392us (674us total) trans 4294968374 rc 0/0 00000100:00100000:0.0:1786015574.395074:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 338 00010000:00010000:2.0:1786015574.892996:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015575.383047:0:22384:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015575.383064:0:22384:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015575.383177:0:22384:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 13 00000040:00080000:0.0:1786015575.383187:0:22384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015575.453867:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015575.453912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015575.453939:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015575.453966:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280728064 00000100:00100000:0.0:1786015575.453975:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280728064 00000100:00100000:0.0:1786015575.454030:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280728192 00000100:00100000:0.0:1786015575.454033:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280728192 00000100:00100000:0.0:1786015575.454053:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280728320 00000100:00100000:0.0:1786015575.454056:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280728320 00000100:00100000:0.0:1786015575.454075:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 491 00000100:00100000:0.0:1786015575.454084:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+16:2353:x1872772280728064:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:0.0:1786015575.454102:0:22346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015575.454123:0:22346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008996879c/0xb1a5ef690c5042b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e972f expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015575.454166:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1786015575.454171:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015575.454183:0:22346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008996879c/0xb1a5ef690c5042b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e972f expref: 17 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015575.454203:0:22346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008996879c/0xb1a5ef690c5042b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e972f expref: 17 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015575.454218:0:22346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b748833ce00, rc 0) 00000100:00100000:0.0:1786015575.454281:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280728064:12345-192.168.202.56@tcp:101:rm.0 Request processed in 194us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015575.454289:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 491 00000100:00100000:0.0:1786015575.454312:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 492 00000100:00100000:0.0:1786015575.454319:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280728192:12345-192.168.202.56@tcp:101:ll_agl.0 00010000:00010000:0.0:1786015575.454328:0:22346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015575.454339:0:22346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c9f2760/0xb1a5ef690c5042bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9736 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015575.454354:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1786015575.454357:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015575.454362:0:22346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c9f2760/0xb1a5ef690c5042bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9736 expref: 19 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015575.454381:0:22346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c9f2760/0xb1a5ef690c5042bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9736 expref: 19 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015575.454391:0:22346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b748833c800, rc 0) 00000100:00100000:0.0:1786015575.454416:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+19:2354:x1872772280728192:12345-192.168.202.56@tcp:101:ll_agl.0 Request processed in 96us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015575.454424:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 492 00000100:00100000:2.0:1786015575.454447:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 493 00000100:00100000:2.0:1786015575.454468:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280728320:12345-192.168.202.56@tcp:101:ll_sa.0 00010000:00010000:2.0:1786015575.454485:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1786015575.454785:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015575.454792:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786015575.456861:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000984e36bc/0xb1a5ef690c5042c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e973d expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.456925:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1786015575.456930:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015575.456945:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000984e36bc/0xb1a5ef690c5042c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e973d expref: 19 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.456968:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000984e36bc/0xb1a5ef690c5042c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e973d expref: 19 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.456990:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bfec2000, rc 0) 00000100:00100000:2.0:1786015575.457073:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+19:2353:x1872772280728320:12345-192.168.202.56@tcp:101:ll_sa.0 Request processed in 2610us (3129us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015575.457099:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 493 00000100:00100000:2.0:1786015575.457329:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015575.457442:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015575.457481:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015575.457596:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015575.457629:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280728448 00000100:00100000:2.0:1786015575.457639:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280728448 00000100:00100000:2.0:1786015575.457696:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280728704 00000100:00100000:2.0:1786015575.457700:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280728704 00000100:00100000:2.0:1786015575.458039:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280728576 00000100:00100000:2.0:1786015575.458044:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280728576 00000100:00100000:2.0:1786015575.458056:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280728832 00000100:00100000:2.0:1786015575.458058:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280728832 00000100:00100000:2.0:1786015575.458073:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 494 00000100:00100000:2.0:1786015575.458091:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280728448:12345-192.168.202.56@tcp:101:ll_agl.0 00010000:00010000:2.0:1786015575.458112:0:22346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015575.458133:0:22346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe21abc1/0xb1a5ef690c5042cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9744 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.458158:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1786015575.458162:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015575.458169:0:22346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe21abc1/0xb1a5ef690c5042cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9744 expref: 19 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.458191:0:22346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe21abc1/0xb1a5ef690c5042cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9744 expref: 19 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.458205:0:22346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bfec2600, rc 0) 00000100:00100000:2.0:1786015575.458254:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+19:2354:x1872772280728448:12345-192.168.202.56@tcp:101:ll_agl.0 Request processed in 163us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015575.458261:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 494 00000100:00100000:2.0:1786015575.458281:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 495 00000100:00100000:2.0:1786015575.458287:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280728704:12345-192.168.202.56@tcp:101:ll_agl.0 00010000:00010000:2.0:1786015575.458295:0:22346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015575.458304:0:22346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000782eea5a/0xb1a5ef690c5042d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9752 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.458316:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1786015575.458318:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015575.458324:0:22346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782eea5a/0xb1a5ef690c5042d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9752 expref: 19 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.458334:0:22346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000782eea5a/0xb1a5ef690c5042d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9752 expref: 19 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.458342:0:22346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bfec3000, rc 0) 00000100:00100000:2.0:1786015575.458359:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+19:2354:x1872772280728704:12345-192.168.202.56@tcp:101:ll_agl.0 Request processed in 73us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015575.458368:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 495 00000100:00100000:2.0:1786015575.458381:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 496 00000100:00100000:2.0:1786015575.458386:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+20:2354:x1872772280728576:12345-192.168.202.56@tcp:101:ll_agl.0 00010000:00010000:2.0:1786015575.458392:0:22346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015575.458402:0:22346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae040d64/0xb1a5ef690c5042d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e974b expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.458414:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1786015575.458417:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015575.458422:0:22346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae040d64/0xb1a5ef690c5042d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e974b expref: 21 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.458431:0:22346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ae040d64/0xb1a5ef690c5042d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e974b expref: 21 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.458440:0:22346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bfec2200, rc 0) 00000100:00100000:2.0:1786015575.458456:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+21:2354:x1872772280728576:12345-192.168.202.56@tcp:101:ll_agl.0 Request processed in 70us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015575.458461:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 496 00000100:00100000:2.0:1786015575.458471:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 497 00000100:00100000:2.0:1786015575.458476:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+20:2353:x1872772280728832:12345-192.168.202.56@tcp:101:ll_agl.0 00010000:00010000:2.0:1786015575.458481:0:22346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786015575.458487:0:22346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000713ab4f/0xb1a5ef690c5042e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9759 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.458505:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786015575.458508:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015575.458513:0:22346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000713ab4f/0xb1a5ef690c5042e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9759 expref: 21 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.458523:0:22346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000713ab4f/0xb1a5ef690c5042e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9759 expref: 21 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.458530:0:22346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b74bfec2400, rc 0) 00000100:00100000:2.0:1786015575.458549:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+21:2353:x1872772280728832:12345-192.168.202.56@tcp:101:ll_agl.0 Request processed in 73us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015575.458556:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 497 00000100:00100000:1.0:1786015575.462436:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015575.462488:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015575.462525:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280728960 00000100:00100000:1.0:1786015575.462535:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280728960 00000100:00100000:1.0:1786015575.462580:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280729088 00000100:00100000:1.0:1786015575.462584:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280729088 00000100:00100000:1.0:1786015575.462608:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 498 00000100:00100000:1.0:1786015575.462618:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+20:2354:x1872772280728960:12345-192.168.202.56@tcp:101:ll_agl.0 00010000:00010000:1.0:1786015575.462636:0:14547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015575.462653:0:14547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a0dd624/0xb1a5ef690c5042e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9760 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.462681:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786015575.462686:0:14547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015575.462695:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a0dd624/0xb1a5ef690c5042e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9760 expref: 21 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015575.463420:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 499 00000100:00100000:0.0:1786015575.463437:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+21:2354:x1872772280729088:12345-192.168.202.56@tcp:101:ll_sa.0 00010000:00010000:0.0:1786015575.463449:0:22346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786015575.463461:0:22346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005492c4c6/0xb1a5ef690c5042ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9767 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015575.463478:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1786015575.463482:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015575.463489:0:22346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005492c4c6/0xb1a5ef690c5042ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9767 expref: 22 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015575.463503:0:22346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005492c4c6/0xb1a5ef690c5042ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9767 expref: 22 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015575.463518:0:22346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b748833ca00, rc 0) 00000100:00100000:0.0:1786015575.463589:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+22:2354:x1872772280729088:12345-192.168.202.56@tcp:101:ll_sa.0 Request processed in 159us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015575.463602:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 499 00010000:00010000:1.0:1786015575.464617:0:14547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a0dd624/0xb1a5ef690c5042e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9760 expref: 21 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.464636:0:14547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921c00, rc 0) 00000100:00100000:1.0:1786015575.464689:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+21:2354:x1872772280728960:12345-192.168.202.56@tcp:101:ll_agl.0 Request processed in 2072us (2264us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015575.464697:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 498 00000100:00100000:2.0:1786015575.465103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015575.465223:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280729344 00000100:00100000:1.0:1786015575.465231:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280729344 00000100:00100000:1.0:1786015575.465289:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1671 00000100:00100000:1.0:1786015575.465298:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+117:33534:x1872772280729344:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:1.0:1786015575.465359:0:7673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1786015575.465389:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b400/0xb1a5ef690c50376b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9155 expref: 117 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.465412:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:1.0:1786015575.465428:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3800/0xb1a5ef690c50423f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96fe expref: 116 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.465442:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015575.465446:0:7673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015575.465476:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5042f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.465490:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5042f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.465500:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5042f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.465517:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5042fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.465523:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5042fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.465531:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5042fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.465650:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504303 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.465661:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50373a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9140 expref: 96 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.465669:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504303 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.465705:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50373a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9140 expref: 96 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.465734:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50373a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9140 expref: 96 pid: 5795 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015575.465749:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304477696:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015575.465885:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74c1359600 going to sleep for 11 seconds 00000100:00080000:3.0:1786015575.466407:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015575.471206:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015575.471673:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304477696:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015575.471702:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504303 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015575.471750:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280729472 00000100:00100000:1.0:1786015575.471756:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280729472 00010000:00010000:1.0:1786015575.471818:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50373a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9140 expref: 97 pid: 5795 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015575.471853:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 485 00000100:00100000:1.0:1786015575.471863:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+97:2354:x1872772280729472:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015575.471880:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015575.471886:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50373a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9140 expref: 97 pid: 5795 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.471961:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50373a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9140 expref: 97 pid: 5795 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.471984:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc000/0xb1a5ef690c50373a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9140 expref: 97 pid: 5795 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.472000:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:1.0:1786015575.472004:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504303 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.472013:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504303 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.472021:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504303 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.472043:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015575.472091:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+96:2354:x1872772280729472:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 228us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015575.472098:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 485 00010000:00010000:1.0:1786015575.472122:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504303 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.472128:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504303 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786015575.475350:0:7673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].15, 64 off9176 00000004:00080000:1.0:1786015575.475374:0:7673:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 810726611859ns, next at 811726607942ns, rc = 0 00010000:00010000:1.0:1786015575.475478:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50430a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.475496:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50430a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.475509:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50430a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.475518:0:7673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50430a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.475523:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50430a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.475529:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50430a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.475563:0:7673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786015575.475591:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504303 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.475597:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504303 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.475604:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504303 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.475610:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015575.475615:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504303 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.475623:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504303 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.475635:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:1.0:1786015575.475639:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786015575.475643:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504303 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.475649:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504303 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.475670:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5042f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.475677:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5042f5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.475682:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5042f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.475687:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015575.475690:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5042f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.475696:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5042f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.475704:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015575.475707:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015575.475721:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5042f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.475727:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5042f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786015575.475737:0:7673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000095bf5ec8 reply state 0000000050a792d5 transno 4294968375 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5042fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015575.475745:0:7673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786015575.475859:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+117:33534:x1872772280729344:12345-192.168.202.56@tcp:36:rm.0 Request processed in 10559us (10756us total) trans 4294968375 rc 0/0 00000100:00100000:1.0:1786015575.475868:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1671 00010000:00010000:2.0:1786015575.476786:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786015575.476795:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50430a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.476803:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015575.476808:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50430a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.476817:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50430a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.476830:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8b74b0022600) 00010000:00010000:2.0:1786015575.476834:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786015575.476838:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50430a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.476843:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921200/0xb1a5ef690c50430a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015575.476859:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015575.476860:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015575.476862:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015575.484317:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5042fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.484334:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5042fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.484342:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5042fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.484349:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015575.484354:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5042fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.484362:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5042fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.484381:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff8b748f194400) 00010000:00010000:1.0:1786015575.484384:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015575.484389:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5042fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015575.484395:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920600/0xb1a5ef690c5042fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015575.616045:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015575.616101:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015575.616141:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015575.616177:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280729856 00000100:00100000:1.0:1786015575.616186:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280729856 00000100:00100000:3.0:1786015575.616446:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280729728 00000100:00100000:3.0:1786015575.616451:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280729728 00000100:00100000:3.0:1786015575.616497:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 575 00000100:00100000:0.0:1786015575.616699:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280729600 00000100:00100000:0.0:1786015575.616704:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280729600 00000100:00100000:0.0:1786015575.616749:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 644 00000100:00100000:0.0:1786015575.616800:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280729600:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015575.616889:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280729600:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 130us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015575.616909:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 644 00000100:00100000:1.0:1786015575.617373:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 576 00000100:00100000:1.0:1786015575.617380:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+21:2353:x1872772280729728:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015575.617426:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+21:2353:x1872772280729728:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 45us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015575.617433:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 576 00000100:00100000:3.0:1786015575.617446:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+23:2353:x1872772280729856:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015575.617478:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+23:2353:x1872772280729856:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 107us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015575.617484:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 575 00000100:00080000:3.0:1786015575.618256:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786015575.918398:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015576.236367:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015576.236390:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304477824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015576.236455:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015576.239113:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304477824 00000100:00100000:0.0:1786015576.239127:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304477824 00000100:00100000:0.0:1786015576.239189:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1786015576.239198:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304477824:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786015576.239426:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1786015576.240346:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 108855296 pending 6815744 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015576.240447:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304477824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1248us (3989us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015576.240456:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1786015576.241121:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304477824:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1786015576.380584:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967380 is committed 00000040:00080000:3.0:1786015576.430502:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015576.430513:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015576.438996:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:0.0:1786015576.439019:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1786015576.719533:0:22435:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015576.719545:0:22435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015576.719716:0:22435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:2.0:1786015576.719723:0:22435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015576.854111:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015576.854409:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280730112 00000100:00100000:2.0:1786015576.854420:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280730112 00000100:00100000:2.0:1786015576.854471:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1672 00000100:00100000:2.0:1786015576.854480:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+116:33546:x1872772280730112:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:2.0:1786015576.854540:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015576.854568:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c503859 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91b0 expref: 116 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015576.854587:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:2.0:1786015576.854592:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015576.854616:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504311 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015576.854630:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504311 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015576.854638:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504311 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015576.854654:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2a00/0xb1a5ef690c504318 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015576.854660:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2a00/0xb1a5ef690c504318 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015576.854665:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2a00/0xb1a5ef690c504318 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015576.856295:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50431f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015576.856315:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c50380c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9194 expref: 95 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015576.856322:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50431f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015576.858303:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c50380c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9194 expref: 95 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015576.858341:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c50380c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9194 expref: 95 pid: 7673 timeout: 912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015576.858359:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304477952:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015576.859038:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb540 going to sleep for 11 seconds 00000100:00100000:0.0:1786015576.866584:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015576.866829:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304477952:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015576.866901:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50431f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015576.866932:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280730240 00000100:00100000:1.0:1786015576.866939:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280730240 00010000:00010000:1.0:1786015576.866986:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c50380c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9194 expref: 96 pid: 7673 timeout: 912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015576.867021:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 486 00000100:00100000:1.0:1786015576.867031:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+96:2354:x1872772280730240:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015576.867059:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015576.867068:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c50380c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9194 expref: 96 pid: 7673 timeout: 912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015576.867080:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c50380c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9194 expref: 96 pid: 7673 timeout: 912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015576.867103:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1c00/0xb1a5ef690c50380c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9194 expref: 96 pid: 7673 timeout: 912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015576.867119:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:1.0:1786015576.867124:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50431f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015576.867132:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50431f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015576.867140:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50431f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015576.867177:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786015576.867226:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+95:2354:x1872772280730240:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 196us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015576.867233:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 486 00000100:00080000:1.0:1786015576.867255:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786015576.867380:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50431f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.867388:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50431f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786015576.870522:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].20, 64 off9592 00000004:00080000:0.0:1786015576.870536:0:5795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812121774226ns, next at 813121771274ns, rc = 0 00010000:00010000:0.0:1786015576.870628:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504326 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.870645:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504326 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.870657:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504326 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.870668:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504326 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.870675:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504326 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.870692:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504326 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.870723:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786015576.870747:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50431f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.870754:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50431f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.870777:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50431f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015576.871098:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786015576.871106:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504326 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015576.871114:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833d200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015576.871117:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504326 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015576.871126:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504326 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015576.871139:0:8308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:1.0:1786015576.871142:0:8308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786015576.871146:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504326 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015576.871152:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504326 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015576.871174:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015576.871176:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015576.871177:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015576.873281:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bfec3400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015576.873289:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50431f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.873299:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50431f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.873313:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8b7487f06c00) 00010000:00010000:0.0:1786015576.873317:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786015576.873322:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50431f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.873329:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c50431f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.873359:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504311 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.873366:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504311 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.873383:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504311 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.873389:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bfec3a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015576.873392:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504311 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.873399:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504311 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.873407:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015576.873409:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015576.873413:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504311 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.873418:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504311 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015576.873428:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d00d56ef reply state 00000000af5e136a transno 4294968376 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2a00/0xb1a5ef690c504318 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015576.873438:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015576.873536:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+117:33546:x1872772280730112:12345-192.168.202.56@tcp:36:rm.0 Request processed in 19053us (19433us total) trans 4294968376 rc 0/0 00000100:00100000:0.0:1786015576.873545:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1672 00010000:00010000:3.0:1786015576.878591:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2a00/0xb1a5ef690c504318 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015576.878619:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2a00/0xb1a5ef690c504318 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015576.878626:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2a00/0xb1a5ef690c504318 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015576.878632:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bfec2a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015576.878637:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2a00/0xb1a5ef690c504318 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015576.878645:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2a00/0xb1a5ef690c504318 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015576.878662:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff8b74c21ebe00) 00010000:00010000:3.0:1786015576.878665:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015576.878671:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2a00/0xb1a5ef690c504318 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015576.878677:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec2a00/0xb1a5ef690c504318 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786015576.893188:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967392 is committed 00000001:00080000:2.0:1786015576.893212:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967395 is committed 00000001:00080000:1.0:1786015576.913945:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968374 is committed 00000001:00080000:1.0:1786015576.914020:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968375 is committed 00000004:00080000:1.0:1786015576.914025:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 17 committed 00000100:00100000:2.0:1786015576.916494:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786015576.916516:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304478080:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786015576.916588:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015576.922478:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304478080 00000100:00100000:1.0:1786015576.922494:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304478080 00000100:00100000:1.0:1786015576.922558:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1786015576.922569:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304478080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786015576.922617:0:6591:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:29 count 1 00010000:00010000:1.0:1786015576.922647:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d53db8ae/0xb1a5ef690c50432d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015576.922671:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c503860 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91b7 expref: 12 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015576.922681:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008996879c/0xb1a5ef690c5042b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e972f expref: 20 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015576.922690:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1786015576.922695:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015576.922732:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d53db8ae/0xb1a5ef690c50432d lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015576.922802:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008996879c/0xb1a5ef690c5042b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e972f expref: 20 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015576.922818:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008996879c/0xb1a5ef690c5042b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e972f expref: 20 pid: 22346 timeout: 912 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015576.922834:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304478208:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015576.922950:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c503860 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91b7 expref: 12 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015576.922961:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c503860 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91b7 expref: 12 pid: 14547 timeout: 912 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015576.922972:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304478336:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015576.922998:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786015576.931343:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304478208:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015576.931371:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304478336:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015576.931399:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d53db8ae/0xb1a5ef690c50432d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015576.933712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015576.933802:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015576.933880:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280730496 00000100:00100000:0.0:1786015576.933891:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280730496 00010000:00010000:0.0:1786015576.933939:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c503860 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91b7 expref: 13 pid: 14547 timeout: 912 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015576.933986:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280730368 00000100:00100000:0.0:1786015576.933989:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280730368 00010000:00010000:0.0:1786015576.934006:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008996879c/0xb1a5ef690c5042b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e972f expref: 21 pid: 22346 timeout: 912 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015576.934031:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 487 00000100:00100000:0.0:1786015576.934042:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280730496:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015576.934062:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015576.934069:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c503860 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91b7 expref: 13 pid: 14547 timeout: 912 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.934082:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c503860 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91b7 expref: 13 pid: 14547 timeout: 912 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015576.934087:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 488 00000100:00100000:2.0:1786015576.934096:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748821dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+21:2354:x1872772280730368:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015576.934104:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015576.934109:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008996879c/0xb1a5ef690c5042b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e972f expref: 21 pid: 22346 timeout: 912 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.934109:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cabb5502/0xb1a5ef690c503860 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e91b7 expref: 13 pid: 14547 timeout: 912 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015576.934121:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008996879c/0xb1a5ef690c5042b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e972f expref: 21 pid: 22346 timeout: 912 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015576.947430:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015576.956165:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015576.956264:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2354:x1872772280730496:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 22216us (22605us total) trans 0 rc 0/0 00010000:00010000:2.0:1786015576.956268:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008996879c/0xb1a5ef690c5042b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e972f expref: 21 pid: 22346 timeout: 912 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015576.956276:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 487 00010000:00010000:2.0:1786015576.956286:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015576.956290:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015576.956296:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d53db8ae/0xb1a5ef690c50432d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015576.956305:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d53db8ae/0xb1a5ef690c50432d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015576.956340:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015576.956364:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748821dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+20:2354:x1872772280730368:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 22269us (22562us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015576.957317:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 488 00010000:00010000:0.0:1786015576.957540:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d53db8ae/0xb1a5ef690c50432d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.957554:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d53db8ae/0xb1a5ef690c50432d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.957635:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d53db8ae/0xb1a5ef690c50432d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.957646:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d53db8ae/0xb1a5ef690c50432d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015576.957678:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786015576.959304:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304478080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 36731us (42708us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1786015576.959316:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000004:00080000:1.0:1786015576.959434:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b74aeba2a00/2, rc 0, transno 4294967381 00000100:00100000:1.0:1786015576.959443:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304478080:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1786015576.960486:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786015576.960498:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d53db8ae/0xb1a5ef690c50432d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015576.960513:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920600 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015576.960518:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d53db8ae/0xb1a5ef690c50432d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015576.960529:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d53db8ae/0xb1a5ef690c50432d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015576.960551:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d53db8ae/0xb1a5ef690c50432d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015576.960559:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d53db8ae/0xb1a5ef690c50432d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015576.960658:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015576.960660:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015576.960661:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015577.776400:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304478848:0@lo:400:kworker.0 00000100:00100000:2.0:1786015577.776488:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015577.776548:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786015577.776554:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304478464:0@lo:400:kworker.0 00000100:00100000:2.0:1786015577.776597:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015577.776623:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304478976:0@lo:400:kworker.0 00000100:00100000:2.0:1786015577.776652:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015577.776699:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304478592:0@lo:400:kworker.0 00000100:00100000:2.0:1786015577.776725:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015577.776744:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304479104:0@lo:400:kworker.0 00000100:00100000:2.0:1786015577.777991:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015577.778032:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786015577.778042:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304478720:0@lo:400:kworker.0 00000100:00100000:2.0:1786015577.778080:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015577.778133:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304478464 00000100:00100000:2.0:1786015577.778142:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304478464 00000100:00100000:2.0:1786015577.778200:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:2.0:1786015577.778209:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304478464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015577.778267:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304478464:12345-0@lo:400:kworker.0 Request processed in 59us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015577.778274:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:2.0:1786015577.778307:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304478976 00000100:00100000:2.0:1786015577.778312:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304478976 00000100:00100000:2.0:1786015577.778347:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304478592 00000100:00100000:2.0:1786015577.778350:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304478592 00000100:00100000:2.0:1786015577.778367:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304478720 00000100:00100000:2.0:1786015577.778370:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304478720 00000100:00100000:2.0:1786015577.778387:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1786015577.778393:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304478976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015577.778426:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304478976:12345-0@lo:400:kworker.0 Request processed in 33us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015577.778432:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1786015577.778443:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1786015577.778449:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304478592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015577.778481:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304478592:12345-0@lo:400:kworker.0 Request processed in 32us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015577.778488:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1786015577.778499:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:2.0:1786015577.778505:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304478720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015577.778529:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304478720:12345-0@lo:400:kworker.0 Request processed in 25us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015577.778535:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:2.0:1786015577.778591:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304478464:0@lo:400:kworker.0 00000100:00100000:2.0:1786015577.778607:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304478976:0@lo:400:kworker.0 00000100:00100000:2.0:1786015577.778649:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304478720:0@lo:400:kworker.0 00000100:00100000:2.0:1786015577.778659:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304478592:0@lo:400:kworker.0 00000100:00100000:1.0:1786015577.778800:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304478848 00000100:00100000:1.0:1786015577.778807:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304478848 00000100:00100000:1.0:1786015577.778844:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304479104 00000100:00100000:1.0:1786015577.778847:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304479104 00000100:00100000:1.0:1786015577.778885:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1786015577.778893:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304478848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015577.778942:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304478848:12345-0@lo:400:kworker.0 Request processed in 49us (2454us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015577.778949:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1786015577.778962:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1786015577.778968:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304479104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015577.779002:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304479104:12345-0@lo:400:kworker.0 Request processed in 34us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015577.779009:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00080000:1.0:1786015577.779032:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015577.779036:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015577.779059:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304478848:0@lo:400:kworker.0 00000100:00100000:1.0:1786015577.779083:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304479104:0@lo:400:kworker.0 00000040:00080000:3.0:1786015577.963585:0:22488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015577.963598:0:22488:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015577.963682:0:22488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:3.0:1786015577.963705:0:22488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786015577.971086:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015578.009507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015578.009921:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280730752 00000100:00100000:3.0:1786015578.009930:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280730752 00000100:00100000:3.0:1786015578.009989:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1673 00000100:00100000:3.0:1786015578.009997:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+115:33557:x1872772280730752:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:3.0:1786015578.010071:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015578.010107:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6000/0xb1a5ef690c50398d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9227 expref: 115 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015578.010125:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8b749232d500) 00010000:00010000:3.0:1786015578.010130:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015578.010155:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c504334 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015578.010169:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c504334 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015578.010179:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c504334 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015578.010193:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50433b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015578.010201:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50433b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015578.010212:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50433b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015578.010327:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504342 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015578.010335:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503939 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9204 expref: 58 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015578.010340:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504342 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015578.010371:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503939 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9204 expref: 58 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015578.010384:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503939 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9204 expref: 58 pid: 12526 timeout: 913 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015578.010400:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8979180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304479232:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015578.010487:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382d069c0 going to sleep for 11 seconds 00000100:00080000:1.0:1786015578.010746:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015578.019834:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8979180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304479232:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015578.019873:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504342 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015578.021513:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015578.021552:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280730880 00000100:00100000:3.0:1786015578.021564:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280730880 00010000:00010000:3.0:1786015578.021623:0:6607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503939 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9204 expref: 59 pid: 12526 timeout: 913 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015578.021661:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 489 00000100:00100000:3.0:1786015578.021670:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+59:2353:x1872772280730880:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015578.021700:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015578.021708:0:6607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503939 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9204 expref: 59 pid: 12526 timeout: 913 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015578.021722:0:6607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503939 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9204 expref: 59 pid: 12526 timeout: 913 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015578.021744:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7000/0xb1a5ef690c503939 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9204 expref: 59 pid: 12526 timeout: 913 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015578.021780:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8b749232d500) 00010000:00010000:3.0:1786015578.021786:0:6607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504342 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015578.021796:0:6607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504342 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015578.021804:0:6607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504342 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015578.021834:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015578.021882:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+58:2353:x1872772280730880:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 212us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015578.021889:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 489 00010000:00010000:0.0:1786015578.021905:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504342 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015578.021912:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504342 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786015578.022497:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1786015578.022667:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].16, 64 off9240 00000004:00080000:0.0:1786015578.022695:0:5796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 813273917038ns, next at 814273913885ns, rc = 0 00010000:00010000:0.0:1786015578.022801:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c504349 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015578.022814:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c504349 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015578.022823:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c504349 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015578.022830:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c504349 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015578.022836:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c504349 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015578.022843:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c504349 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015578.022863:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786015578.022886:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504342 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015578.022892:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504342 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015578.022899:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504342 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015578.022904:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015578.022909:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504342 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015578.022917:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504342 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015578.022928:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8b749232d500) 00010000:00010000:0.0:1786015578.022931:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786015578.022935:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504342 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015578.022941:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786015578.022942:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504342 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015578.022949:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c504349 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015578.022954:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833cc00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015578.022958:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c504349 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015578.022963:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c504334 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015578.022964:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c504349 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015578.022970:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c504334 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015578.022975:0:8308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8b749232d500) 00010000:00010000:2.0:1786015578.022978:0:8308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786015578.022978:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c504334 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015578.022981:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c504349 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015578.022984:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015578.022987:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c504334 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015578.022988:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c504349 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015578.022994:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c504334 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015578.022999:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015578.023001:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015578.023002:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015578.023004:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015578.023005:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c504334 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015578.023006:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015578.023010:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c504334 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015578.023021:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ea5c176 reply state 000000000e7bffe2 transno 4294968377 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50433b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015578.023032:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015578.023114:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+116:33557:x1872772280730752:12345-192.168.202.56@tcp:36:rm.0 Request processed in 13114us (13613us total) trans 4294968377 rc 0/0 00000100:00100000:0.0:1786015578.023123:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1673 00010000:00010000:1.0:1786015578.034442:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50433b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015578.034470:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50433b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015578.034478:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50433b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015578.034485:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015578.034491:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50433b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015578.034499:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50433b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015578.034519:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff8b7483ce2000) 00010000:00010000:1.0:1786015578.034523:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015578.034528:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50433b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015578.034535:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50433b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786015578.284044:0:7781:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 813535279105ns, next at 814535275841ns, rc = 0 00000100:00100000:1.0:1786015578.284072:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015578.284096:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304479360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015578.284186:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015578.284256:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304479360 00000100:00100000:1.0:1786015578.284264:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304479360 00000100:00100000:1.0:1786015578.284322:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1786015578.284331:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304479360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015578.284590:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015578.284649:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304479360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 317us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015578.284656:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1786015578.284728:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304479360:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786015578.989211:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015579.470614:0:22540:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015579.470625:0:22540:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015579.470712:0:22540:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:2.0:1786015579.470720:0:22540:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015579.545543:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015579.547227:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280731136 00000100:00100000:2.0:1786015579.547355:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280731136 00000100:00100000:2.0:1786015579.547434:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1674 00000100:00100000:2.0:1786015579.547446:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+115:33567:x1872772280731136:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:2.0:1786015579.547510:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786015579.547538:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c503ab3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e932a expref: 115 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015579.547560:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8b7482d4bb00) 00010000:00010000:2.0:1786015579.547565:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786015579.547591:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504350 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015579.547605:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504350 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015579.547615:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504350 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015579.547638:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504357 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015579.547646:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015579.547653:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015579.547795:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c50435e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015579.547807:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92a5 expref: 57 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015579.547815:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c50435e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015579.547847:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92a5 expref: 57 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015579.547859:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92a5 expref: 57 pid: 12526 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015579.547873:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304479488:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015579.547970:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb480 going to sleep for 11 seconds 00000100:00100000:2.0:1786015579.561230:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304479488:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015579.561267:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c50435e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015579.564991:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015579.565039:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280731264 00000100:00100000:0.0:1786015579.565049:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280731264 00010000:00010000:0.0:1786015579.565091:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92a5 expref: 58 pid: 12526 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015579.565136:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 490 00000100:00100000:0.0:1786015579.565146:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+58:2354:x1872772280731264:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015579.565162:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015579.565170:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92a5 expref: 58 pid: 12526 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.565182:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92a5 expref: 58 pid: 12526 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.565203:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca6c00/0xb1a5ef690c503a58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e92a5 expref: 58 pid: 12526 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.565410:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8b7482d4bb00) 00010000:00010000:0.0:1786015579.565418:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c50435e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.565430:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c50435e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.565437:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c50435e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.565465:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015579.565519:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+57:2354:x1872772280731264:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 374us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015579.565527:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 490 00010000:00010000:0.0:1786015579.565639:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c50435e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.565648:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c50435e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786015579.570056:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].21, 64 off9656 00000004:00080000:0.0:1786015579.570071:0:5795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 814821308570ns, next at 815821305155ns, rc = 0 00010000:00010000:0.0:1786015579.570150:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504365 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.570168:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504365 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.570181:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504365 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.570191:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504365 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.570198:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504365 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.570205:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504365 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.570638:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786015579.570668:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c50435e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.570685:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c50435e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.570692:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c50435e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.570699:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bfec3c00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015579.570704:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c50435e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.570710:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c50435e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.570724:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8b7482d4bb00) 00010000:00010000:0.0:1786015579.570727:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786015579.570732:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c50435e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.570738:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3c00/0xb1a5ef690c50435e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.570787:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504350 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.570795:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504350 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.570801:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504350 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.570806:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bfec3a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015579.570809:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504350 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.570816:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504350 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.570828:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015579.570830:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015579.570834:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504350 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015579.570839:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3a00/0xb1a5ef690c504350 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015579.570850:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000047c71ee6 reply state 00000000206b6383 transno 4294968378 ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015579.570858:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015579.571444:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+116:33567:x1872772280731136:12345-192.168.202.56@tcp:36:rm.0 Request processed in 23995us (25906us total) trans 4294968378 rc 0/0 00000100:00100000:0.0:1786015579.571454:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1674 00010000:00010000:2.0:1786015579.572952:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786015579.573005:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504365 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015579.573018:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833da00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015579.573022:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504365 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015579.573047:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504365 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015579.573062:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8b7482d4bb00) 00010000:00010000:2.0:1786015579.573065:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786015579.573069:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504365 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015579.573075:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c504365 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015579.573104:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015579.573106:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015579.573107:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015579.581397:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015579.581412:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504357 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015579.581418:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504357 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015579.581423:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bfec3400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015579.581427:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504357 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015579.581432:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504357 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015579.581448:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff8b7491fe1b00) 00010000:00010000:3.0:1786015579.581450:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015579.581454:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504357 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015579.581458:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bfec3400/0xb1a5ef690c504357 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015580.012321:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015580.735369:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015580.735420:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015580.735448:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015580.735475:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015580.735495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015580.735512:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015580.735529:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015580.735570:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280731776 00000100:00100000:1.0:1786015580.736053:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280731776 00000100:00100000:1.0:1786015580.736139:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280732032 00000100:00100000:1.0:1786015580.736150:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280732032 00000100:00100000:1.0:1786015580.736195:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280731648 00000100:00100000:1.0:1786015580.736199:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280731648 00000100:00100000:1.0:1786015580.736214:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280732160 00000100:00100000:1.0:1786015580.736216:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280732160 00000100:00100000:1.0:1786015580.736234:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 579 00000100:00100000:1.0:1786015580.736244:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+21:2351:x1872772280731776:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015580.736743:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+21:2351:x1872772280731776:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 498us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015580.736785:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 579 00000100:00100000:1.0:1786015580.736816:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 580 00000100:00100000:1.0:1786015580.736825:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2351:x1872772280732032:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015580.737131:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2351:x1872772280732032:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 305us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015580.737139:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 580 00000100:00100000:1.0:1786015580.737159:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 581 00000100:00100000:1.0:1786015580.737166:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+20:2351:x1872772280731648:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015580.737198:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+20:2351:x1872772280731648:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (1701us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015580.737211:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 581 00000100:00100000:1.0:1786015580.737653:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 582 00000100:00100000:2.0:1786015580.737814:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280731520 00000100:00100000:2.0:1786015580.737822:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280731520 00000100:00100000:2.0:1786015580.737897:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280731904 00000100:00100000:2.0:1786015580.737901:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280731904 00000100:00100000:1.0:1786015580.737967:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2351:x1872772280732160:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015580.738043:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2351:x1872772280732160:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 382us (2511us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015580.738051:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 582 00000100:00100000:1.0:1786015580.738080:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280731392 00000100:00100000:1.0:1786015580.738083:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280731392 00000100:00100000:1.0:1786015580.738111:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 646 00000100:00100000:1.0:1786015580.738117:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280731392:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015580.738142:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280731392:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (2666us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015580.738148:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 646 00000100:00080000:1.0:1786015580.738195:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015580.738199:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015580.738202:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015580.749933:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 571 00000100:00100000:2.0:1786015580.749961:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+115:2351:x1872772280731520:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015580.750104:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+115:2351:x1872772280731520:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 155us (14746us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015580.750114:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 571 00000100:00100000:2.0:1786015580.750136:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 572 00000100:00100000:2.0:1786015580.750145:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+57:2351:x1872772280731904:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015580.750176:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+57:2351:x1872772280731904:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (14662us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015580.750196:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 572 00000040:00080000:0.0:1786015580.927888:0:22591:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015580.927899:0:22591:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015580.927982:0:22591:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:0.0:1786015580.927990:0:22591:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015581.037699:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015581.043356:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015581.044549:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280732416 00000100:00100000:0.0:1786015581.044569:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280732416 00000100:00100000:0.0:1786015581.044625:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1675 00000100:00100000:0.0:1786015581.044634:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+115:33577:x1872772280732416:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:0.0:1786015581.044712:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015581.044741:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd800/0xb1a5ef690c503baf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e938c expref: 115 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.044793:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8b749802ea00) 00010000:00010000:0.0:1786015581.044798:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015581.044823:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c50436c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.044835:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c50436c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.044845:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c50436c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.044858:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833dc00/0xb1a5ef690c504373 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.044865:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833dc00/0xb1a5ef690c504373 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.044871:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833dc00/0xb1a5ef690c504373 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.044967:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d600/0xb1a5ef690c50437a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.044976:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c503b69 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9370 expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.044984:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d600/0xb1a5ef690c50437a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.045025:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c503b69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9370 expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.045040:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c503b69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9370 expref: 56 pid: 5796 timeout: 916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015581.045054:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f1a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304479616:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015581.045481:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0174a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786015581.057737:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015581.057901:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280732544 00000100:00100000:1.0:1786015581.057911:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280732544 00000100:00100000:1.0:1786015581.057974:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 91 00000100:00100000:1.0:1786015581.057985:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:41677fca-39fb-471c-b582-96bce6540a36+115:2351:x1872772280732544:12345-192.168.202.56@tcp:63:ll_sa.0 00010000:00010000:1.0:1786015581.058023:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015581.058044:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504381 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e976e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058109:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c504388 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058124:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c504388 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058135:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c504388 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058148:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50438f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058154:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50438f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058159:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50438f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058222:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c504388 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058231:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c504388 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058242:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c504388 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058247:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015581.058252:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c504388 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058271:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c504388 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058283:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015581.058286:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015581.058290:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c504388 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058296:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c504388 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058310:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50438f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058315:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50438f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058320:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50438f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058325:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015581.058329:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50438f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058338:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50438f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058346:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xbb834312 (ffff8b748f194600) 00010000:00010000:1.0:1786015581.058348:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015581.058351:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50438f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058357:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c50438f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058386:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504381 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e976e expref: 116 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058396:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015581.058398:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786015581.058402:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c504381 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e976e expref: 116 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.058411:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921000, rc -2) 00000100:00100000:1.0:1786015581.058466:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:41677fca-39fb-471c-b582-96bce6540a36+115:2351:x1872772280732544:12345-192.168.202.56@tcp:63:ll_sa.0 Request processed in 483us (741us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786015581.058474:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 91 00000100:00100000:3.0:1786015581.071595:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015581.071742:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015581.071796:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280732800 00000100:00100000:3.0:1786015581.071806:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280732800 00010000:00010000:3.0:1786015581.071854:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c503b69 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9370 expref: 57 pid: 5796 timeout: 916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015581.071904:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 491 00000100:00100000:3.0:1786015581.071916:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+57:2354:x1872772280732800:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015581.071939:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015581.071947:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c503b69 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9370 expref: 57 pid: 5796 timeout: 916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015581.071961:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c503b69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9370 expref: 57 pid: 5796 timeout: 916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015581.071984:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8b749802ea00) 00010000:00010000:3.0:1786015581.071989:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d600/0xb1a5ef690c50437a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015581.071999:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d600/0xb1a5ef690c50437a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015581.072006:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d600/0xb1a5ef690c50437a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015581.072025:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015581.072092:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+57:2354:x1872772280732800:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 178us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015581.072109:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 491 00000100:00100000:1.0:1786015581.072264:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280732672 00000100:00100000:1.0:1786015581.072269:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280732672 00000100:00100000:1.0:1786015581.072308:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 501 00000100:00100000:1.0:1786015581.072315:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+21:2353:x1872772280732672:12345-192.168.202.56@tcp:101:ll_sa.0 00010000:00010000:1.0:1786015581.072331:0:11384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015581.072346:0:11384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c504396 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e9783 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.072366:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=7s v=(0 0) 00010000:00010000:1.0:1786015581.072370:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015581.072378:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c504396 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9783 expref: 22 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.072393:0:11384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f4e4284e/0xb1a5ef690c504396 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9783 expref: 22 pid: 11384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.072404:0:11384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383920e00, rc 0) 00000100:00100000:1.0:1786015581.072432:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+22:2353:x1872772280732672:12345-192.168.202.56@tcp:101:ll_sa.0 Request processed in 118us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015581.072438:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 501 00010000:00010000:0.0:1786015581.072886:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9600/0xb1a5ef690c503b69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9370 expref: 56 pid: 5796 timeout: 916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015581.072902:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f1a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304479616:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015581.072923:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d600/0xb1a5ef690c50437a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.072931:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d600/0xb1a5ef690c50437a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.072937:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d600/0xb1a5ef690c50437a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786015581.073869:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].17, 64 off9304 00000004:00080000:0.0:1786015581.073880:0:5795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 816325117991ns, next at 817325115837ns, rc = 0 00010000:00010000:0.0:1786015581.073947:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c600/0xb1a5ef690c50439d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.073960:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c600/0xb1a5ef690c50439d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.073970:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c600/0xb1a5ef690c50439d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.073978:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c600/0xb1a5ef690c50439d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.073985:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c600/0xb1a5ef690c50439d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.073991:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c600/0xb1a5ef690c50439d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.074015:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786015581.074038:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d600/0xb1a5ef690c50437a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.074044:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d600/0xb1a5ef690c50437a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.074052:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d600/0xb1a5ef690c50437a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.074057:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833d600 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015581.074061:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d600/0xb1a5ef690c50437a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.074069:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d600/0xb1a5ef690c50437a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.074078:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8b749802ea00) 00010000:00010000:0.0:1786015581.074081:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786015581.074085:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d600/0xb1a5ef690c50437a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.074338:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d600/0xb1a5ef690c50437a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.074358:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c50436c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.074364:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c50436c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.074370:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c50436c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.074375:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833da00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015581.074379:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c50436c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.074384:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c50436c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.074393:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015581.074396:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015581.074399:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c50436c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.074404:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833da00/0xb1a5ef690c50436c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015581.074414:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003da484e2 reply state 00000000151e0845 transno 4294968379 ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833dc00/0xb1a5ef690c504373 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015581.074422:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015581.074495:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+116:33577:x1872772280732416:12345-192.168.202.56@tcp:36:rm.0 Request processed in 29859us (31146us total) trans 4294968379 rc 0/0 00000100:00100000:0.0:1786015581.074502:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1675 00010000:00010000:0.0:1786015581.074533:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786015581.074540:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c600/0xb1a5ef690c50439d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.074546:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833c600 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015581.074549:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c600/0xb1a5ef690c50439d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.074556:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c600/0xb1a5ef690c50439d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.074564:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8b749802ea00) 00010000:00010000:0.0:1786015581.074567:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786015581.074570:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c600/0xb1a5ef690c50439d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.074575:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c600/0xb1a5ef690c50439d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015581.074593:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015581.074595:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015581.074596:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015581.076830:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833dc00/0xb1a5ef690c504373 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015581.077558:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833dc00/0xb1a5ef690c504373 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015581.077567:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833dc00/0xb1a5ef690c504373 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015581.077579:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833dc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015581.077584:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833dc00/0xb1a5ef690c504373 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015581.077603:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833dc00/0xb1a5ef690c504373 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015581.077619:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8b749302f400) 00010000:00010000:3.0:1786015581.077623:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015581.077627:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833dc00/0xb1a5ef690c504373 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015581.077633:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833dc00/0xb1a5ef690c504373 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015581.357223:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304479744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015581.357309:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015581.357423:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304479744 00000100:00100000:0.0:1786015581.357431:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304479744 00000100:00100000:0.0:1786015581.357487:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1786015581.357496:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304479744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015581.357533:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015581.357816:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304479744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 320us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015581.357824:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1786015581.358293:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015581.358538:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304479744:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1786015581.489096:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967381 is committed 00000001:00080000:0.0:1786015581.980109:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968379 is committed 00000004:00080000:0.0:1786015581.980127:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 19 committed 00000004:00080000:0.0:1786015581.980152:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 27 committed 00000004:00080000:0.0:1786015581.980171:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 18 committed 00000004:00080000:0.0:1786015581.980176:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 25 committed 00000004:00080000:0.0:1786015581.980183:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 26 committed 00000100:00100000:1.0:1786015581.980379:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786015581.980402:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304479872:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786015581.980481:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015581.980562:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304480000:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786015581.980599:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015581.980634:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304479872 00000100:00100000:1.0:1786015581.980642:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304479872 00000100:00100000:1.0:1786015581.980700:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304480000 00000100:00100000:1.0:1786015581.980704:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304480000 00000100:00100000:1.0:1786015581.980728:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1786015581.980737:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1872772304479872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786015581.980792:0:6592:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:32 count 1 00010000:00010000:1.0:1786015581.980821:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c5043a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.980857:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000286d08cf/0xb1a5ef690c50394e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9212 expref: 14 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.980869:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c9f2760/0xb1a5ef690c5042bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9736 expref: 21 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.980877:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=7s v=(0 0) 00010000:00010000:1.0:1786015581.980882:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015581.980887:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c5043a4 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.980915:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c9f2760/0xb1a5ef690c5042bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9736 expref: 21 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.980932:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c9f2760/0xb1a5ef690c5042bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9736 expref: 21 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015581.980944:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304480128:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015581.981018:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000286d08cf/0xb1a5ef690c50394e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9212 expref: 14 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.981035:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000286d08cf/0xb1a5ef690c50394e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9212 expref: 14 pid: 6591 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015581.981045:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304480256:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015581.981069:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb4480 going to sleep for 11 seconds 00000100:00100000:1.0:1786015581.981087:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:1.0:1786015581.981095:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304480000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786015581.981108:0:22346:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:33 count 1 00010000:00010000:1.0:1786015581.981121:0:22346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c5043ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.981134:0:22346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000733bf407/0xb1a5ef690c503cf8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9442 expref: 14 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.981141:0:22346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000984e36bc/0xb1a5ef690c5042c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e973d expref: 21 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.981147:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=7s v=(0 0) 00010000:00010000:1.0:1786015581.981150:0:22346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015581.981153:0:22346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c5043ab lrc: 5/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.981171:0:22346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000984e36bc/0xb1a5ef690c5042c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e973d expref: 21 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.981186:0:22346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000984e36bc/0xb1a5ef690c5042c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e973d expref: 21 pid: 14547 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015581.981197:0:22346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22346:1872772304480384:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015581.981230:0:22346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000733bf407/0xb1a5ef690c503cf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9442 expref: 14 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.981240:0:22346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000733bf407/0xb1a5ef690c503cf8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9442 expref: 14 pid: 14547 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015581.981250:0:22346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22346:1872772304480512:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015581.981272:0:22346:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb4840 going to sleep for 11 seconds 00000100:00080000:1.0:1786015581.981284:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015581.982281:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304480768:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1786015581.982321:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015581.982350:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015581.982385:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304480768 00000100:00100000:1.0:1786015581.982392:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304480768 00000100:00100000:1.0:1786015581.982429:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1786015581.982437:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304480768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786015581.982458:0:11384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:31 count 1 00010000:00010000:1.0:1786015581.982477:0:11384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001933ae34/0xb1a5ef690c5043b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.982491:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d08a9211/0xb1a5ef690c503cea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9434 expref: 11 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.982505:0:11384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005492c4c6/0xb1a5ef690c5042ee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9767 expref: 19 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.982511:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=7s v=(0 0) 00010000:00010000:1.0:1786015581.982514:0:11384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015581.982518:0:11384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001933ae34/0xb1a5ef690c5043b2 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015581.982647:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304480640:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786015581.982685:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015581.982798:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304480640 00000100:00100000:2.0:1786015581.982802:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304480640 00000100:00100000:2.0:1786015581.982826:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:2.0:1786015581.982845:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304480640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1786015581.982858:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:30 count 1 00010000:00010000:2.0:1786015581.982871:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000398818e/0xb1a5ef690c5043b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015581.982883:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503cf1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e943b expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015581.982891:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe21abc1/0xb1a5ef690c5042cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9744 expref: 19 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015581.982896:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=7s v=(0 0) 00010000:00010000:2.0:1786015581.982899:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786015581.982902:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000398818e/0xb1a5ef690c5043b9 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015581.982927:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe21abc1/0xb1a5ef690c5042cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9744 expref: 19 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015581.982939:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe21abc1/0xb1a5ef690c5042cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9744 expref: 19 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015581.982951:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304480896:192.168.202.56@tcp:104: 00010000:00010000:2.0:1786015581.983013:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503cf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e943b expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015581.983023:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503cf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e943b expref: 11 pid: 6591 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015581.983033:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304481024:192.168.202.56@tcp:104: 00000100:00100000:2.0:1786015581.983054:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cbb540 going to sleep for 11 seconds 00010000:00010000:1.0:1786015581.984268:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005492c4c6/0xb1a5ef690c5042ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9767 expref: 19 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.984286:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005492c4c6/0xb1a5ef690c5042ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9767 expref: 19 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015581.984298:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304481152:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015581.984428:0:11384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d08a9211/0xb1a5ef690c503cea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9434 expref: 11 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015581.984438:0:11384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d08a9211/0xb1a5ef690c503cea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9434 expref: 11 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015581.984448:0:11384:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304481280:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015581.984470:0:11384:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb4300 going to sleep for 11 seconds 00000100:00100000:1.0:1786015581.999571:0:22346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22346:1872772304480384:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015581.999587:0:22346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22346:1872772304480512:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015581.999615:0:22346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c5043ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015581.999660:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304480128:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015581.999669:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304480256:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015581.999681:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c5043a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015582.007355:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015582.007395:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015582.007424:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015582.007450:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015582.007468:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015582.007485:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015582.007512:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015582.007582:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015582.007606:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280732928 00000100:00100000:1.0:1786015582.007615:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280732928 00010000:00010000:1.0:1786015582.007677:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c9f2760/0xb1a5ef690c5042bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9736 expref: 22 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015582.008397:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280733440 00000100:00100000:1.0:1786015582.008402:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280733440 00010000:00010000:1.0:1786015582.008423:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503cf1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e943b expref: 12 pid: 6591 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015582.008435:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280733184 00000100:00100000:1.0:1786015582.008437:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280733184 00010000:00010000:1.0:1786015582.008450:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000286d08cf/0xb1a5ef690c50394e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9212 expref: 15 pid: 6591 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015582.008460:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280733056 00000100:00100000:1.0:1786015582.008462:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280733056 00010000:00010000:1.0:1786015582.008473:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000984e36bc/0xb1a5ef690c5042c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e973d expref: 23 pid: 14547 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015582.008482:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280733312 00000100:00100000:1.0:1786015582.008484:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280733312 00010000:00010000:1.0:1786015582.008494:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000733bf407/0xb1a5ef690c503cf8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9442 expref: 16 pid: 14547 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015582.008502:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280733568 00000100:00100000:1.0:1786015582.008505:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280733568 00010000:00010000:1.0:1786015582.008516:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe21abc1/0xb1a5ef690c5042cb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9744 expref: 20 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015582.008526:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280733696 00000100:00100000:1.0:1786015582.008528:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280733696 00010000:00010000:1.0:1786015582.008537:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d08a9211/0xb1a5ef690c503cea lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9434 expref: 13 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015582.008547:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280733824 00000100:00100000:1.0:1786015582.008550:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280733824 00010000:00010000:1.0:1786015582.008560:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005492c4c6/0xb1a5ef690c5042ee lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9767 expref: 21 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015582.008575:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 492 00000100:00100000:1.0:1786015582.008583:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+23:2353:x1872772280732928:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786015582.008597:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015582.008602:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c9f2760/0xb1a5ef690c5042bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9736 expref: 23 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.008615:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c9f2760/0xb1a5ef690c5042bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9736 expref: 23 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.008640:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c9f2760/0xb1a5ef690c5042bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9736 expref: 23 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.008666:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015582.008903:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 493 00000100:00100000:3.0:1786015582.008916:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280733440:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015582.008925:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015582.008931:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503cf1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e943b expref: 13 pid: 6591 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.008942:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503cf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e943b expref: 13 pid: 6591 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.008963:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015582.009012:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280733440:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 99us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015582.009018:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 493 00000100:00100000:3.0:1786015582.009040:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 494 00000100:00100000:3.0:1786015582.009045:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+16:2353:x1872772280733184:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015582.009053:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015582.009057:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000286d08cf/0xb1a5ef690c50394e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9212 expref: 16 pid: 6591 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009066:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000286d08cf/0xb1a5ef690c50394e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9212 expref: 16 pid: 6591 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009079:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000286d08cf/0xb1a5ef690c50394e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9212 expref: 16 pid: 6591 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009089:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015582.009093:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015582.009098:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c5043a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009109:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c5043a4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009139:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015582.009156:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+15:2353:x1872772280733184:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 111us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015582.009162:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 494 00000100:00100000:3.0:1786015582.009175:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 495 00000100:00100000:3.0:1786015582.009182:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748821ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+22:2352:x1872772280733056:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015582.009190:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015582.009194:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000984e36bc/0xb1a5ef690c5042c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e973d expref: 22 pid: 14547 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009203:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000984e36bc/0xb1a5ef690c5042c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e973d expref: 22 pid: 14547 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009228:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000984e36bc/0xb1a5ef690c5042c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e973d expref: 22 pid: 14547 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009238:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015582.009255:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748821ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+21:2352:x1872772280733056:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 73us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015582.009261:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 495 00000100:00100000:3.0:1786015582.009274:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 496 00000100:00100000:3.0:1786015582.009280:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2352:x1872772280733312:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015582.009288:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015582.009293:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000733bf407/0xb1a5ef690c503cf8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9442 expref: 14 pid: 14547 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009302:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000733bf407/0xb1a5ef690c503cf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9442 expref: 14 pid: 14547 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009313:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000733bf407/0xb1a5ef690c503cf8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9442 expref: 14 pid: 14547 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009322:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015582.009325:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015582.009329:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c5043ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009335:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c5043ab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009353:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015582.009382:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2352:x1872772280733312:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 101us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015582.009389:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 496 00000100:00100000:3.0:1786015582.009402:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 497 00000100:00100000:3.0:1786015582.009409:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+21:2352:x1872772280733568:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015582.009417:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015582.009422:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe21abc1/0xb1a5ef690c5042cb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9744 expref: 21 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009437:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe21abc1/0xb1a5ef690c5042cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9744 expref: 21 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009449:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015582.009452:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015582.009455:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000398818e/0xb1a5ef690c5043b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009463:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000398818e/0xb1a5ef690c5043b9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009475:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015582.009494:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+21:2352:x1872772280733568:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 85us (2009us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015582.009501:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 497 00000100:00100000:3.0:1786015582.009514:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 498 00000100:00100000:3.0:1786015582.009520:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280733696:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015582.009529:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015582.009534:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d08a9211/0xb1a5ef690c503cea lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9434 expref: 12 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009543:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d08a9211/0xb1a5ef690c503cea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9434 expref: 12 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009559:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015582.009576:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280733696:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 56us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015582.009582:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 498 00000100:00100000:3.0:1786015582.009595:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 499 00000100:00100000:3.0:1786015582.009602:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+20:2354:x1872772280733824:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015582.009609:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015582.009613:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005492c4c6/0xb1a5ef690c5042ee lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9767 expref: 20 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009623:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005492c4c6/0xb1a5ef690c5042ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9767 expref: 20 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009634:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015582.009637:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786015582.009641:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001933ae34/0xb1a5ef690c5043b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009659:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001933ae34/0xb1a5ef690c5043b2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009672:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015582.009702:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41677fca-39fb-471c-b582-96bce6540a36+20:2354:x1872772280733824:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 100us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015582.009711:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 499 00010000:00010000:3.0:1786015582.009838:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe21abc1/0xb1a5ef690c5042cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9744 expref: 19 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015582.009850:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304480896:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015582.009864:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0de7548/0xb1a5ef690c503cf1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e943b expref: 11 pid: 6591 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015582.009874:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1872772304481024:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015582.009901:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000398818e/0xb1a5ef690c5043b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009912:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000398818e/0xb1a5ef690c5043b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009920:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000398818e/0xb1a5ef690c5043b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009929:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000398818e/0xb1a5ef690c5043b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009937:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000398818e/0xb1a5ef690c5043b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.009960:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786015582.010535:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1872772304480640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27701us (27847us total) trans 4294967382 rc 0/0 00000100:00100000:3.0:1786015582.010544:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1786015582.010579:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967381 gen 2 00000004:00080000:3.0:1786015582.010585:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b74aeba2a00, transno 4294967381 00000100:00100000:3.0:1786015582.010599:0:3314:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8b74aee5bb80 x1872772304480640/t4294967382(4294967382) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786015597 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1786015582.010609:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b74aee5bb80/2, rc 0, transno 4294967382 00000100:00100000:3.0:1786015582.010613:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304480640:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786015582.011072:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+20:2353:x1872772280732928:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 2487us (3726us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015582.011080:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 492 00000100:00080000:1.0:1786015582.011139:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015582.011145:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786015582.011157:0:22346:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c5043ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.011167:0:22346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c5043ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.011181:0:22346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c5043ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.011188:0:22346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c5043ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.011220:0:22346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1786015582.011644:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3314:x1872772304480000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30549us (31043us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1786015582.011665:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000004:00080000:1.0:1786015582.011715:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b7383aad180/2, rc 0, transno 4294967396 00000100:00100000:1.0:1786015582.011721:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304480000:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1786015582.015782:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c5043a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.015807:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c5043a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.015820:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c5043a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.015828:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c5043a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.015859:0:6592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1786015582.016442:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304479872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 35702us (35957us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1786015582.016453:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00010000:00010000:0.0:1786015582.016483:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786015582.016490:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000398818e/0xb1a5ef690c5043b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.016500:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b74bfec2e00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015582.016504:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000398818e/0xb1a5ef690c5043b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.016514:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000398818e/0xb1a5ef690c5043b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.016533:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000398818e/0xb1a5ef690c5043b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.016540:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000398818e/0xb1a5ef690c5043b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.016568:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786015582.016572:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c5043ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.016579:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920a00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015582.016583:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c5043ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.016596:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c5043ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.016606:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c5043ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.016613:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000801c984f/0xb1a5ef690c5043ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 22346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.016626:0:8308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786015582.016629:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c5043a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.016636:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921000 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015582.016639:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c5043a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.016646:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c5043a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.016668:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c5043a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.016675:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c5ef6/0xb1a5ef690c5043a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.016693:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015582.016695:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015582.016696:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015582.016969:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005492c4c6/0xb1a5ef690c5042ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9767 expref: 18 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015582.016983:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304481152:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015582.016997:0:11384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d08a9211/0xb1a5ef690c503cea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9434 expref: 10 pid: 22346 timeout: 917 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015582.017006:0:11384:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11384:1872772304481280:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015582.017031:0:11384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001933ae34/0xb1a5ef690c5043b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.017045:0:11384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001933ae34/0xb1a5ef690c5043b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.017051:0:11384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001933ae34/0xb1a5ef690c5043b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.017059:0:11384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001933ae34/0xb1a5ef690c5043b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.017066:0:11384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001933ae34/0xb1a5ef690c5043b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.017091:0:11384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786015582.017709:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304480768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35271us (35386us total) trans 4294967383 rc 0/0 00000100:00100000:1.0:1786015582.017719:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00010000:00010000:3.0:1786015582.017999:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786015582.018007:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001933ae34/0xb1a5ef690c5043b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.018018:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921a00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:3.0:1786015582.018022:0:6606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001933ae34/0xb1a5ef690c5043b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.018031:0:6606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001933ae34/0xb1a5ef690c5043b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.018045:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001933ae34/0xb1a5ef690c5043b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.018053:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001933ae34/0xb1a5ef690c5043b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.018069:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015582.018070:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015582.018072:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015582.018160:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015582.019379:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1786015582.020792:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b74aee5a300/2, rc 0, transno 4294967383 00000100:00100000:2.0:1786015582.020805:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304480768:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1786015582.020819:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b7383aafb80/2, rc 0, transno 4294967397 00000100:00100000:2.0:1786015582.020823:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304479872:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1786015582.060202:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015582.224236:0:22644:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015582.224247:0:22644:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015582.224322:0:22644:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:0.0:1786015582.224329:0:22644:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015582.360301:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015582.364259:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280733952 00000100:00100000:1.0:1786015582.364279:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280733952 00000100:00100000:1.0:1786015582.364358:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 92 00000100:00100000:1.0:1786015582.364372:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:41677fca-39fb-471c-b582-96bce6540a36+111:2354:x1872772280733952:12345-192.168.202.56@tcp:63:ll_sa.0 00010000:00010000:1.0:1786015582.364419:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786015582.364442:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5043c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb3f0d9e45e978a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.364507:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.364525:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.364539:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.364556:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.364563:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.364570:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.367202:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.367218:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.367227:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.367234:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015582.367239:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.367246:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.367263:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015582.367267:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015582.367272:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.367278:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.367290:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.367296:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.367302:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.367307:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015582.367310:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.367317:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.367325:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x4b66ad81 (ffff8b748f194600) 00010000:00010000:1.0:1786015582.367327:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015582.367330:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.367335:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.367379:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5043c0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e978a expref: 112 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.367390:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015582.367392:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786015582.367396:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5043c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e978a expref: 112 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.367404:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b7383921000, rc -2) 00000100:00100000:1.0:1786015582.367488:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:41677fca-39fb-471c-b582-96bce6540a36+111:2354:x1872772280733952:12345-192.168.202.56@tcp:63:ll_sa.0 Request processed in 3118us (7194us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786015582.367498:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 92 00000100:00080000:1.0:1786015582.372257:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015582.391972:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015582.392242:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280734208 00000100:00100000:0.0:1786015582.392257:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280734208 00000100:00100000:0.0:1786015582.392346:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1676 00000100:00100000:0.0:1786015582.392361:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+111:33589:x1872772280734208:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:0.0:1786015582.392443:0:7673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015582.392476:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920000/0xb1a5ef690c503d30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9449 expref: 111 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.392494:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8b749302f200) 00010000:00010000:0.0:1786015582.392500:0:7673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786015582.392538:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5043d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.392553:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5043d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.392563:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5043d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.392581:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5043dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.392587:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5043dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.392594:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5043dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.394222:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5043e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.394246:0:7673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503cc7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9418 expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.394254:0:7673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5043e3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.394304:0:7673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9418 expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.394320:0:7673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9418 expref: 55 pid: 5794 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015582.394337:0:7673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304481408:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015582.394438:0:7673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0042000 going to sleep for 11 seconds 00000100:00100000:1.0:1786015582.406486:0:7673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7673:1872772304481408:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015582.406525:0:7673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5043e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015582.418506:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015582.422419:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280734336 00000100:00100000:3.0:1786015582.422439:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280734336 00010000:00010000:3.0:1786015582.422515:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9418 expref: 56 pid: 5794 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015582.422568:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 500 00000100:00100000:3.0:1786015582.422579:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+56:2354:x1872772280734336:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015582.422596:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015582.422603:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9418 expref: 56 pid: 5794 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.422618:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9418 expref: 56 pid: 5794 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.422653:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c0ca7600/0xb1a5ef690c503cc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9418 expref: 56 pid: 5794 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.422669:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8b749302f200) 00010000:00010000:3.0:1786015582.422676:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5043e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.422697:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5043e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.422706:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5043e3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.422745:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015582.423121:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+55:2354:x1872772280734336:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 249us (4332us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015582.423133:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 500 00000100:00080000:0.0:1786015582.423212:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786015582.423247:0:7673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5043e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015582.423270:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5043e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786015582.437989:0:7673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].22, 64 off9720 00000004:00080000:3.0:1786015582.438007:0:7673:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 817689245110ns, next at 818689241302ns, rc = 0 00010000:00010000:3.0:1786015582.438103:0:7673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5043ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.438122:0:7673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5043ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.438135:0:7673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5043ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.438145:0:7673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5043ea lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.438152:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5043ea lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.438160:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5043ea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.438238:0:7673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786015582.438270:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5043e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.438281:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5043e3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.438287:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5043e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.438292:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833cc00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015582.438296:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5043e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.438302:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5043e3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.438313:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8b749302f200) 00010000:00010000:3.0:1786015582.438316:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786015582.438320:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5043e3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.438326:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833cc00/0xb1a5ef690c5043e3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.438344:0:7673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5043d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.438350:0:7673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5043d5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.438355:0:7673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5043d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.438360:0:7673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833c200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015582.438363:0:7673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5043d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.438369:0:7673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5043d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.438376:0:7673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:3.0:1786015582.438378:0:7673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015582.438381:0:7673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5043d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015582.438386:0:7673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c200/0xb1a5ef690c5043d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786015582.438395:0:7673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000861c8ce6 reply state 00000000578f28e2 transno 4294968380 ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5043dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015582.438404:0:7673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786015582.438490:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+112:33589:x1872772280734208:12345-192.168.202.56@tcp:36:rm.0 Request processed in 46130us (46530us total) trans 4294968380 rc 0/0 00000100:00100000:3.0:1786015582.438499:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1676 00010000:00010000:1.0:1786015582.440424:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786015582.440437:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5043ea lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.440447:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afce00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015582.440451:0:6606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5043ea lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.440459:0:6606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5043ea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.440474:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8b749302f200) 00010000:00010000:1.0:1786015582.440477:0:6606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786015582.440481:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5043ea lrc: 1/0,0 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.440487:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afce00/0xb1a5ef690c5043ea lrc: 0/0,0 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015582.440507:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015582.440509:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015582.440511:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015582.447504:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5043dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015582.447535:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5043dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015582.447545:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5043dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015582.447552:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833c000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:2.0:1786015582.447558:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5043dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015582.447567:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5043dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015582.447584:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff8b749302fd00) 00010000:00010000:2.0:1786015582.447587:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786015582.447592:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5043dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015582.447599:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833c000/0xb1a5ef690c5043dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015582.896790:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304481664:0@lo:400:kworker.0 00000100:00100000:3.0:1786015582.896997:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304481920:0@lo:400:kworker.0 00000100:00100000:3.0:1786015582.897068:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015582.897139:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786015582.897145:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304481536:0@lo:400:kworker.0 00000100:00100000:3.0:1786015582.897176:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015582.897204:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304482048:0@lo:400:kworker.0 00000100:00100000:3.0:1786015582.897231:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015582.897263:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304481920 00000100:00100000:3.0:1786015582.897271:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304481920 00000100:00100000:3.0:1786015582.897320:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:3.0:1786015582.897329:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304481920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015582.897402:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304481920:12345-0@lo:400:kworker.0 Request processed in 74us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015582.897410:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:3.0:1786015582.897594:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304481920:0@lo:400:kworker.0 00000100:00100000:3.0:1786015582.897649:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304481536 00000100:00100000:3.0:1786015582.897654:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304481536 00000100:00100000:3.0:1786015582.897678:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:3.0:1786015582.898042:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304481536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015582.898091:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304481536:12345-0@lo:400:kworker.0 Request processed in 52us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015582.898098:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:3.0:1786015582.898131:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304481536:0@lo:400:kworker.0 00000100:00100000:3.0:1786015582.898160:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304482048 00000100:00100000:3.0:1786015582.898164:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304482048 00000100:00100000:3.0:1786015582.898206:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:3.0:1786015582.898213:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304482048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015582.898255:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304482048:12345-0@lo:400:kworker.0 Request processed in 43us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015582.898261:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:3.0:1786015582.898288:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304482048:0@lo:400:kworker.0 00000100:00100000:3.0:1786015582.898324:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304481792:0@lo:400:kworker.0 00000100:00100000:3.0:1786015582.898352:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015582.898490:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304481792 00000100:00100000:1.0:1786015582.898495:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304481792 00000100:00100000:1.0:1786015582.898521:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:1.0:1786015582.898528:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304481792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015582.898568:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304481792:12345-0@lo:400:kworker.0 Request processed in 41us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015582.898575:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00080000:1.0:1786015582.898603:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015582.899040:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304481792:0@lo:400:kworker.0 00000100:00100000:0.0:1786015582.899132:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015582.899162:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304482176:0@lo:400:kworker.0 00000100:00100000:0.0:1786015582.899190:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015582.899224:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304482176 00000100:00100000:0.0:1786015582.899228:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304482176 00000100:00100000:0.0:1786015582.899259:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:0.0:1786015582.899266:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1872772304482176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015582.899303:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1872772304482176:12345-0@lo:400:kworker.0 Request processed in 39us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015582.899310:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:0.0:1786015582.899343:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304482176:0@lo:400:kworker.0 00000100:00100000:3.0:1786015582.899462:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304481664 00000100:00100000:3.0:1786015582.899466:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304481664 00000100:00100000:3.0:1786015582.899501:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:3.0:1786015582.899508:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304481664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015582.899558:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872772304481664:12345-0@lo:400:kworker.0 Request processed in 51us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015582.899565:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:0.0:1786015582.901423:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872772304481664:0@lo:400:kworker.0 00010000:00010000:0.0:1786015583.084021:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015583.405844:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304482304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015583.405918:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015583.405991:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304482304 00000100:00100000:1.0:1786015583.406000:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304482304 00000100:00100000:1.0:1786015583.406079:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1786015583.406088:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1872772304482304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015583.406127:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015583.406174:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1872772304482304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015583.406180:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1786015583.406225:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304482304:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1786015583.406908:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1786015583.849581:0:22695:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015583.849612:0:22695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015583.849712:0:22695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:3.0:1786015583.849721:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015583.945666:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015583.949055:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280734592 00000100:00100000:1.0:1786015583.949072:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280734592 00000100:00100000:1.0:1786015583.949205:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1677 00000100:00100000:1.0:1786015583.949216:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+111:33599:x1872772280734592:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:1.0:1786015583.949279:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786015583.949308:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384bbdc00/0xb1a5ef690c503e3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e94b2 expref: 111 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.949328:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8b749302fe00) 00010000:00010000:1.0:1786015583.949333:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786015583.949469:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.949486:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.949496:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.949513:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5043f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.949521:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5043f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.949528:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5043f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.949742:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.949754:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503e09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e949d expref: 54 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.949789:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043ff lrc: 4/0,1 mode: --/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.949827:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503e09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e949d expref: 54 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.949841:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503e09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e949d expref: 54 pid: 5796 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015583.949855:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aace00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304482432:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015583.950088:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786015583.958475:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aace00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1872772304482432:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015583.958515:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015583.958871:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015583.959166:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280734720 00000100:00100000:3.0:1786015583.959177:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280734720 00010000:00010000:3.0:1786015583.959224:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503e09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e949d expref: 55 pid: 5796 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015583.959272:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 501 00000100:00100000:3.0:1786015583.959284:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+55:2354:x1872772280734720:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015583.959300:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015583.959310:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503e09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e949d expref: 55 pid: 5796 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015583.959324:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503e09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e949d expref: 55 pid: 5796 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015583.959346:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7481665400/0xb1a5ef690c503e09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e949d expref: 55 pid: 5796 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015583.959363:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8b749302fe00) 00010000:00010000:3.0:1786015583.959368:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015583.959377:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015583.959384:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043ff lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015583.959411:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015583.959463:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+54:2354:x1872772280734720:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 182us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015583.959470:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 501 00010000:00010000:1.0:1786015583.959599:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.959606:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786015583.962285:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].18, 64 off9368 00000004:00080000:1.0:1786015583.962302:0:5796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 819213539585ns, next at 820213535372ns, rc = 0 00010000:00010000:1.0:1786015583.962385:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c504406 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.962403:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c504406 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.962415:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c504406 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.962424:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c504406 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.962431:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c504406 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.962437:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c504406 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.962458:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786015583.962481:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.962488:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043ff lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.962495:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.962502:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015583.962507:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.962514:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043ff lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.962526:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8b749302fe00) 00010000:00010000:1.0:1786015583.962529:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786015583.962534:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043ff lrc: 2/0,0 mode: --/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.962540:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920200/0xb1a5ef690c5043ff lrc: 0/0,0 mode: --/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.962560:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.962567:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043f1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015583.962689:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786015583.962696:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c504406 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015583.962703:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921a00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:2.0:1786015583.962706:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c504406 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015583.962798:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c504406 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015583.962817:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8b749302fe00) 00010000:00010000:2.0:1786015583.962820:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786015583.962824:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c504406 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015583.962830:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921a00/0xb1a5ef690c504406 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015583.962846:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015583.962848:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015583.962850:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015583.963128:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.963133:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920a00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:1.0:1786015583.963137:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.963144:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.963154:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:1.0:1786015583.963157:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786015583.963160:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015583.963166:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383920a00/0xb1a5ef690c5043f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786015583.963178:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005eda66cd reply state 00000000870fba36 transno 4294968381 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5043f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015583.963193:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786015583.963328:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+112:33599:x1872772280734592:12345-192.168.202.56@tcp:36:rm.0 Request processed in 14109us (17668us total) trans 4294968381 rc 0/0 00000100:00100000:1.0:1786015583.963336:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1677 00010000:00010000:3.0:1786015583.965550:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5043f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015583.965567:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5043f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015583.965650:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5043f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015583.965656:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383921000 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:3.0:1786015583.965661:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5043f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015583.970079:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5043f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015583.970128:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff8b748f194600) 00010000:00010000:3.0:1786015583.970132:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786015583.970139:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5043f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015583.970147:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383921000/0xb1a5ef690c5043f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015584.109325:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015585.135372:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015585.369518:0:22746:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015585.369528:0:22746:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015585.369608:0:22746:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:1.0:1786015585.369631:0:22746:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015585.563234:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015585.563314:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280734976 00000100:00100000:3.0:1786015585.563325:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280734976 00000100:00100000:3.0:1786015585.563393:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1678 00000100:00100000:3.0:1786015585.563405:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+111:33610:x1872772280734976:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:3.0:1786015585.563463:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786015585.563493:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384b47000/0xb1a5ef690c503f60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e95b5 expref: 111 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015585.563522:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8b7487f06500) 00010000:00010000:3.0:1786015585.563528:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786015585.563684:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50440d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015585.563700:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50440d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015585.563721:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50440d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015585.563736:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504414 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015585.563747:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504414 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015585.563754:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504414 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015585.564057:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50441b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015585.564070:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c503f05 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9530 expref: 53 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015585.564078:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50441b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015585.564111:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c503f05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9530 expref: 53 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015585.564125:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c503f05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9530 expref: 53 pid: 5795 timeout: 920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015585.564139:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304482560:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015585.564231:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b0023f00 going to sleep for 11 seconds 00000100:00080000:2.0:1786015585.564289:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015585.570527:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1872772304482560:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015585.570689:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50441b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786015585.578022:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015585.578093:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280735104 00000100:00100000:0.0:1786015585.578104:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280735104 00010000:00010000:0.0:1786015585.578162:0:17038:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c503f05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9530 expref: 54 pid: 5795 timeout: 920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015585.578211:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 502 00000100:00100000:0.0:1786015585.578220:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748821e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+54:2354:x1872772280735104:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015585.578234:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015585.578242:0:17038:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c503f05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9530 expref: 54 pid: 5795 timeout: 920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.578255:0:17038:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c503f05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9530 expref: 54 pid: 5795 timeout: 920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.578278:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7383906800/0xb1a5ef690c503f05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9530 expref: 54 pid: 5795 timeout: 920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.578291:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8b7487f06500) 00010000:00010000:0.0:1786015585.578296:0:17038:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50441b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.578304:0:17038:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50441b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.578311:0:17038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50441b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.578337:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015585.578381:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748821e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2354:x1872772280735104:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 162us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015585.578389:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 502 00010000:00010000:0.0:1786015585.578491:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50441b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.578499:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50441b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786015585.579179:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].23, 64 off9784 00000004:00080000:0.0:1786015585.579188:0:5795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820830426481ns, next at 821830424468ns, rc = 0 00010000:00010000:0.0:1786015585.579249:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504422 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579261:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504422 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579270:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504422 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579278:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504422 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579284:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504422 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579291:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504422 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579308:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786015585.579329:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50441b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579335:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50441b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579341:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50441b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579347:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afc200 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015585.579351:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50441b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579359:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50441b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579367:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8b7487f06500) 00010000:00010000:0.0:1786015585.579369:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786015585.579373:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50441b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579378:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afc200/0xb1a5ef690c50441b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579396:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50440d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579402:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50440d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579407:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50440d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579412:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afd400 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015585.579415:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50440d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579420:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50440d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579426:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8b748f194c00) 00010000:00010000:0.0:1786015585.579428:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015585.579431:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50440d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579436:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afd400/0xb1a5ef690c50440d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786015585.579445:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000770dc419 reply state 00000000e2b80720 transno 4294968382 ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504414 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015585.579453:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786015585.579510:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+112:33610:x1872772280734976:12345-192.168.202.56@tcp:36:rm.0 Request processed in 16108us (16283us total) trans 4294968382 rc 0/0 00000100:00100000:0.0:1786015585.579517:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1678 00010000:00010000:0.0:1786015585.579544:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786015585.579549:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504422 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579555:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833d200 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015585.579559:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504422 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579566:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504422 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579574:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8b7487f06500) 00010000:00010000:0.0:1786015585.579576:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786015585.579579:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504422 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579585:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b748833d200/0xb1a5ef690c504422 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.579603:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015585.579605:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015585.579607:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786015585.579807:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786015585.585249:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504414 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.585269:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504414 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.585277:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504414 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.585284:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7384afda00 already unused, calling callback (ffffffffc20624f0) 00010000:00010000:0.0:1786015585.585289:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504414 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.585297:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504414 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.585315:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff8b7483ce2a00) 00010000:00010000:0.0:1786015585.585318:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786015585.585323:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504414 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015585.585329:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7384afda00/0xb1a5ef690c504414 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015585.890504:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015585.890546:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015585.890570:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015585.890601:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015585.890643:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015585.890682:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280735360 00000100:00100000:0.0:1786015585.890693:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280735360 00000100:00100000:0.0:1786015585.890755:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280735616 00000100:00100000:0.0:1786015585.890758:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280735616 00000100:00100000:0.0:1786015585.890804:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280735488 00000100:00100000:0.0:1786015585.890808:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280735488 00000100:00100000:0.0:1786015585.890822:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280735744 00000100:00100000:0.0:1786015585.890825:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280735744 00000100:00100000:0.0:1786015585.890842:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 585 00000100:00100000:0.0:1786015585.890853:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280735360:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015585.890941:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280735360:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 91us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015585.890966:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 585 00000100:00100000:0.0:1786015585.890988:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 586 00000100:00100000:0.0:1786015585.890994:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280735616:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015585.891020:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2353:x1872772280735616:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015585.891027:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 586 00000100:00100000:0.0:1786015585.891037:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 587 00000100:00100000:0.0:1786015585.891043:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+20:2353:x1872772280735488:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015585.891067:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+20:2353:x1872772280735488:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015585.891073:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 587 00000100:00100000:0.0:1786015585.891084:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 588 00000100:00100000:0.0:1786015585.891092:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280735744:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015585.891113:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2353:x1872772280735744:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015585.891119:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 588 00000100:00100000:1.0:1786015585.898580:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280735232 00000100:00100000:1.0:1786015585.898595:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280735232 00000100:00100000:1.0:1786015585.898739:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 648 00000100:00100000:1.0:1786015585.898750:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280735232:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015585.898854:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280735232:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 106us (8359us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015585.898861:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 648 00000100:00080000:3.0:1786015585.903780:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015585.903790:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786015586.156410:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786015586.476317:0:6699:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 821727552764ns, next at 822727550552ns, rc = 0 00000100:00100000:0.0:1786015586.476381:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304482688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015586.476451:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015586.476877:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304482688 00000100:00100000:0.0:1786015586.476886:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304482688 00000100:00100000:0.0:1786015586.476941:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1786015586.476950:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304482688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015586.476980:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015586.477023:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304482688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015586.477030:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:0.0:1786015586.477340:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015586.477378:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304482688:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1786015586.592080:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967383 is committed 00000040:00080000:2.0:1786015586.674734:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015586.674744:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015586.678545:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 54 count 1 00000040:00080000:2.0:1786015586.678562:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1786015586.763569:0:22799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015586.763577:0:22799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015586.764585:0:22799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015586.764599:0:22799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1786015587.124745:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967397 is committed 00000004:00080000:0.0:1786015587.133414:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 21 committed 00000001:00080000:0.0:1786015587.133446:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968382 is committed 00000004:00080000:0.0:1786015587.133451:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 29 committed 00000004:00080000:0.0:1786015587.133464:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 20 committed 00000004:00080000:0.0:1786015587.133488:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 28 committed 00000100:00100000:0.0:1786015587.133657:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304482816:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786015587.133727:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015587.133827:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304482944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786015587.133853:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015587.134079:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304482816 00000100:00100000:0.0:1786015587.134087:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304482816 00000100:00100000:0.0:1786015587.134132:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304482944 00000100:00100000:0.0:1786015587.134136:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304482944 00000100:00100000:0.0:1786015587.134156:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1786015587.134163:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1872772304482816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786015587.134191:0:6592:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:34 count 1 00010000:00010000:0.0:1786015587.134217:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c504429 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.134238:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac472ba5/0xb1a5ef690c504189 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96b1 expref: 12 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.134247:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae040d64/0xb1a5ef690c5042d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e974b expref: 19 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.134254:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=12s v=(0 0) 00010000:00010000:0.0:1786015587.134259:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015587.134263:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c504429 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.134288:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae040d64/0xb1a5ef690c5042d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e974b expref: 19 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.134302:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae040d64/0xb1a5ef690c5042d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e974b expref: 19 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015587.134321:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef02a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304483072:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015587.134381:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac472ba5/0xb1a5ef690c504189 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96b1 expref: 12 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.134392:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac472ba5/0xb1a5ef690c504189 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96b1 expref: 12 pid: 6591 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015587.134403:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304483200:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015587.134424:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b02a8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786015587.134439:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1786015587.134446:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304482944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786015587.134458:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:35 count 1 00010000:00010000:0.0:1786015587.134469:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0ebf21d/0xb1a5ef690c504430 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.134481:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000052c48d5/0xb1a5ef690c50419e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96c6 expref: 12 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.134490:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000713ab4f/0xb1a5ef690c5042e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9759 expref: 19 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.134497:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=12s v=(0 0) 00010000:00010000:0.0:1786015587.134500:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015587.134504:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0ebf21d/0xb1a5ef690c504430 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.134521:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000713ab4f/0xb1a5ef690c5042e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9759 expref: 19 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.134530:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000713ab4f/0xb1a5ef690c5042e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9759 expref: 19 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015587.134538:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef00380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304483328:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015587.134568:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000052c48d5/0xb1a5ef690c50419e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96c6 expref: 12 pid: 14547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.134575:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000052c48d5/0xb1a5ef690c50419e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96c6 expref: 12 pid: 14547 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015587.134583:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304483456:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015587.134614:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b74b02a8600 going to sleep for 11 seconds 00000100:00080000:0.0:1786015587.134626:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015587.135723:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304483584:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1786015587.135800:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015587.136064:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304483584 00000100:00100000:1.0:1786015587.136072:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304483584 00000100:00100000:1.0:1786015587.136104:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:1.0:1786015587.136111:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304483584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786015587.136131:0:6591:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:32 count 1 00010000:00010000:1.0:1786015587.136149:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000801c984f/0xb1a5ef690c504437 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015587.136166:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000017e465ed/0xb1a5ef690c504190 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96b8 expref: 9 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015587.136174:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000782eea5a/0xb1a5ef690c5042d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9752 expref: 17 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015587.136181:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=12s v=(0 0) 00010000:00010000:1.0:1786015587.136184:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786015587.136188:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000801c984f/0xb1a5ef690c504437 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015587.136209:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000782eea5a/0xb1a5ef690c5042d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9752 expref: 17 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015587.136221:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000782eea5a/0xb1a5ef690c5042d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9752 expref: 17 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015587.136231:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304483712:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015587.136287:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000017e465ed/0xb1a5ef690c504190 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96b8 expref: 9 pid: 22346 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015587.136296:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000017e465ed/0xb1a5ef690c504190 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96b8 expref: 9 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015587.136312:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304483840:192.168.202.56@tcp:104: 00000100:00100000:1.0:1786015587.136334:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8b7382cb4840 going to sleep for 11 seconds 00000100:00100000:0.0:1786015587.137440:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef02a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304483072:192.168.202.56@tcp:104: 00000100:00100000:0.0:1786015587.137454:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6592:1872772304483200:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015587.137477:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c504429 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786015587.140122:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef00380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304483328:192.168.202.56@tcp:104: 00000100:00100000:3.0:1786015587.140139:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1872772304483456:192.168.202.56@tcp:104: 00010000:00010000:3.0:1786015587.140165:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c0ebf21d/0xb1a5ef690c504430 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786015587.145026:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304483712:192.168.202.56@tcp:104: 00010000:00010000:0.0:1786015587.182110:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015587.182213:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015587.182236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015587.182259:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015587.182284:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015587.182300:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015587.182324:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015587.182359:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280736000 00000100:00100000:0.0:1786015587.182369:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280736000 00010000:00010000:0.0:1786015587.182418:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac472ba5/0xb1a5ef690c504189 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96b1 expref: 13 pid: 6591 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015587.182442:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280735872 00000100:00100000:0.0:1786015587.182444:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280735872 00010000:00010000:0.0:1786015587.182457:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae040d64/0xb1a5ef690c5042d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e974b expref: 20 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015587.182467:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280736128 00000100:00100000:0.0:1786015587.182470:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280736128 00010000:00010000:0.0:1786015587.182480:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000052c48d5/0xb1a5ef690c50419e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96c6 expref: 14 pid: 14547 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015587.182490:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280736384 00000100:00100000:0.0:1786015587.182492:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280736384 00010000:00010000:0.0:1786015587.182505:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000782eea5a/0xb1a5ef690c5042d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9752 expref: 18 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015587.182520:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280736256 00000100:00100000:0.0:1786015587.182523:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280736256 00010000:00010000:0.0:1786015587.182532:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000713ab4f/0xb1a5ef690c5042e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9759 expref: 21 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015587.182543:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280736512 00000100:00100000:0.0:1786015587.182545:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280736512 00010000:00010000:0.0:1786015587.182557:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000017e465ed/0xb1a5ef690c504190 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96b8 expref: 10 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786015587.182572:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 503 00000100:00100000:0.0:1786015587.182581:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+14:2354:x1872772280736000:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015587.182617:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015587.182623:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac472ba5/0xb1a5ef690c504189 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96b1 expref: 14 pid: 6591 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.182644:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac472ba5/0xb1a5ef690c504189 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96b1 expref: 14 pid: 6591 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.182670:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac472ba5/0xb1a5ef690c504189 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96b1 expref: 14 pid: 6591 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.182688:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015587.182748:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+13:2354:x1872772280736000:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 168us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015587.182756:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 503 00000100:00100000:0.0:1786015587.182804:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 504 00000100:00100000:0.0:1786015587.182811:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+21:2353:x1872772280735872:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015587.182819:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015587.182824:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae040d64/0xb1a5ef690c5042d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e974b expref: 21 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.182834:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae040d64/0xb1a5ef690c5042d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e974b expref: 21 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.182847:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae040d64/0xb1a5ef690c5042d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e974b expref: 21 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.182857:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015587.182861:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1786015587.183381:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6591:1872772304483840:192.168.202.56@tcp:104: 00010000:00010000:1.0:1786015587.183409:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000801c984f/0xb1a5ef690c504437 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.183454:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c504429 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.183466:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c504429 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.183533:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015587.183560:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+20:2353:x1872772280735872:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 749us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015587.183568:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 504 00000100:00100000:0.0:1786015587.183608:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 505 00000100:00100000:0.0:1786015587.183617:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+12:2353:x1872772280736128:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015587.183626:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015587.183631:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000052c48d5/0xb1a5ef690c50419e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96c6 expref: 12 pid: 14547 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.183650:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000052c48d5/0xb1a5ef690c50419e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96c6 expref: 12 pid: 14547 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.183664:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000052c48d5/0xb1a5ef690c50419e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96c6 expref: 12 pid: 14547 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.183675:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015587.183757:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280736128:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 141us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015587.183932:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 505 00000100:00100000:0.0:1786015587.183948:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 506 00000100:00100000:0.0:1786015587.183956:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280736384:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015587.183965:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015587.183969:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000782eea5a/0xb1a5ef690c5042d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9752 expref: 18 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.183979:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000782eea5a/0xb1a5ef690c5042d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9752 expref: 18 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.184000:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000782eea5a/0xb1a5ef690c5042d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9752 expref: 18 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.184011:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015587.184029:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280736384:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 74us (1744us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015587.184035:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 506 00000100:00100000:0.0:1786015587.184049:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 507 00000100:00100000:0.0:1786015587.184056:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+19:2354:x1872772280736256:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015587.184062:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015587.184067:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000713ab4f/0xb1a5ef690c5042e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9759 expref: 19 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.184076:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000713ab4f/0xb1a5ef690c5042e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9759 expref: 19 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.184087:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000713ab4f/0xb1a5ef690c5042e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e9759 expref: 19 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.184096:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015587.184099:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015587.184104:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0ebf21d/0xb1a5ef690c504430 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.184116:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0ebf21d/0xb1a5ef690c504430 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.184143:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015587.184161:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280736256:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 106us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015587.184168:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 507 00000100:00100000:0.0:1786015587.184181:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 508 00000100:00100000:0.0:1786015587.184188:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+10:2354:x1872772280736512:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015587.184196:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786015587.184201:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000017e465ed/0xb1a5ef690c504190 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96b8 expref: 10 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.184211:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000017e465ed/0xb1a5ef690c504190 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96b8 expref: 10 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.184223:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017e465ed/0xb1a5ef690c504190 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e96b8 expref: 10 pid: 22346 timeout: 922 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.184231:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015587.184233:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786015587.184238:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000801c984f/0xb1a5ef690c504437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.184250:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000801c984f/0xb1a5ef690c504437 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.184266:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015587.184284:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280736512:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 97us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015587.184290:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 508 00000100:00080000:0.0:1786015587.184313:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015587.184317:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786015587.184390:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c0ebf21d/0xb1a5ef690c504430 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015587.184399:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0ebf21d/0xb1a5ef690c504430 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015587.184408:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0ebf21d/0xb1a5ef690c504430 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015587.184416:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0ebf21d/0xb1a5ef690c504430 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015587.184442:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786015587.185335:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786015587.185343:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0ebf21d/0xb1a5ef690c504430 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.185353:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833de00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015587.185358:0:6606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0ebf21d/0xb1a5ef690c504430 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.185368:0:6606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0ebf21d/0xb1a5ef690c504430 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.185382:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0ebf21d/0xb1a5ef690c504430 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.185389:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0ebf21d/0xb1a5ef690c504430 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.185417:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015587.185420:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015587.185421:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015587.186029:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000801c984f/0xb1a5ef690c504437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.186041:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000801c984f/0xb1a5ef690c504437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.186050:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000801c984f/0xb1a5ef690c504437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.186057:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000801c984f/0xb1a5ef690c504437 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.186076:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786015587.187287:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1872772304482944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 52835us (53427us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1786015587.187299:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1786015587.188165:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304483584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 52051us (52362us total) trans 4294967384 rc 0/0 00000100:00100000:0.0:1786015587.188175:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00010000:00010000:0.0:1786015587.188202:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786015587.188209:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000801c984f/0xb1a5ef690c504437 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.188221:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b7383920a00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:0.0:1786015587.188225:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000801c984f/0xb1a5ef690c504437 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.188237:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000801c984f/0xb1a5ef690c504437 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.188256:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000801c984f/0xb1a5ef690c504437 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.188264:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000801c984f/0xb1a5ef690c504437 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015587.188284:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015587.188286:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015587.188288:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015587.188321:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967383 gen 2 00000004:00080000:0.0:1786015587.188327:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b74aee5bb80, transno 4294967382 00000004:00080000:0.0:1786015587.188339:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b74aee5a300, transno 4294967383 00000100:00100000:0.0:1786015587.189051:0:3315:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8b7383aace00 x1872772304483584/t4294967384(4294967384) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786015603 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1786015587.189064:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b7383aace00/2, rc 0, transno 4294967384 00000100:00100000:0.0:1786015587.189070:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304483584:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786015587.190919:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967397 gen 2 00000004:00080000:3.0:1786015587.190929:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b7383aad180, transno 4294967396 00000004:00080000:3.0:1786015587.190942:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b7383aafb80, transno 4294967397 00000100:00100000:3.0:1786015587.190950:0:3314:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8b74aef01500 x1872772304482944/t4294967398(4294967398) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786015603 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1786015587.190963:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b74aef01500/2, rc 0, transno 4294967398 00000100:00100000:3.0:1786015587.190969:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304482944:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1786015587.200366:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c504429 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015587.200385:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c504429 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015587.200397:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c504429 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015587.200404:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c504429 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015587.200426:0:6592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786015587.202330:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1872772304482816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 68161us (68597us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1786015587.202343:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00010000:00010000:1.0:1786015587.203126:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786015587.203136:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c504429 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015587.203148:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b748833cc00 already unused, calling callback (ffffffffc1624300) 00010000:00010000:1.0:1786015587.203153:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c504429 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015587.203164:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c504429 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015587.203184:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c504429 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015587.203192:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a3bfce9/0xb1a5ef690c504429 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786015587.203213:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015587.203215:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015587.203217:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786015587.204142:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b74aef00a80/2, rc 0, transno 4294967399 00000100:00100000:0.0:1786015587.204154:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304482816:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786015588.012114:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304484352:0@lo:400:kworker.0 00000100:00100000:0.0:1786015588.012194:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015588.012290:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786015588.012303:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304484224:0@lo:400:kworker.0 00000100:00100000:0.0:1786015588.012361:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015588.012400:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304484352 00000100:00100000:0.0:1786015588.012406:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304484352 00000100:00100000:0.0:1786015588.012460:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:0.0:1786015588.012475:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304484352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015588.012540:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3315:x1872772304484352:12345-0@lo:400:kworker.0 Request processed in 73us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015588.012554:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:0.0:1786015588.012751:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304484224 00000100:00100000:0.0:1786015588.012756:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304484224 00000100:00100000:0.0:1786015588.012813:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:0.0:1786015588.012820:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304484224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015588.012851:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304484224:12345-0@lo:400:kworker.0 Request processed in 32us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015588.012858:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00080000:0.0:1786015588.012940:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015588.012943:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015588.012975:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304484224:0@lo:400:kworker.0 00000100:00100000:0.0:1786015588.012987:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304484352:0@lo:400:kworker.0 00000100:00100000:1.0:1786015588.013118:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304483968:0@lo:400:kworker.0 00000100:00100000:1.0:1786015588.013167:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015588.013216:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304484480:0@lo:400:kworker.0 00000100:00100000:1.0:1786015588.013255:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015588.013287:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786015588.013297:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304484096:0@lo:400:kworker.0 00000100:00100000:1.0:1786015588.013343:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015588.013371:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304484608:0@lo:400:kworker.0 00000100:00100000:1.0:1786015588.013392:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015588.013420:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304484480 00000100:00100000:1.0:1786015588.013423:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304484480 00000100:00100000:1.0:1786015588.013458:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304484096 00000100:00100000:1.0:1786015588.013464:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304484096 00000100:00100000:1.0:1786015588.013491:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1786015588.013498:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304484480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015588.013550:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304484480:12345-0@lo:400:kworker.0 Request processed in 52us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015588.013563:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1786015588.013575:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1786015588.013580:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304484096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015588.013616:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304484096:12345-0@lo:400:kworker.0 Request processed in 36us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015588.013622:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1786015588.013660:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304484608 00000100:00100000:1.0:1786015588.013664:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304484608 00000100:00100000:1.0:1786015588.013700:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:1.0:1786015588.013711:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304484608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015588.013911:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3312:x1872772304484608:12345-0@lo:400:kworker.0 Request processed in 199us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015588.013924:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00080000:1.0:1786015588.014017:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015588.014042:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304484096:0@lo:400:kworker.0 00000100:00100000:1.0:1786015588.014053:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304484608:0@lo:400:kworker.0 00000100:00100000:1.0:1786015588.014064:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304484480:0@lo:400:kworker.0 00000100:00100000:0.0:1786015588.014382:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304483968 00000100:00100000:0.0:1786015588.014387:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304483968 00000100:00100000:0.0:1786015588.014425:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:0.0:1786015588.014432:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304483968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015588.014479:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304483968:12345-0@lo:400:kworker.0 Request processed in 47us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015588.014488:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:1.0:1786015588.016917:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304483968:0@lo:400:kworker.0 00010000:00010000:2.0:1786015588.211226:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015588.526221:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304484736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015588.526293:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015588.526416:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304484736 00000100:00100000:2.0:1786015588.526424:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304484736 00000100:00100000:2.0:1786015588.526478:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1786015588.526487:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1872772304484736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015588.526524:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015588.526572:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1872772304484736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015588.526580:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1786015588.526642:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304484736:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1786015588.863479:0:22853:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015588.863490:0:22853:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015588.866570:0:22853:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015588.866601:0:22853:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015589.228943:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015590.256240:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015590.983497:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015590.983535:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015590.983558:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015590.983590:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015590.983609:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015590.983630:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015590.983668:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015590.983707:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280736640 00000100:00100000:0.0:1786015590.983721:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280736640 00000100:00100000:0.0:1786015590.983806:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 650 00000100:00100000:0.0:1786015590.983816:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280736640:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015590.983893:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280736640:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 78us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015590.983902:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 650 00000100:00100000:0.0:1786015590.983936:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280736896 00000100:00100000:0.0:1786015590.983940:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280736896 00000100:00100000:0.0:1786015590.983972:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280737408 00000100:00100000:0.0:1786015590.983974:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280737408 00000100:00100000:0.0:1786015590.983992:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280737024 00000100:00100000:0.0:1786015590.983995:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280737024 00000100:00100000:0.0:1786015590.986688:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280737280 00000100:00100000:0.0:1786015590.986705:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280737280 00000100:00100000:0.0:1786015590.986739:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 591 00000100:00100000:0.0:1786015590.986748:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280736896:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015590.987976:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280736896:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 1218us (4429us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015590.987993:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 591 00000040:00080000:2.0:1786015590.989098:0:22905:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015590.989108:0:22905:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1786015590.989605:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 592 00000100:00100000:0.0:1786015590.989622:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280737408:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015590.989695:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280737408:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 81us (6104us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015590.989702:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 592 00000100:00100000:0.0:1786015590.989716:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 593 00000100:00100000:0.0:1786015590.989722:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280737024:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015590.989746:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280737024:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (6116us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015590.989752:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 593 00000100:00100000:0.0:1786015590.989776:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 594 00000100:00100000:0.0:1786015590.992013:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280737280:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015590.992096:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280737280:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 2313us (8425us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015590.992107:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 594 00000100:00100000:0.0:1786015590.992151:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280737152 00000100:00100000:0.0:1786015590.992159:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280737152 00000100:00100000:0.0:1786015590.992216:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280736768 00000100:00100000:0.0:1786015590.992220:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280736768 00000100:00100000:0.0:1786015590.992251:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 579 00000100:00100000:0.0:1786015590.992257:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280737152:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015590.992290:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280737152:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 34us (8731us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015590.992296:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 579 00000100:00100000:0.0:1786015590.992308:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 580 00000100:00100000:0.0:1786015590.992314:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280736768:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015590.992339:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280736768:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (8730us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015590.992345:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 580 00000100:00080000:0.0:1786015590.992533:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015590.992538:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015590.992541:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1786015590.994902:0:22905:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015590.994926:0:22905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015591.276067:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015591.598568:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786015591.598595:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304484864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015591.598667:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015591.598736:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304484864 00000100:00100000:2.0:1786015591.598744:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304484864 00000100:00100000:2.0:1786015591.598814:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1786015591.598823:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304484864:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786015591.598969:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1786015591.599007:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015591.599062:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1872772304484864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 240us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015591.599070:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1786015591.599161:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304484864:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1786015591.641082:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967384 is committed 00000001:00080000:2.0:1786015592.265019:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967399 is committed 00010000:00010000:2.0:1786015592.300960:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015593.141056:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304484992:0@lo:400:kworker.0 00000100:00100000:1.0:1786015593.141133:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015593.141201:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304485504:0@lo:400:kworker.0 00000100:00100000:1.0:1786015593.141230:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015593.141267:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786015593.141274:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304485120:0@lo:400:kworker.0 00000100:00100000:1.0:1786015593.141297:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015593.141318:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304485632:0@lo:400:kworker.0 00000100:00100000:1.0:1786015593.141341:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015593.141372:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304485248:0@lo:400:kworker.0 00000100:00100000:1.0:1786015593.141396:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015593.141415:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015593.141421:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304485376:0@lo:400:kworker.0 00000100:00100000:1.0:1786015593.141442:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015593.141475:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304484992 00000100:00100000:1.0:1786015593.141482:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304484992 00000100:00100000:1.0:1786015593.141527:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:1.0:1786015593.141536:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304484992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015593.141604:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304484992:12345-0@lo:400:kworker.0 Request processed in 68us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015593.141611:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:1.0:1786015593.141925:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304485504 00000100:00100000:1.0:1786015593.141929:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304485504 00000100:00100000:1.0:1786015593.141963:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304485120 00000100:00100000:1.0:1786015593.141966:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304485120 00000100:00100000:1.0:1786015593.141981:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304485248 00000100:00100000:1.0:1786015593.141984:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304485248 00000100:00100000:1.0:1786015593.141999:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1786015593.142006:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304485504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015593.142044:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304485504:12345-0@lo:400:kworker.0 Request processed in 39us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015593.142050:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1786015593.142063:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:1.0:1786015593.142069:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304485120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015593.142097:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304485120:12345-0@lo:400:kworker.0 Request processed in 29us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015593.142102:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:1.0:1786015593.142113:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:1.0:1786015593.142118:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304485248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015593.142148:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304485248:12345-0@lo:400:kworker.0 Request processed in 30us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015593.142154:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:1.0:1786015593.142185:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304485632 00000100:00100000:1.0:1786015593.142189:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304485632 00000100:00100000:1.0:1786015593.142215:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304485376 00000100:00100000:1.0:1786015593.142219:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304485376 00000100:00100000:1.0:1786015593.142237:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:1.0:1786015593.142244:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304485632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015593.142275:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304485632:12345-0@lo:400:kworker.0 Request processed in 32us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015593.142282:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:1.0:1786015593.142293:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:1.0:1786015593.142299:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304485376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015593.142326:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304485376:12345-0@lo:400:kworker.0 Request processed in 27us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015593.142332:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:1.0:1786015593.142375:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304485120:0@lo:400:kworker.0 00000100:00100000:1.0:1786015593.142385:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967399 gen 2 00000004:00080000:1.0:1786015593.142390:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b74aef01500, transno 4294967398 00000004:00080000:1.0:1786015593.142400:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b74aef00a80, transno 4294967399 00000100:00100000:1.0:1786015593.142405:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304485632:0@lo:400:kworker.0 00000100:00100000:1.0:1786015593.142417:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304484992:0@lo:400:kworker.0 00000100:00100000:1.0:1786015593.142425:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304485504:0@lo:400:kworker.0 00000100:00080000:1.0:1786015593.142462:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015593.142466:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015593.142469:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015593.142487:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967384 gen 2 00000004:00080000:1.0:1786015593.142491:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b7383aace00, transno 4294967384 00000100:00100000:1.0:1786015593.142501:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304485376:0@lo:400:kworker.0 00000100:00100000:1.0:1786015593.142512:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304485248:0@lo:400:kworker.0 00000040:00080000:0.0:1786015593.162263:0:22958:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015593.162276:0:22958:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015593.164120:0:22958:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015593.164135:0:22958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015593.325034:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015593.644142:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786015593.644166:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304485760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015593.644245:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015593.644465:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304485760 00000100:00100000:1.0:1786015593.644474:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304485760 00000100:00100000:1.0:1786015593.644528:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1786015593.644547:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304485760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015593.644604:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015593.644665:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304485760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015593.644673:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1786015593.644982:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304485760:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786015594.351510:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015595.367012:0:23010:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015595.367021:0:23010:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015595.367579:0:23010:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015595.367590:0:23010:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786015595.376474:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015596.097999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015596.098058:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015596.098170:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280737536 00000100:00100000:0.0:1786015596.098184:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280737536 00000100:00100000:0.0:1786015596.098272:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 652 00000100:00100000:0.0:1786015596.098283:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280737536:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015596.098379:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280737536:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 99us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015596.098388:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 652 00000100:00100000:1.0:1786015596.102180:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280737664 00000100:00100000:1.0:1786015596.102199:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280737664 00000100:00100000:1.0:1786015596.102319:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 584 00000100:00100000:1.0:1786015596.102333:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+108:2351:x1872772280737664:12345-192.168.202.56@tcp:400:kworker.0 00000100:00080000:2.0:1786015596.102424:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015596.102446:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+108:2351:x1872772280737664:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 118us (4387us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015596.102455:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 584 00000100:00100000:3.0:1786015596.112073:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015596.112134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015596.112168:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015596.112211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015596.112433:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015596.113563:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280737920 00000100:00100000:0.0:1786015596.113576:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280737920 00000100:00100000:0.0:1786015596.113650:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280738176 00000100:00100000:0.0:1786015596.113654:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280738176 00000100:00100000:0.0:1786015596.113679:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280737792 00000100:00100000:0.0:1786015596.113682:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280737792 00000100:00100000:0.0:1786015596.113897:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 597 00000100:00100000:0.0:1786015596.113910:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2352:x1872772280737920:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015596.114004:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2352:x1872772280737920:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 97us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015596.114012:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 597 00000100:00100000:0.0:1786015596.114032:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 598 00000100:00100000:0.0:1786015596.114038:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280738176:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015596.114063:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280738176:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015596.114262:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 598 00000100:00100000:0.0:1786015596.114277:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 599 00000100:00100000:0.0:1786015596.114285:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2352:x1872772280737792:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015596.114313:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2352:x1872772280737792:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (2144us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015596.114320:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 599 00000100:00080000:0.0:1786015596.115242:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015596.115249:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015596.115271:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280738048 00000100:00100000:0.0:1786015596.115280:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280738048 00000100:00100000:0.0:1786015596.115344:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 585 00000100:00100000:0.0:1786015596.115352:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2352:x1872772280738048:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015596.115409:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2352:x1872772280738048:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 58us (3196us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015596.115415:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 585 00000100:00080000:0.0:1786015596.115441:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015596.119274:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280738304 00000100:00100000:1.0:1786015596.119293:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280738304 00000100:00100000:1.0:1786015596.119396:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 600 00000100:00100000:1.0:1786015596.119408:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280738304:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015596.119497:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280738304:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 92us (7065us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015596.119504:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 600 00000100:00080000:2.0:1786015596.121746:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1786015596.401292:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015596.717308:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786015596.717333:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304485888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015596.717418:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015596.717501:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304485888 00000100:00100000:2.0:1786015596.717523:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304485888 00000100:00100000:2.0:1786015596.717580:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1786015596.717590:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304485888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015596.717625:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015596.717669:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304485888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015596.717676:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:2.0:1786015596.717697:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015596.717733:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304485888:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1786015596.908525:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015596.908535:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015596.909098:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015596.909109:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015597.423955:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015597.442148:0:23062:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015597.442158:0:23062:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015597.443963:0:23062:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015597.443982:0:23062:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015598.252214:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304486016:0@lo:400:kworker.0 00000100:00100000:1.0:1786015598.252297:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015598.252529:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304486144:0@lo:400:kworker.0 00000100:00100000:2.0:1786015598.252576:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015598.252648:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304486144 00000100:00100000:2.0:1786015598.252656:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304486144 00000100:00100000:2.0:1786015598.252710:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1786015598.252720:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304486144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015598.252956:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304486016 00000100:00100000:0.0:1786015598.252962:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304486016 00000100:00100000:0.0:1786015598.252997:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1786015598.253004:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304486016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015598.253219:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304486144:12345-0@lo:400:kworker.0 Request processed in 500us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015598.253228:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1786015598.253272:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304486144:0@lo:400:kworker.0 00000100:00100000:3.0:1786015598.260526:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304486400:0@lo:400:kworker.0 00000100:00100000:3.0:1786015598.260617:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015598.260663:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786015598.260669:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304486272:0@lo:400:kworker.0 00000100:00100000:3.0:1786015598.260699:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015598.260730:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304486656:0@lo:400:kworker.0 00000100:00100000:3.0:1786015598.260757:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015598.261193:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786015598.261201:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304486528:0@lo:400:kworker.0 00000100:00100000:3.0:1786015598.261230:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015598.261280:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304486400 00000100:00100000:3.0:1786015598.261287:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304486400 00000100:00100000:3.0:1786015598.261342:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304486656 00000100:00100000:3.0:1786015598.261346:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304486656 00000100:00100000:3.0:1786015598.261388:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:3.0:1786015598.261398:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304486400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015598.261471:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304486400:12345-0@lo:400:kworker.0 Request processed in 74us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015598.261478:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:3.0:1786015598.261507:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:3.0:1786015598.261514:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304486656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015598.261546:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304486656:12345-0@lo:400:kworker.0 Request processed in 33us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015598.261553:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:3.0:1786015598.261572:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304486272 00000100:00100000:3.0:1786015598.261577:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304486272 00000100:00100000:3.0:1786015598.261861:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304486528 00000100:00100000:3.0:1786015598.261866:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304486528 00000100:00100000:3.0:1786015598.261888:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:3.0:1786015598.261895:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304486272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015598.261929:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304486272:12345-0@lo:400:kworker.0 Request processed in 35us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015598.262007:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:3.0:1786015598.262022:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1786015598.262029:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304486528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015598.262058:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304486528:12345-0@lo:400:kworker.0 Request processed in 31us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015598.262064:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1786015598.262109:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304486272:0@lo:400:kworker.0 00000100:00100000:3.0:1786015598.262119:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304486400:0@lo:400:kworker.0 00000100:00100000:3.0:1786015598.262150:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304486528:0@lo:400:kworker.0 00000100:00100000:3.0:1786015598.262159:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304486656:0@lo:400:kworker.0 00000100:00080000:2.0:1786015598.262550:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786015598.262556:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015598.262559:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015598.265879:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304486016:12345-0@lo:400:kworker.0 Request processed in 12575us (13283us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015598.265898:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:1.0:1786015598.269234:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304486016:0@lo:400:kworker.0 00010000:00010000:0.0:1786015598.444526:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015598.765237:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786015598.765265:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304486784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015598.765338:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015598.765532:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304486784 00000100:00100000:0.0:1786015598.765541:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304486784 00000100:00100000:0.0:1786015598.765598:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1786015598.765608:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304486784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015598.765644:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015598.765705:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304486784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015598.765712:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1786015598.766326:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304486784:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786015599.468149:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015599.555700:0:23113:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015599.555710:0:23113:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015599.559016:0:23113:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015599.559035:0:23113:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786015600.492056:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015601.219954:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015601.220041:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015601.220067:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015601.220097:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015601.220117:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015601.220138:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015601.222064:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015601.222110:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280738816 00000100:00100000:0.0:1786015601.222120:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280738816 00000100:00100000:0.0:1786015601.222179:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280739072 00000100:00100000:0.0:1786015601.222183:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280739072 00000100:00100000:0.0:1786015601.222204:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280738688 00000100:00100000:0.0:1786015601.222206:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280738688 00000100:00100000:0.0:1786015601.222221:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280739200 00000100:00100000:0.0:1786015601.222224:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280739200 00000100:00100000:0.0:1786015601.222242:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 603 00000100:00100000:0.0:1786015601.222254:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280738816:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015601.222340:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280738816:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 88us (2298us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015601.222348:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 603 00000100:00100000:0.0:1786015601.222372:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 604 00000100:00100000:0.0:1786015601.222378:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280739072:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015601.222403:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280739072:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (2334us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015601.222413:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 604 00000100:00100000:0.0:1786015601.222425:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 605 00000100:00100000:0.0:1786015601.222432:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280738688:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015601.222454:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280738688:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (2336us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015601.222461:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 605 00000100:00100000:0.0:1786015601.222484:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 606 00000100:00100000:0.0:1786015601.222491:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280739200:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015601.222515:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280739200:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015601.222520:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 606 00000100:00100000:0.0:1786015601.222544:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280738432 00000100:00100000:0.0:1786015601.222696:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280738432 00000100:00100000:0.0:1786015601.222734:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 654 00000100:00100000:0.0:1786015601.222741:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280738432:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015601.222796:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280738432:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 55us (2698us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015601.222802:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 654 00000100:00080000:0.0:1786015601.222837:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015601.222842:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015601.224805:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280738560 00000100:00100000:1.0:1786015601.224822:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280738560 00000100:00100000:1.0:1786015601.224909:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280738944 00000100:00100000:1.0:1786015601.224913:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280738944 00000100:00100000:1.0:1786015601.224939:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 589 00000100:00100000:1.0:1786015601.224948:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280738560:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015601.225034:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280738560:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 86us (5092us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015601.225042:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 589 00000100:00100000:1.0:1786015601.225167:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 590 00000100:00100000:1.0:1786015601.225174:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280738944:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015601.225204:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280738944:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (5066us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015601.225209:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 590 00000100:00080000:0.0:1786015601.225520:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786015601.516648:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015601.720272:0:23165:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015601.720283:0:23165:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015601.721432:0:23165:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015601.721444:0:23165:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015601.836055:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304486912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015601.836160:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015601.836288:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304486912 00000100:00100000:0.0:1786015601.836297:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304486912 00000100:00100000:0.0:1786015601.836374:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1786015601.836384:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304486912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015601.836431:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015601.836500:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304486912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015601.836508:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00080000:0.0:1786015601.836534:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015601.836580:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304486912:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786015602.541847:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015603.372082:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304487424:0@lo:400:kworker.0 00000100:00100000:0.0:1786015603.372161:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015603.372219:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786015603.372226:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304487296:0@lo:400:kworker.0 00000100:00100000:0.0:1786015603.372253:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015603.372293:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304487424 00000100:00100000:0.0:1786015603.372300:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304487424 00000100:00100000:0.0:1786015603.372354:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1786015603.372365:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304487424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015603.372417:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304487424:12345-0@lo:400:kworker.0 Request processed in 54us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015603.372424:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1786015603.372461:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304487296 00000100:00100000:0.0:1786015603.372465:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304487296 00000100:00100000:0.0:1786015603.372492:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:0.0:1786015603.372500:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304487296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015603.372533:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304487296:12345-0@lo:400:kworker.0 Request processed in 34us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015603.372539:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00080000:0.0:1786015603.372556:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015603.372560:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015603.372592:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304487296:0@lo:400:kworker.0 00000100:00100000:0.0:1786015603.372603:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304487424:0@lo:400:kworker.0 00000100:00100000:3.0:1786015603.372677:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304487168:0@lo:400:kworker.0 00000100:00100000:3.0:1786015603.372706:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015603.372736:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304487680:0@lo:400:kworker.0 00000100:00100000:3.0:1786015603.372785:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015603.372803:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786015603.372808:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304487040:0@lo:400:kworker.0 00000100:00100000:3.0:1786015603.372833:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015603.372851:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304487552:0@lo:400:kworker.0 00000100:00100000:3.0:1786015603.372868:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015603.372888:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304487680 00000100:00100000:3.0:1786015603.372891:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304487680 00000100:00100000:3.0:1786015603.372919:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:3.0:1786015603.372925:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304487680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015603.372961:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304487680:12345-0@lo:400:kworker.0 Request processed in 36us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015603.372967:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:3.0:1786015603.372992:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304487680:0@lo:400:kworker.0 00000100:00100000:2.0:1786015603.373108:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304487040 00000100:00100000:2.0:1786015603.373113:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304487040 00000100:00100000:2.0:1786015603.373138:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:2.0:1786015603.373145:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304487040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015603.373183:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304487040:12345-0@lo:400:kworker.0 Request processed in 38us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015603.373188:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:2.0:1786015603.373222:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304487040:0@lo:400:kworker.0 00000100:00100000:1.0:1786015603.373358:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304487168 00000100:00100000:1.0:1786015603.373363:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304487168 00000100:00100000:1.0:1786015603.373400:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304487552 00000100:00100000:1.0:1786015603.373404:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304487552 00000100:00100000:1.0:1786015603.373436:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:1.0:1786015603.373443:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304487168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015603.373460:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1786015603.373468:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304487552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015603.373492:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304487168:12345-0@lo:400:kworker.0 Request processed in 50us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015603.373492:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304487552:12345-0@lo:400:kworker.0 Request processed in 27us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015603.373498:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:2.0:1786015603.373554:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304487552:0@lo:400:kworker.0 00000100:00100000:2.0:1786015603.373563:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304487168:0@lo:400:kworker.0 00000100:00080000:0.0:1786015603.373648:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015603.373651:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015603.380237:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00010000:00010000:3.0:1786015603.564597:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015603.887868:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786015603.887897:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304487808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015603.887970:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015603.888118:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304487808 00000100:00100000:3.0:1786015603.888127:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304487808 00000100:00100000:3.0:1786015603.888173:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1786015603.888182:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304487808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015603.888224:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015603.888282:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304487808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015603.888290:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1786015603.888335:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304487808:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1786015603.966272:0:23216:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015603.966288:0:23216:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015603.974190:0:23216:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015603.974209:0:23216:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786015604.594316:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015605.614980:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015606.125414:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015606.125441:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015606.126526:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015606.126545:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1786015606.154132:0:23267:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015606.154147:0:23267:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015606.154680:0:23267:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015606.154692:0:23267:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015606.335382:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015606.335451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015606.335488:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015606.335513:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015606.335534:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015606.335554:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015606.335583:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015606.335624:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280739584 00000100:00100000:1.0:1786015606.335638:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280739584 00000100:00100000:1.0:1786015606.335712:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280740096 00000100:00100000:1.0:1786015606.335715:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280740096 00000100:00100000:1.0:1786015606.335736:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280739712 00000100:00100000:1.0:1786015606.335739:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280739712 00000100:00100000:1.0:1786015606.335754:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280739968 00000100:00100000:1.0:1786015606.335757:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280739968 00000100:00100000:1.0:1786015606.335809:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 609 00000100:00100000:1.0:1786015606.335820:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280739584:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015606.335933:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280739584:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 115us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015606.335946:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 609 00000100:00100000:1.0:1786015606.335966:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 610 00000100:00100000:1.0:1786015606.335972:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280740096:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015606.335999:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280740096:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015606.336005:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 610 00000100:00100000:1.0:1786015606.336017:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 611 00000100:00100000:1.0:1786015606.336022:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280739712:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015606.336043:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280739712:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015606.336049:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 611 00000100:00100000:1.0:1786015606.336060:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 612 00000100:00100000:1.0:1786015606.336066:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280739968:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015606.336090:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280739968:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015606.336096:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 612 00000100:00100000:1.0:1786015606.336119:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280739840 00000100:00100000:1.0:1786015606.336123:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280739840 00000100:00100000:1.0:1786015606.336157:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280739456 00000100:00100000:1.0:1786015606.336160:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280739456 00000100:00100000:1.0:1786015606.336182:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 594 00000100:00100000:1.0:1786015606.336188:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280739840:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015606.336222:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280739840:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 34us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015606.336230:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 594 00000100:00100000:1.0:1786015606.336243:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 595 00000100:00100000:1.0:1786015606.336249:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280739456:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015606.336273:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280739456:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015606.336279:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 595 00000100:00080000:1.0:1786015606.336316:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015606.336321:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015606.336323:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015606.336793:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280739328 00000100:00100000:2.0:1786015606.336800:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280739328 00000100:00100000:2.0:1786015606.336842:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 656 00000100:00100000:2.0:1786015606.336850:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74864ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280739328:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015606.336903:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74864ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280739328:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 54us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015606.336910:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 656 00010000:00010000:0.0:1786015606.637377:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015606.957008:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304487936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015606.957124:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015606.957353:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304487936 00000100:00100000:0.0:1786015606.957365:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304487936 00000100:00100000:0.0:1786015606.957453:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1786015606.957464:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304487936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015606.957510:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015606.957568:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304487936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015606.957578:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00080000:1.0:1786015606.957756:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015606.957838:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304487936:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786015607.660922:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015608.368291:0:23319:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015608.368305:0:23319:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015608.370739:0:23319:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015608.370779:0:23319:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015608.492169:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304488320:0@lo:400:kworker.0 00000100:00100000:3.0:1786015608.492269:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015608.492349:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015608.492356:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304488448:0@lo:400:kworker.0 00000100:00100000:3.0:1786015608.492383:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015608.492442:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304488320 00000100:00100000:3.0:1786015608.492451:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304488320 00000100:00100000:3.0:1786015608.492535:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:3.0:1786015608.492548:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304488320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015608.492680:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304488320:12345-0@lo:400:kworker.0 Request processed in 135us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015608.492688:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:3.0:1786015608.492713:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304488448 00000100:00100000:3.0:1786015608.492717:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304488448 00000100:00100000:3.0:1786015608.492747:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1786015608.492754:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304488448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015608.492814:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304488448:12345-0@lo:400:kworker.0 Request processed in 60us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015608.492819:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00080000:3.0:1786015608.492834:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786015608.492839:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015608.492884:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304488448:0@lo:400:kworker.0 00000100:00100000:3.0:1786015608.492896:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304488320:0@lo:400:kworker.0 00000100:00100000:0.0:1786015608.493162:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304488064:0@lo:400:kworker.0 00000100:00100000:0.0:1786015608.493208:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015608.493240:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304488576:0@lo:400:kworker.0 00000100:00100000:0.0:1786015608.493266:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015608.493289:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1786015608.493295:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304488192:0@lo:400:kworker.0 00000100:00100000:0.0:1786015608.493318:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015608.493338:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304488704:0@lo:400:kworker.0 00000100:00100000:0.0:1786015608.493363:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015608.493425:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304488064 00000100:00100000:0.0:1786015608.493430:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304488064 00000100:00100000:0.0:1786015608.493472:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1786015608.493479:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74864ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304488064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015608.493530:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74864ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304488064:12345-0@lo:400:kworker.0 Request processed in 52us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015608.493537:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1786015608.493572:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304488576 00000100:00100000:0.0:1786015608.493700:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304488576 00000100:00100000:0.0:1786015608.493740:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304488192 00000100:00100000:0.0:1786015608.493744:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304488192 00000100:00100000:0.0:1786015608.493796:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:0.0:1786015608.493803:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304488576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015608.493840:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304488576:12345-0@lo:400:kworker.0 Request processed in 38us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015608.493848:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:0.0:1786015608.493860:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1786015608.493866:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304488192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015608.493893:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304488192:12345-0@lo:400:kworker.0 Request processed in 27us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015608.493899:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1786015608.493927:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304488704 00000100:00100000:0.0:1786015608.493931:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304488704 00000100:00100000:0.0:1786015608.494041:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:0.0:1786015608.494049:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304488704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015608.494085:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304488704:12345-0@lo:400:kworker.0 Request processed in 37us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015608.494091:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00080000:0.0:1786015608.494120:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015608.494124:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015608.494154:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304488192:0@lo:400:kworker.0 00000100:00100000:0.0:1786015608.494165:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304488704:0@lo:400:kworker.0 00000100:00100000:0.0:1786015608.494174:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304488064:0@lo:400:kworker.0 00000100:00100000:0.0:1786015608.494183:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304488576:0@lo:400:kworker.0 00010000:00010000:2.0:1786015608.684276:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015609.004727:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304488832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015609.004846:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015609.005112:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304488832 00000100:00100000:0.0:1786015609.005122:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304488832 00000100:00100000:0.0:1786015609.005183:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1786015609.005192:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304488832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015609.005243:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015609.005476:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304488832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 283us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015609.005608:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1786015609.005749:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304488832:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786015609.712396:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015610.289239:0:23370:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015610.289252:0:23370:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015610.295481:0:23370:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015610.295502:0:23370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015610.732005:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015611.462540:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015611.462640:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015611.462710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015611.462740:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280740352 00000100:00100000:3.0:1786015611.462753:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280740352 00000100:00100000:3.0:1786015611.462852:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 599 00000100:00100000:3.0:1786015611.462868:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280740352:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015611.462952:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280740352:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 89us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015611.462960:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 599 00000100:00080000:3.0:1786015611.462996:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015611.476973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015611.477020:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015611.481859:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280740608 00000100:00100000:2.0:1786015611.481875:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280740608 00000100:00100000:2.0:1786015611.481946:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280740864 00000100:00100000:2.0:1786015611.481950:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280740864 00000100:00100000:2.0:1786015611.481991:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 615 00000100:00100000:2.0:1786015611.482010:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280740608:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015611.482088:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280740608:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 89us (19447us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015611.482095:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 615 00000100:00100000:2.0:1786015611.482113:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 616 00000100:00100000:2.0:1786015611.482119:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280740864:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015611.482139:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280740864:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (19429us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015611.482144:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 616 00000100:00080000:2.0:1786015611.482289:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015611.482294:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015611.482341:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280740224 00000100:00100000:2.0:1786015611.482345:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280740224 00000100:00100000:2.0:1786015611.482387:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 658 00000100:00100000:2.0:1786015611.482393:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280740224:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015611.482420:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280740224:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (5467us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015611.482426:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 658 00000100:00100000:0.0:1786015611.483173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015611.483196:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280740736 00000100:00100000:0.0:1786015611.483201:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280740736 00000100:00100000:0.0:1786015611.483236:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 600 00000100:00100000:0.0:1786015611.483243:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280740736:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015611.483280:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280740736:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015611.483287:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 600 00000100:00100000:0.0:1786015611.483323:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015611.483338:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280740480 00000100:00100000:0.0:1786015611.483341:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280740480 00000100:00100000:0.0:1786015611.483358:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280740992 00000100:00100000:0.0:1786015611.483376:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280740992 00000100:00100000:0.0:1786015611.483394:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 617 00000100:00100000:0.0:1786015611.483400:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280740480:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015611.483421:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280740480:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (6402us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015611.483431:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 617 00000100:00100000:0.0:1786015611.483441:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 618 00000100:00100000:0.0:1786015611.483445:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280740992:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015611.483462:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280740992:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 16us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015611.483467:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 618 00000100:00080000:2.0:1786015611.485528:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015611.485538:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015611.485542:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786015611.756585:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015612.078557:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786015612.078584:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aee58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304488960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015612.078648:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015612.078713:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304488960 00000100:00100000:2.0:1786015612.078720:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304488960 00000100:00100000:2.0:1786015612.078796:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1786015612.078810:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304488960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015612.078849:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015612.078889:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304488960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015612.078896:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:2.0:1786015612.078915:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015612.078949:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aee58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304488960:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1786015612.399022:0:23421:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015612.399032:0:23421:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015612.403659:0:23421:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015612.403681:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786015612.779978:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015613.612150:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304489216:0@lo:400:kworker.0 00000100:00100000:2.0:1786015613.612232:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015613.612299:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304489728:0@lo:400:kworker.0 00000100:00100000:2.0:1786015613.612326:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015613.612363:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1786015613.612370:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304489088:0@lo:400:kworker.0 00000100:00100000:2.0:1786015613.612400:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015613.612547:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304489600:0@lo:400:kworker.0 00000100:00100000:2.0:1786015613.612573:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015613.612603:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304489728 00000100:00100000:2.0:1786015613.612610:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304489728 00000100:00100000:2.0:1786015613.612674:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:2.0:1786015613.612685:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304489728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015613.612749:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304489344:0@lo:400:kworker.0 00000100:00100000:2.0:1786015613.612752:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304489728:12345-0@lo:400:kworker.0 Request processed in 68us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015613.612824:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304489216 00000100:00100000:3.0:1786015613.612831:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304489216 00000100:00100000:1.0:1786015613.612860:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015613.612913:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015613.612923:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304489472:0@lo:400:kworker.0 00000100:00100000:0.0:1786015613.612942:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304489088 00000100:00100000:0.0:1786015613.612949:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304489088 00000100:00100000:1.0:1786015613.612960:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015613.613002:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:0.0:1786015613.613012:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304489088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015613.613064:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304489088:12345-0@lo:400:kworker.0 Request processed in 54us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015613.613071:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:0.0:1786015613.613106:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304489472 00000100:00100000:0.0:1786015613.613110:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304489472 00000100:00100000:0.0:1786015613.613137:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:0.0:1786015613.613143:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304489472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015613.613181:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304489472:12345-0@lo:400:kworker.0 Request processed in 38us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015613.613188:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:2.0:1786015613.613317:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00080000:2.0:1786015613.613336:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015613.613368:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304489088:0@lo:400:kworker.0 00000100:00100000:2.0:1786015613.613380:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304489728:0@lo:400:kworker.0 00000100:00100000:0.0:1786015613.613626:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304489472:0@lo:400:kworker.0 00000100:00100000:3.0:1786015613.628322:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304489600 00000100:00100000:3.0:1786015613.628343:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304489600 00000100:00100000:3.0:1786015613.628461:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304489344 00000100:00100000:3.0:1786015613.628466:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304489344 00000100:00100000:3.0:1786015613.628496:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:3.0:1786015613.628508:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304489216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015613.628638:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304489216:12345-0@lo:400:kworker.0 Request processed in 132us (16405us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015613.628646:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:3.0:1786015613.628665:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:3.0:1786015613.628671:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304489600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015613.628701:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304489600:12345-0@lo:400:kworker.0 Request processed in 31us (16127us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015613.628706:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:3.0:1786015613.628718:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:3.0:1786015613.628725:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304489344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015613.628777:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304489344:12345-0@lo:400:kworker.0 Request processed in 35us (15902us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015613.628783:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00080000:3.0:1786015613.628807:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015613.628852:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304489344:0@lo:400:kworker.0 00000100:00100000:3.0:1786015613.628907:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304489600:0@lo:400:kworker.0 00000100:00100000:3.0:1786015613.628921:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304489216:0@lo:400:kworker.0 00010000:00010000:0.0:1786015613.809911:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015614.123959:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786015614.123992:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304489856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015614.124102:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015614.124201:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304489856 00000100:00100000:3.0:1786015614.124212:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304489856 00000100:00100000:3.0:1786015614.124281:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1786015614.124291:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304489856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015614.124350:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015614.124409:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304489856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015614.124418:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1786015614.126150:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304489856:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1786015614.529205:0:23472:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015614.529220:0:23472:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015614.531044:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015614.531062:0:23472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015614.829907:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015615.853867:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015616.365038:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015616.365070:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015616.366479:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015616.366505:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015616.576090:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015616.576138:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015616.576162:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015616.576184:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015616.576204:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015616.576226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015616.576276:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015616.576313:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280741120 00000100:00100000:3.0:1786015616.576339:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280741120 00000100:00100000:3.0:1786015616.576398:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 660 00000100:00100000:3.0:1786015616.576408:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280741120:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015616.576486:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280741120:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 79us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015616.576493:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 660 00000100:00100000:3.0:1786015616.576526:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280741248 00000100:00100000:3.0:1786015616.576529:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280741248 00000100:00100000:3.0:1786015616.576577:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280741632 00000100:00100000:3.0:1786015616.576580:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280741632 00000100:00100000:3.0:1786015616.576601:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 604 00000100:00100000:3.0:1786015616.576607:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+108:2351:x1872772280741248:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015616.576640:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+108:2351:x1872772280741248:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 34us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015616.576647:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 604 00000100:00100000:3.0:1786015616.576658:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 605 00000100:00100000:3.0:1786015616.576663:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2352:x1872772280741632:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015616.576685:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2352:x1872772280741632:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015616.576691:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 605 00000100:00100000:3.0:1786015616.576709:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280741504 00000100:00100000:3.0:1786015616.576712:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280741504 00000100:00100000:3.0:1786015616.576736:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280741376 00000100:00100000:3.0:1786015616.576739:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280741376 00000100:00100000:3.0:1786015616.576756:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280741760 00000100:00100000:3.0:1786015616.576783:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280741760 00000100:00100000:3.0:1786015616.576797:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280741888 00000100:00100000:3.0:1786015616.576799:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280741888 00000100:00100000:3.0:1786015616.576812:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 621 00000100:00100000:3.0:1786015616.576817:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+18:2351:x1872772280741504:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015616.576843:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+18:2351:x1872772280741504:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015616.576850:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 621 00000100:00100000:3.0:1786015616.576861:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 622 00000100:00100000:3.0:1786015616.576867:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+17:2352:x1872772280741376:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015616.576888:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+17:2352:x1872772280741376:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015616.576894:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 622 00000100:00100000:3.0:1786015616.576904:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 623 00000100:00100000:3.0:1786015616.576909:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280741760:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015616.576929:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280741760:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015616.576935:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 623 00000100:00100000:3.0:1786015616.576945:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 624 00000100:00100000:3.0:1786015616.576951:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280741888:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015616.576973:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280741888:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015616.576979:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 624 00000100:00080000:3.0:1786015616.577150:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786015616.577154:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015616.577156:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1786015616.647749:0:23524:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015616.647798:0:23524:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015616.648406:0:23524:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015616.648419:0:23524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786015616.875882:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015617.198833:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015617.198866:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304489984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015617.198950:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015617.201921:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304489984 00000100:00100000:3.0:1786015617.201938:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304489984 00000100:00100000:3.0:1786015617.202031:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1786015617.202042:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304489984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015617.202083:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015617.202168:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304489984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (3218us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015617.202174:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00080000:2.0:1786015617.202248:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015617.203004:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304489984:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786015617.903211:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015618.690452:0:23575:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015618.690465:0:23575:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015618.690996:0:23575:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015618.691006:0:23575:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015618.732168:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304490240:0@lo:400:kworker.0 00000100:00100000:0.0:1786015618.732253:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015618.732322:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304490752:0@lo:400:kworker.0 00000100:00100000:0.0:1786015618.732353:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015618.732379:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1786015618.732385:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304490112:0@lo:400:kworker.0 00000100:00100000:0.0:1786015618.732413:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015618.732437:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304490624:0@lo:400:kworker.0 00000100:00100000:0.0:1786015618.732458:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015618.732486:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304490368:0@lo:400:kworker.0 00000100:00100000:0.0:1786015618.732509:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015618.732529:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015618.732534:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304490496:0@lo:400:kworker.0 00000100:00100000:0.0:1786015618.732554:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015618.732584:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304490240 00000100:00100000:0.0:1786015618.732603:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304490240 00000100:00100000:0.0:1786015618.732653:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304490624 00000100:00100000:0.0:1786015618.732656:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304490624 00000100:00100000:0.0:1786015618.732683:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304490368 00000100:00100000:0.0:1786015618.732686:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304490368 00000100:00100000:0.0:1786015618.732703:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:0.0:1786015618.732711:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304490240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015618.732780:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304490240:12345-0@lo:400:kworker.0 Request processed in 51us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015618.732789:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:0.0:1786015618.732806:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1786015618.732812:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304490624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015618.732841:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304490624:12345-0@lo:400:kworker.0 Request processed in 29us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015618.732846:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1786015618.732857:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:0.0:1786015618.732863:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304490368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015618.732892:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304490368:12345-0@lo:400:kworker.0 Request processed in 30us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015618.732897:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:0.0:1786015618.732914:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304490752 00000100:00100000:0.0:1786015618.732917:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304490752 00000100:00100000:0.0:1786015618.732941:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304490496 00000100:00100000:0.0:1786015618.732944:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304490496 00000100:00100000:0.0:1786015618.732963:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:0.0:1786015618.732970:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304490752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015618.733001:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304490752:12345-0@lo:400:kworker.0 Request processed in 30us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015618.733006:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:0.0:1786015618.733017:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:0.0:1786015618.733023:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304490496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015618.733049:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304490496:12345-0@lo:400:kworker.0 Request processed in 27us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015618.733055:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:0.0:1786015618.733072:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304490112 00000100:00100000:0.0:1786015618.733076:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304490112 00000100:00100000:0.0:1786015618.733099:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:0.0:1786015618.733106:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304490112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015618.733136:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304490112:12345-0@lo:400:kworker.0 Request processed in 31us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015618.733141:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00080000:0.0:1786015618.733176:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015618.733180:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015618.733216:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304490496:0@lo:400:kworker.0 00000100:00100000:0.0:1786015618.733226:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304490368:0@lo:400:kworker.0 00000100:00100000:0.0:1786015618.733251:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304490112:0@lo:400:kworker.0 00000100:00100000:0.0:1786015618.733259:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304490624:0@lo:400:kworker.0 00000100:00100000:0.0:1786015618.733267:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af06a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304490240:0@lo:400:kworker.0 00000100:00100000:0.0:1786015618.733274:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304490752:0@lo:400:kworker.0 00010000:00010000:1.0:1786015618.926375:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015619.244242:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304490880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015619.244336:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015619.244720:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304490880 00000100:00100000:3.0:1786015619.244730:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304490880 00000100:00100000:3.0:1786015619.244805:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1786015619.244815:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304490880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015619.244858:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015619.244973:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304490880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015619.244985:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1786015619.248816:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304490880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786015619.948860:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015620.971980:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015621.044558:0:23626:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015621.044576:0:23626:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015621.045178:0:23626:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015621.045189:0:23626:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015621.698207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015621.698280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015621.698320:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015621.698341:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015621.698358:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015621.698377:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015621.698406:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015621.698452:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280742528 00000100:00100000:0.0:1786015621.698466:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280742528 00000100:00100000:0.0:1786015621.698540:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280742144 00000100:00100000:0.0:1786015621.698544:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280742144 00000100:00100000:0.0:1786015621.698571:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 609 00000100:00100000:0.0:1786015621.698583:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280742528:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015621.698681:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280742528:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 100us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015621.698690:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 609 00000100:00100000:0.0:1786015621.698711:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 610 00000100:00100000:0.0:1786015621.698717:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280742144:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015621.698742:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280742144:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015621.698748:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 610 00000100:00100000:0.0:1786015621.698806:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280742272 00000100:00100000:0.0:1786015621.698810:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280742272 00000100:00100000:1.0:1786015621.699101:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280742016 00000100:00100000:1.0:1786015621.699107:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280742016 00000100:00100000:1.0:1786015621.699149:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 662 00000100:00100000:1.0:1786015621.699158:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280742016:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015621.699190:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280742016:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 34us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015621.699198:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 662 00000100:00100000:0.0:1786015621.699267:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280742784 00000100:00100000:0.0:1786015621.699282:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280742784 00000100:00080000:1.0:1786015621.702936:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015621.702954:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015621.702959:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015621.709480:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280742400 00000100:00100000:0.0:1786015621.709505:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280742400 00000100:00100000:2.0:1786015621.709657:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280742656 00000100:00100000:2.0:1786015621.709664:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280742656 00000100:00100000:2.0:1786015621.709702:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 627 00000100:00100000:2.0:1786015621.709715:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280742272:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015621.709857:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280742272:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 143us (11584us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015621.709866:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 627 00000100:00100000:2.0:1786015621.709896:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 628 00000100:00100000:2.0:1786015621.709904:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280742784:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015621.709932:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280742784:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (11591us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015621.709940:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 628 00000100:00100000:2.0:1786015621.709953:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 629 00000100:00100000:2.0:1786015621.709959:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280742400:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015621.709985:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280742400:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (11608us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015621.709991:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 629 00000100:00100000:2.0:1786015621.710013:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 630 00000100:00100000:2.0:1786015621.710021:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280742656:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015621.710043:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280742656:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (11636us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015621.710049:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 630 00000100:00080000:1.0:1786015621.715569:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015621.715585:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786015621.997301:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015622.322635:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015622.322677:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304491008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015622.322829:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015622.323589:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304491008 00000100:00100000:1.0:1786015622.323604:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304491008 00000100:00100000:1.0:1786015622.323696:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1786015622.323708:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304491008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015622.323777:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015622.323863:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304491008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015622.323871:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:1.0:1786015622.323901:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015622.324612:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304491008:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786015623.019991:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015623.255649:0:23678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015623.255661:0:23678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015623.256638:0:23678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015623.256656:0:23678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015623.853916:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304491264:0@lo:400:kworker.0 00000100:00100000:0.0:1786015623.854043:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015623.854122:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304491776:0@lo:400:kworker.0 00000100:00100000:0.0:1786015623.854154:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015623.854180:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1786015623.854185:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304491136:0@lo:400:kworker.0 00000100:00100000:0.0:1786015623.854215:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015623.854238:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738374ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304491648:0@lo:400:kworker.0 00000100:00100000:0.0:1786015623.854269:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015623.854301:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304491136 00000100:00100000:0.0:1786015623.854309:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304491136 00000100:00100000:0.0:1786015623.854361:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:0.0:1786015623.854371:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304491136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015623.854430:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304491136:12345-0@lo:400:kworker.0 Request processed in 59us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015623.854438:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:0.0:1786015623.854480:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304491264 00000100:00100000:0.0:1786015623.854483:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304491264 00000100:00100000:0.0:1786015623.854510:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304491648 00000100:00100000:0.0:1786015623.854513:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304491648 00000100:00100000:0.0:1786015623.854543:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:0.0:1786015623.854562:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304491264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015623.854595:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304491264:12345-0@lo:400:kworker.0 Request processed in 34us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015623.854602:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:0.0:1786015623.854614:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:0.0:1786015623.854619:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304491648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015623.854644:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304491648:12345-0@lo:400:kworker.0 Request processed in 25us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015623.854649:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:0.0:1786015623.854692:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304491136:0@lo:400:kworker.0 00000100:00100000:0.0:1786015623.854707:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738374ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304491648:0@lo:400:kworker.0 00000100:00100000:0.0:1786015623.854718:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304491264:0@lo:400:kworker.0 00000100:00080000:1.0:1786015623.854991:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015623.855074:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304491392:0@lo:400:kworker.0 00000100:00100000:2.0:1786015623.855116:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015623.855149:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786015623.855155:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304491520:0@lo:400:kworker.0 00000100:00100000:2.0:1786015623.855177:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015623.855218:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304491776 00000100:00100000:2.0:1786015623.855223:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304491776 00000100:00100000:2.0:1786015623.855273:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304491520 00000100:00100000:2.0:1786015623.855275:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304491520 00000100:00100000:2.0:1786015623.855295:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:2.0:1786015623.855302:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304491776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015623.855340:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304491776:12345-0@lo:400:kworker.0 Request processed in 38us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015623.855350:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:2.0:1786015623.855362:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:2.0:1786015623.855368:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304491520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015623.855399:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304491520:12345-0@lo:400:kworker.0 Request processed in 31us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015623.855405:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00080000:2.0:1786015623.855423:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015623.855446:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304491520:0@lo:400:kworker.0 00000100:00100000:2.0:1786015623.855473:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304491776:0@lo:400:kworker.0 00000100:00100000:0.0:1786015623.855671:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304491392 00000100:00100000:0.0:1786015623.855677:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304491392 00000100:00100000:0.0:1786015623.855725:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:0.0:1786015623.855732:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304491392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015623.855803:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304491392:12345-0@lo:400:kworker.0 Request processed in 71us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015623.855810:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00080000:2.0:1786015623.856134:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015623.856161:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304491392:0@lo:400:kworker.0 00010000:00010000:3.0:1786015624.044113:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015624.364592:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786015624.364624:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304491904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015624.364726:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015624.365138:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304491904 00000100:00100000:3.0:1786015624.365150:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304491904 00000100:00100000:3.0:1786015624.365267:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1786015624.365279:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304491904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015624.365327:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015624.365401:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304491904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015624.365410:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1786015624.365500:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304491904:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786015625.069705:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015625.427675:0:23729:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015625.427690:0:23729:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015625.429119:0:23729:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015625.429144:0:23729:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015626.093146:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015626.604405:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015626.604420:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015626.605105:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015626.605120:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015626.823155:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015626.823233:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015626.823265:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015626.823299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015626.823321:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015626.823339:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015626.823367:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015626.823404:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280743296 00000100:00100000:3.0:1786015626.823418:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280743296 00000100:00100000:3.0:1786015626.823494:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280743552 00000100:00100000:3.0:1786015626.823497:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280743552 00000100:00100000:3.0:1786015626.823515:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280743168 00000100:00100000:3.0:1786015626.823517:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280743168 00000100:00100000:3.0:1786015626.823531:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280743680 00000100:00100000:3.0:1786015626.823533:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280743680 00000100:00100000:3.0:1786015626.823551:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 633 00000100:00100000:3.0:1786015626.823562:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+18:2352:x1872772280743296:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015626.823672:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+18:2352:x1872772280743296:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 112us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015626.823681:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 633 00000100:00100000:3.0:1786015626.823700:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 634 00000100:00100000:3.0:1786015626.823707:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280743552:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015626.823731:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280743552:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015626.823736:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 634 00000100:00100000:3.0:1786015626.823747:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 635 00000100:00100000:3.0:1786015626.823752:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+17:2352:x1872772280743168:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015626.823819:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+17:2352:x1872772280743168:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 67us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015626.823825:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 635 00000100:00100000:3.0:1786015626.823835:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 636 00000100:00100000:3.0:1786015626.823841:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280743680:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015626.823860:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280743680:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015626.823865:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 636 00000100:00100000:3.0:1786015626.823884:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280742912 00000100:00100000:3.0:1786015626.823887:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280742912 00000100:00100000:3.0:1786015626.823913:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 664 00000100:00100000:3.0:1786015626.823918:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280742912:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015626.823955:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280742912:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 37us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015626.823962:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 664 00000100:00100000:3.0:1786015626.823997:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280743040 00000100:00100000:3.0:1786015626.824000:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280743040 00000100:00100000:3.0:1786015626.824032:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280743424 00000100:00100000:3.0:1786015626.824035:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280743424 00000100:00100000:3.0:1786015626.824057:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 614 00000100:00100000:3.0:1786015626.824063:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+108:2352:x1872772280743040:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015626.824090:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+108:2352:x1872772280743040:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015626.824096:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 614 00000100:00100000:3.0:1786015626.824106:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 615 00000100:00100000:3.0:1786015626.824112:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2352:x1872772280743424:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015626.824132:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2352:x1872772280743424:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015626.824141:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 615 00000100:00080000:2.0:1786015626.825041:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786015626.825052:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015626.825056:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786015627.115907:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015627.441868:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015627.441901:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c11aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304492032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015627.441999:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015627.442092:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304492032 00000100:00100000:1.0:1786015627.442102:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304492032 00000100:00100000:1.0:1786015627.442176:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1786015627.442187:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304492032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015627.442245:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015627.442297:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304492032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015627.442320:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:1.0:1786015627.442347:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015627.442520:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c11aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304492032:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1786015627.559665:0:23780:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015627.559675:0:23780:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015627.561857:0:23780:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015627.561879:0:23780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786015628.140068:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015628.973264:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304492288:0@lo:400:kworker.0 00000100:00100000:0.0:1786015628.973367:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015628.973431:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304492800:0@lo:400:kworker.0 00000100:00100000:0.0:1786015628.973463:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015628.973496:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1786015628.973502:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304492160:0@lo:400:kworker.0 00000100:00100000:0.0:1786015628.973539:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015628.973563:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304492672:0@lo:400:kworker.0 00000100:00100000:0.0:1786015628.973588:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015628.973618:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738374ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304492544:0@lo:400:kworker.0 00000100:00100000:0.0:1786015628.973647:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015628.973669:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786015628.973675:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304492416:0@lo:400:kworker.0 00000100:00100000:0.0:1786015628.973700:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015628.973732:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304492800 00000100:00100000:0.0:1786015628.973742:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304492800 00000100:00100000:0.0:1786015628.973850:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304492544 00000100:00100000:0.0:1786015628.973853:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304492544 00000100:00100000:0.0:1786015628.973881:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:0.0:1786015628.973892:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304492800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015628.974040:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304492800:12345-0@lo:400:kworker.0 Request processed in 149us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015628.974050:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:0.0:1786015628.974071:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:0.0:1786015628.974078:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304492544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015628.974113:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304492544:12345-0@lo:400:kworker.0 Request processed in 36us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015628.974119:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:0.0:1786015628.974140:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304492288 00000100:00100000:0.0:1786015628.974144:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304492288 00000100:00100000:0.0:1786015628.974171:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304492672 00000100:00100000:0.0:1786015628.974174:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304492672 00000100:00100000:0.0:1786015628.974195:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304492416 00000100:00100000:0.0:1786015628.974197:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304492416 00000100:00100000:0.0:1786015628.974228:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:0.0:1786015628.974234:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304492288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015628.974266:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304492288:12345-0@lo:400:kworker.0 Request processed in 32us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015628.974273:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:0.0:1786015628.974285:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:0.0:1786015628.974291:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304492672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015628.974317:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304492672:12345-0@lo:400:kworker.0 Request processed in 27us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015628.974322:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:0.0:1786015628.974332:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1786015628.974337:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304492416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015628.974361:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304492416:12345-0@lo:400:kworker.0 Request processed in 24us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015628.974367:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1786015628.974429:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304492416:0@lo:400:kworker.0 00000100:00100000:0.0:1786015628.974442:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738374ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304492544:0@lo:400:kworker.0 00000100:00100000:0.0:1786015628.974479:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304492672:0@lo:400:kworker.0 00000100:00100000:0.0:1786015628.974490:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304492288:0@lo:400:kworker.0 00000100:00100000:0.0:1786015628.974503:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304492800:0@lo:400:kworker.0 00000100:00100000:1.0:1786015628.974645:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304492160 00000100:00100000:1.0:1786015628.974650:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304492160 00000100:00100000:1.0:1786015628.974685:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:1.0:1786015628.974692:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304492160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015628.974743:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304492160:12345-0@lo:400:kworker.0 Request processed in 52us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015628.974750:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00080000:1.0:1786015628.974799:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015628.974805:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015628.974822:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304492160:0@lo:400:kworker.0 00010000:00010000:0.0:1786015629.169071:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015629.484109:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786015629.484141:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304492928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015629.484248:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015629.490044:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304492928 00000100:00100000:3.0:1786015629.490061:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304492928 00000100:00100000:3.0:1786015629.490220:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1786015629.490231:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304492928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015629.490286:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015629.490379:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304492928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (6137us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015629.490387:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1786015629.498025:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304492928:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1786015629.981251:0:23832:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015629.981265:0:23832:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015629.983644:0:23832:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015629.983668:0:23832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015630.194428:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015631.215148:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015631.937800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015631.937851:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015631.937872:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015631.937898:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015631.937916:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015631.938207:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015631.938614:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015631.940101:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280743936 00000100:00100000:3.0:1786015631.940122:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280743936 00000100:00100000:3.0:1786015631.940218:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280744320 00000100:00100000:3.0:1786015631.940222:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280744320 00000100:00100000:3.0:1786015631.940256:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 619 00000100:00100000:3.0:1786015631.940267:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+108:2351:x1872772280743936:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015631.940378:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+108:2351:x1872772280743936:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 112us (2594us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015631.940385:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 619 00000100:00100000:3.0:1786015631.940404:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 620 00000100:00100000:3.0:1786015631.940410:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2351:x1872772280744320:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015631.940437:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2351:x1872772280744320:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015631.940443:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 620 00000100:00100000:2.0:1786015631.940673:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280744192 00000100:00100000:2.0:1786015631.940679:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280744192 00000100:00100000:2.0:1786015631.940710:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280744448 00000100:00100000:2.0:1786015631.940713:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280744448 00000100:00100000:2.0:1786015631.940820:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280744064 00000100:00100000:2.0:1786015631.940825:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280744064 00000100:00100000:2.0:1786015631.940847:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280744576 00000100:00100000:2.0:1786015631.940850:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280744576 00000100:00100000:2.0:1786015631.940867:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 639 00000100:00100000:2.0:1786015631.940875:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+18:2351:x1872772280744192:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015631.940909:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+18:2351:x1872772280744192:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 36us (3058us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015631.940916:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 639 00000100:00100000:2.0:1786015631.940930:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 640 00000100:00100000:2.0:1786015631.941234:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280744448:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015631.941271:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280744448:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 41us (3397us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015631.941277:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 640 00000100:00100000:2.0:1786015631.941292:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 641 00000100:00100000:2.0:1786015631.941298:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280744064:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015631.941324:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280744064:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (3407us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015631.941335:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 641 00000100:00100000:2.0:1786015631.941347:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 642 00000100:00100000:2.0:1786015631.941353:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280744576:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015631.941374:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280744576:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (2762us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015631.941381:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 642 00000100:00100000:2.0:1786015631.941411:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280743808 00000100:00100000:2.0:1786015631.941416:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280743808 00000100:00100000:2.0:1786015631.941450:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 666 00000100:00100000:2.0:1786015631.941457:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280743808:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015631.941483:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280743808:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (3584us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015631.941490:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 666 00000100:00080000:0.0:1786015631.941537:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015631.941542:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015631.941545:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1786015631.960544:0:23883:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015631.960563:0:23883:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015631.961743:0:23883:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015631.961808:0:23883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015632.242289:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015632.556232:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304493056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015632.556335:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015632.556825:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304493056 00000100:00100000:2.0:1786015632.556837:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304493056 00000100:00100000:2.0:1786015632.556974:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1786015632.556986:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304493056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015632.557036:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015632.557305:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304493056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 320us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015632.557315:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1786015632.557743:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304493056:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786015632.557886:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786015633.260430:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015634.102008:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304493184:0@lo:400:kworker.0 00000100:00100000:1.0:1786015634.102113:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015634.102188:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304493696:0@lo:400:kworker.0 00000100:00100000:1.0:1786015634.102226:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015634.102260:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786015634.102266:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304493312:0@lo:400:kworker.0 00000100:00100000:1.0:1786015634.102290:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015634.102310:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304493824:0@lo:400:kworker.0 00000100:00100000:1.0:1786015634.102339:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015634.102372:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304493440:0@lo:400:kworker.0 00000100:00100000:1.0:1786015634.102399:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015634.102420:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015634.102426:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304493568:0@lo:400:kworker.0 00000100:00100000:1.0:1786015634.102449:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015634.102484:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304493184 00000100:00100000:1.0:1786015634.102493:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304493184 00000100:00100000:1.0:1786015634.102548:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:1.0:1786015634.102558:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304493184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015634.102617:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304493184:12345-0@lo:400:kworker.0 Request processed in 60us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015634.102626:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:2.0:1786015634.102801:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304493824 00000100:00100000:2.0:1786015634.102808:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304493824 00000100:00100000:2.0:1786015634.102857:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304493568 00000100:00100000:2.0:1786015634.102861:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304493568 00000100:00100000:2.0:1786015634.102887:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:2.0:1786015634.102894:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304493824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015634.102937:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304493824:12345-0@lo:400:kworker.0 Request processed in 44us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015634.102943:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:2.0:1786015634.102956:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:2.0:1786015634.102961:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304493568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015634.102993:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304493568:12345-0@lo:400:kworker.0 Request processed in 31us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015634.102999:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:0.0:1786015634.104039:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304493696 00000100:00100000:0.0:1786015634.104053:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304493696 00000100:00100000:0.0:1786015634.104111:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304493312 00000100:00100000:0.0:1786015634.104115:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304493312 00000100:00100000:0.0:1786015634.104134:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304493440 00000100:00100000:0.0:1786015634.104137:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304493440 00000100:00100000:0.0:1786015634.104170:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:0.0:1786015634.104180:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304493696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015634.104262:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304493696:12345-0@lo:400:kworker.0 Request processed in 83us (2034us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015634.104269:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:0.0:1786015634.104286:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:0.0:1786015634.104292:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304493312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015634.104325:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304493312:12345-0@lo:400:kworker.0 Request processed in 34us (2034us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015634.104332:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:0.0:1786015634.104343:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:0.0:1786015634.104350:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304493440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015634.104379:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304493440:12345-0@lo:400:kworker.0 Request processed in 30us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015634.104384:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:1.0:1786015634.106896:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304493312:0@lo:400:kworker.0 00000100:00100000:1.0:1786015634.106922:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304493824:0@lo:400:kworker.0 00000100:00100000:1.0:1786015634.106934:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304493184:0@lo:400:kworker.0 00000100:00100000:1.0:1786015634.106946:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304493696:0@lo:400:kworker.0 00000100:00080000:1.0:1786015634.106994:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015634.107002:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015634.107007:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015634.107034:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304493568:0@lo:400:kworker.0 00000100:00100000:1.0:1786015634.107048:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304493440:0@lo:400:kworker.0 00010000:00010000:0.0:1786015634.287893:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015634.364603:0:23934:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015634.364616:0:23934:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015634.365197:0:23934:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015634.365209:0:23934:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015634.603960:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786015634.603993:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304493952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015634.604461:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015634.604610:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304493952 00000100:00100000:2.0:1786015634.604621:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304493952 00000100:00100000:2.0:1786015634.604695:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1786015634.604707:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304493952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015634.604755:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015634.604837:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304493952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015634.604845:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1786015634.605436:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304493952:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786015635.310313:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015636.337882:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015636.383008:0:23985:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015636.383022:0:23985:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015636.383987:0:23985:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015636.384005:0:23985:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1786015636.844169:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015636.844179:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015636.846510:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015636.846535:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015637.066061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015637.066119:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015637.066202:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015637.066230:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015637.066252:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015637.066270:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015637.066348:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015637.066379:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280745088 00000100:00100000:3.0:1786015637.066389:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280745088 00000100:00100000:3.0:1786015637.066466:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280745344 00000100:00100000:3.0:1786015637.066470:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280745344 00000100:00100000:3.0:1786015637.066487:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280744960 00000100:00100000:3.0:1786015637.066490:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280744960 00000100:00100000:3.0:1786015637.066501:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280745472 00000100:00100000:3.0:1786015637.066504:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280745472 00000100:00100000:3.0:1786015637.066520:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 645 00000100:00100000:3.0:1786015637.066529:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2352:x1872772280745088:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015637.066820:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280744704 00000100:00100000:2.0:1786015637.066835:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280744704 00000100:00100000:2.0:1786015637.066915:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 668 00000100:00100000:2.0:1786015637.066927:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280744704:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015637.067414:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280744704:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 485us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015637.067426:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 668 00000100:00100000:2.0:1786015637.067485:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 646 00000100:00100000:2.0:1786015637.067506:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280745344:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015637.067537:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280745344:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 46us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015637.067544:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 646 00000100:00100000:2.0:1786015637.067559:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 647 00000100:00100000:2.0:1786015637.067565:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280744960:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015637.067584:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280744960:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015637.067590:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 647 00000100:00100000:2.0:1786015637.067599:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 648 00000100:00100000:2.0:1786015637.067606:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280745472:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015637.067627:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280745472:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015637.067632:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 648 00000100:00080000:1.0:1786015637.067883:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015637.067892:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015637.067935:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280744832 00000100:00100000:1.0:1786015637.067944:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280744832 00000100:00100000:1.0:1786015637.068006:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280745216 00000100:00100000:1.0:1786015637.068011:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280745216 00000100:00100000:1.0:1786015637.068052:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 624 00000100:00100000:1.0:1786015637.068062:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+108:2352:x1872772280744832:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015637.068090:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 625 00000100:00100000:2.0:1786015637.068104:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2351:x1872772280745216:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015637.068187:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+108:2352:x1872772280744832:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 124us (2135us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015637.068197:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 624 00000100:00100000:2.0:1786015637.068364:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2351:x1872772280745216:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 262us (2090us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015637.068378:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 625 00000100:00080000:0.0:1786015637.068471:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015637.069167:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2352:x1872772280745088:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 2633us (3041us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015637.069180:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 645 00010000:00010000:2.0:1786015637.356083:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015637.677816:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304494080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015637.677904:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015637.677977:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304494080 00000100:00100000:1.0:1786015637.677985:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304494080 00000100:00100000:1.0:1786015637.678042:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1786015637.678051:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304494080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015637.678087:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015637.678147:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304494080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015637.678155:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1786015637.678202:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304494080:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786015637.678237:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786015638.385809:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015638.484083:0:24037:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015638.484096:0:24037:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015638.488493:0:24037:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015638.488515:0:24037:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015639.216949:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304494592:0@lo:400:kworker.0 00000100:00100000:1.0:1786015639.217045:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015639.217130:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786015639.217137:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304494464:0@lo:400:kworker.0 00000100:00100000:1.0:1786015639.217167:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015639.217211:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304494464 00000100:00100000:1.0:1786015639.217219:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304494464 00000100:00100000:1.0:1786015639.217281:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:3.0:1786015639.217467:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304494336:0@lo:400:kworker.0 00000100:00100000:3.0:1786015639.217501:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015639.217531:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304494848:0@lo:400:kworker.0 00000100:00100000:3.0:1786015639.217555:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015639.217590:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786015639.217596:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304494208:0@lo:400:kworker.0 00000100:00100000:3.0:1786015639.217627:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015639.217651:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c103f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304494720:0@lo:400:kworker.0 00000100:00100000:3.0:1786015639.217673:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786015639.217713:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015639.217732:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304494336 00000100:00100000:3.0:1786015639.217736:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304494336 00000100:00100000:2.0:1786015639.217818:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304494592 00000100:00100000:2.0:1786015639.217823:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304494592 00000100:00100000:2.0:1786015639.217862:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304494848 00000100:00100000:2.0:1786015639.217866:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304494848 00000100:00100000:2.0:1786015639.217889:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1786015639.217898:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304494592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015639.217950:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304494592:12345-0@lo:400:kworker.0 Request processed in 54us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015639.217956:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1786015639.217972:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1786015639.217978:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304494848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015639.218010:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304494848:12345-0@lo:400:kworker.0 Request processed in 31us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015639.218016:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1786015639.218037:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304494208 00000100:00100000:2.0:1786015639.218040:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304494208 00000100:00100000:2.0:1786015639.218061:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:1.0:1786015639.218065:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304494464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015639.218066:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304494208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015639.218095:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304494208:12345-0@lo:400:kworker.0 Request processed in 29us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015639.218096:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304494464:12345-0@lo:400:kworker.0 Request processed in 36us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015639.218112:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00080000:2.0:1786015639.218152:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015639.218156:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015639.218172:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304494720 00000100:00100000:0.0:1786015639.218176:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304494720 00000100:00100000:2.0:1786015639.218187:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304494464:0@lo:400:kworker.0 00000100:00100000:2.0:1786015639.218202:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304494592:0@lo:400:kworker.0 00000100:00100000:2.0:1786015639.218234:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304494208:0@lo:400:kworker.0 00000100:00100000:2.0:1786015639.218243:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304494848:0@lo:400:kworker.0 00000100:00080000:2.0:1786015639.218277:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015639.222199:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:3.0:1786015639.222223:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304494336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015639.222495:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304494336:12345-0@lo:400:kworker.0 Request processed in 284us (4992us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015639.222505:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:3.0:1786015639.224099:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304494336:0@lo:400:kworker.0 00000100:00100000:1.0:1786015639.225133:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:0.0:1786015639.226147:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:0.0:1786015639.226170:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304494720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015639.226303:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304494720:12345-0@lo:400:kworker.0 Request processed in 146us (8628us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015639.226311:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:3.0:1786015639.227123:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c103f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304494720:0@lo:400:kworker.0 00010000:00010000:1.0:1786015639.404033:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015639.724046:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786015639.724070:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304494976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015639.724166:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015639.724256:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304494976 00000100:00100000:2.0:1786015639.724266:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304494976 00000100:00100000:2.0:1786015639.724337:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1786015639.724347:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304494976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015639.724387:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015639.724437:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304494976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015639.724445:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1786015639.724499:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304494976:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786015640.430682:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015640.456908:0:24088:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015640.456920:0:24088:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015640.460241:0:24088:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015640.460263:0:24088:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786015641.455006:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015642.175666:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015642.175724:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015642.175800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015642.175820:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280745856 00000100:00100000:2.0:1786015642.175823:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015642.175833:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280745856 00000100:00100000:2.0:1786015642.175840:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015642.175869:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015642.175890:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280746368 00000100:00100000:3.0:1786015642.175893:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280746368 00000100:00100000:2.0:1786015642.175893:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015642.175911:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280745984 00000100:00100000:2.0:1786015642.175911:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280746112 00000100:00100000:3.0:1786015642.175913:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280745984 00000100:00100000:2.0:1786015642.175914:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280746112 00000100:00100000:3.0:1786015642.175924:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280746240 00000100:00100000:3.0:1786015642.175926:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280746240 00000100:00100000:2.0:1786015642.175941:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280745728 00000100:00100000:3.0:1786015642.175942:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 651 00000100:00100000:2.0:1786015642.175943:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280745728 00000100:00100000:3.0:1786015642.175951:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280745856:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015642.175963:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 629 00000100:00100000:2.0:1786015642.175968:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2354:x1872772280746112:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015642.176040:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280745600 00000100:00100000:1.0:1786015642.176045:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280745600 00000100:00100000:1.0:1786015642.176093:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 670 00000100:00100000:1.0:1786015642.176101:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280745600:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015642.176178:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2354:x1872772280746112:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 208us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015642.176186:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 629 00000100:00100000:2.0:1786015642.176203:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 630 00000100:00100000:2.0:1786015642.176209:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+108:2354:x1872772280745728:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015642.178852:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280745856:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 2888us (3113us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015642.178867:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 651 00000100:00100000:3.0:1786015642.178902:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 652 00000100:00100000:3.0:1786015642.178913:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280746368:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015642.178973:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280746368:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 63us (3149us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015642.178979:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 652 00000100:00100000:3.0:1786015642.178992:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 653 00000100:00100000:3.0:1786015642.178998:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280745984:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015642.179024:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280745984:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (3155us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015642.179029:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 653 00000100:00100000:3.0:1786015642.179041:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 654 00000100:00100000:3.0:1786015642.179048:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280746240:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015642.179091:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280746240:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 43us (3197us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015642.179098:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 654 00000100:00100000:1.0:1786015642.181488:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280745600:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 5374us (5823us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015642.181507:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 670 00000100:00080000:0.0:1786015642.183867:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015642.183876:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015642.183879:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015642.186990:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+108:2354:x1872772280745728:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 10768us (11135us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015642.187006:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 630 00010000:00010000:3.0:1786015642.481857:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015642.484051:0:24139:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015642.484062:0:24139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015642.485386:0:24139:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015642.485405:0:24139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015642.796782:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304495104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015642.796867:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015642.797076:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304495104 00000100:00100000:2.0:1786015642.797087:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304495104 00000100:00100000:2.0:1786015642.797182:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1786015642.797193:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304495104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015642.797237:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015642.797429:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304495104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 238us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015642.797438:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:0.0:1786015642.797514:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015642.797553:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304495104:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786015643.500103:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015644.335694:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304495360:0@lo:400:kworker.0 00000100:00100000:3.0:1786015644.335815:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015644.335878:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304495872:0@lo:400:kworker.0 00000100:00100000:3.0:1786015644.335907:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015644.335937:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786015644.335943:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304495232:0@lo:400:kworker.0 00000100:00100000:3.0:1786015644.335983:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015644.336007:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304495744:0@lo:400:kworker.0 00000100:00100000:3.0:1786015644.336031:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015644.336073:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304495616:0@lo:400:kworker.0 00000100:00100000:3.0:1786015644.336099:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015644.336121:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786015644.336126:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304495488:0@lo:400:kworker.0 00000100:00100000:3.0:1786015644.336149:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015644.336181:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304495872 00000100:00100000:3.0:1786015644.336189:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304495872 00000100:00100000:3.0:1786015644.336259:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304495616 00000100:00100000:3.0:1786015644.336262:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304495616 00000100:00100000:3.0:1786015644.336307:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:3.0:1786015644.336317:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304495872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015644.336379:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304495872:12345-0@lo:400:kworker.0 Request processed in 64us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015644.336387:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:3.0:1786015644.336411:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:3.0:1786015644.336418:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304495616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015644.336455:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304495616:12345-0@lo:400:kworker.0 Request processed in 37us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015644.336461:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:3.0:1786015644.336481:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304495360 00000100:00100000:3.0:1786015644.336485:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304495360 00000100:00100000:3.0:1786015644.336510:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304495744 00000100:00100000:3.0:1786015644.336513:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304495744 00000100:00100000:3.0:1786015644.336531:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304495488 00000100:00100000:3.0:1786015644.336533:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304495488 00000100:00100000:3.0:1786015644.336549:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1786015644.336555:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304495360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015644.336587:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304495360:12345-0@lo:400:kworker.0 Request processed in 32us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015644.336594:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1786015644.336606:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:3.0:1786015644.336612:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304495744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015644.336641:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304495744:12345-0@lo:400:kworker.0 Request processed in 29us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015644.336646:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:3.0:1786015644.336657:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:3.0:1786015644.336662:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304495488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015644.336691:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304495488:12345-0@lo:400:kworker.0 Request processed in 28us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015644.336696:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00080000:3.0:1786015644.336718:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015644.336724:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786015644.336726:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015644.336791:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304495488:0@lo:400:kworker.0 00000100:00100000:3.0:1786015644.336805:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304495616:0@lo:400:kworker.0 00000100:00100000:3.0:1786015644.336844:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304495744:0@lo:400:kworker.0 00000100:00100000:3.0:1786015644.336853:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304495360:0@lo:400:kworker.0 00000100:00100000:3.0:1786015644.336861:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304495872:0@lo:400:kworker.0 00000100:00100000:2.0:1786015644.337421:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304495232 00000100:00100000:2.0:1786015644.337429:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304495232 00000100:00100000:2.0:1786015644.337472:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:2.0:1786015644.337480:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304495232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015644.337545:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304495232:12345-0@lo:400:kworker.0 Request processed in 65us (1560us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015644.337563:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:2.0:1786015644.337620:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304495232:0@lo:400:kworker.0 00000040:00080000:1.0:1786015644.468233:0:24191:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015644.468247:0:24191:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015644.468793:0:24191:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015644.468804:0:24191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015644.526842:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015644.844522:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304496000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015644.844616:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015644.844848:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304496000 00000100:00100000:2.0:1786015644.844856:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304496000 00000100:00100000:2.0:1786015644.844912:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1786015644.844921:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304496000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015644.844961:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015644.845016:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304496000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015644.845023:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1786015644.845142:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304496000:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786015645.548029:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015646.060131:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015646.060143:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015646.060680:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015646.060690:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1786015646.372974:0:24242:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015646.372985:0:24242:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015646.373593:0:24242:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015646.373604:0:24242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786015646.571944:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015647.299169:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015647.299225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015647.299265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015647.299294:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015647.299316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015647.299331:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015647.299370:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015647.299397:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280746752 00000100:00100000:0.0:1786015647.299406:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280746752 00000100:00100000:0.0:1786015647.299456:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280747264 00000100:00100000:0.0:1786015647.299459:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280747264 00000100:00100000:0.0:1786015647.299477:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280746880 00000100:00100000:0.0:1786015647.299479:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280746880 00000100:00100000:0.0:1786015647.299491:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280747136 00000100:00100000:0.0:1786015647.299493:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280747136 00000100:00100000:0.0:1786015647.299510:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 657 00000100:00100000:0.0:1786015647.299518:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2352:x1872772280746752:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015647.299582:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2352:x1872772280746752:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 65us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015647.299589:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 657 00000100:00100000:0.0:1786015647.299604:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 658 00000100:00100000:0.0:1786015647.299610:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280747264:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015647.299633:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280747264:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015647.299638:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 658 00000100:00100000:0.0:1786015647.299648:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 659 00000100:00100000:0.0:1786015647.299653:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2352:x1872772280746880:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015647.299674:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2352:x1872772280746880:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015647.299680:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 659 00000100:00100000:0.0:1786015647.299692:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 660 00000100:00100000:0.0:1786015647.299697:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280747136:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015647.299719:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280747136:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015647.299725:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 660 00000100:00100000:3.0:1786015647.299827:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280747008 00000100:00100000:3.0:1786015647.299832:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280747008 00000100:00100000:3.0:1786015647.299870:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280746624 00000100:00100000:3.0:1786015647.299873:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280746624 00000100:00100000:3.0:1786015647.299893:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 634 00000100:00100000:3.0:1786015647.299900:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2352:x1872772280747008:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015647.299931:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2352:x1872772280747008:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015647.299950:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 634 00000100:00080000:1.0:1786015647.299961:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015647.299962:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 635 00000100:00080000:1.0:1786015647.299966:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015647.299967:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+108:2352:x1872772280746624:12345-192.168.202.56@tcp:400:kworker.0 00000100:00080000:1.0:1786015647.299968:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015647.299990:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+108:2352:x1872772280746624:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015647.299996:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 635 00000100:00100000:2.0:1786015647.300099:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280746496 00000100:00100000:2.0:1786015647.300104:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280746496 00000100:00100000:2.0:1786015647.300150:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 672 00000100:00100000:2.0:1786015647.300157:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280746496:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015647.300183:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280746496:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015647.300189:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 672 00010000:00010000:1.0:1786015647.596063:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015647.916559:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786015647.916591:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304496128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015647.916682:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015647.916755:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304496128 00000100:00100000:2.0:1786015647.916781:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304496128 00000100:00100000:2.0:1786015647.916845:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1786015647.918387:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304496128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015647.918443:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015647.918537:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304496128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (1855us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015647.920077:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304496128:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786015647.921190:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015647.923699:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000040:00080000:2.0:1786015648.553812:0:24293:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015648.553826:0:24293:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015648.556524:0:24293:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015648.556780:0:24293:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015648.632900:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015649.452718:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304496384:0@lo:400:kworker.0 00000100:00100000:3.0:1786015649.452847:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015649.452931:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304496896:0@lo:400:kworker.0 00000100:00100000:3.0:1786015649.452960:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015649.452995:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786015649.453001:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304496256:0@lo:400:kworker.0 00000100:00100000:3.0:1786015649.453053:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015649.453081:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304496768:0@lo:400:kworker.0 00000100:00100000:1.0:1786015649.453604:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304496640:0@lo:400:kworker.0 00000100:00100000:1.0:1786015649.453650:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015649.453683:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786015649.453689:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304496512:0@lo:400:kworker.0 00000100:00100000:1.0:1786015649.453715:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015649.453757:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304496896 00000100:00100000:1.0:1786015649.453788:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304496896 00000100:00100000:1.0:1786015649.453853:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304496640 00000100:00100000:1.0:1786015649.453856:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304496640 00000100:00100000:1.0:1786015649.453881:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1786015649.453893:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304496896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015649.453962:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304496896:12345-0@lo:400:kworker.0 Request processed in 71us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015649.453970:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1786015649.453989:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1786015649.453995:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304496640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015649.454047:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304496640:12345-0@lo:400:kworker.0 Request processed in 52us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015649.454068:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00080000:1.0:1786015649.454087:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015649.454224:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304496384 00000100:00100000:2.0:1786015649.454230:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304496384 00000100:00100000:2.0:1786015649.454265:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304496512 00000100:00100000:2.0:1786015649.454268:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304496512 00000100:00100000:2.0:1786015649.454303:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:2.0:1786015649.454311:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304496384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015649.454353:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304496384:12345-0@lo:400:kworker.0 Request processed in 44us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015649.454360:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:2.0:1786015649.454373:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:2.0:1786015649.454379:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304496512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015649.454409:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304496512:12345-0@lo:400:kworker.0 Request processed in 30us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015649.454415:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:2.0:1786015649.454466:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304496256 00000100:00100000:2.0:1786015649.454471:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304496256 00000100:00100000:2.0:1786015649.454501:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:2.0:1786015649.454507:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304496256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015649.454543:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304496256:12345-0@lo:400:kworker.0 Request processed in 36us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015649.454549:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1786015649.454794:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015649.454850:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304496384:0@lo:400:kworker.0 00000100:00100000:3.0:1786015649.454864:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304496896:0@lo:400:kworker.0 00000100:00100000:3.0:1786015649.454890:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304496256:0@lo:400:kworker.0 00000100:00100000:3.0:1786015649.454926:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304496512:0@lo:400:kworker.0 00000100:00100000:3.0:1786015649.454939:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304496640:0@lo:400:kworker.0 00000100:00100000:0.0:1786015649.455131:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304496768 00000100:00100000:0.0:1786015649.455137:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304496768 00000100:00100000:0.0:1786015649.455190:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:0.0:1786015649.455199:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304496768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015649.455253:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304496768:12345-0@lo:400:kworker.0 Request processed in 55us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015649.455260:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:3.0:1786015649.456435:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304496768:0@lo:400:kworker.0 00000100:00080000:1.0:1786015649.456524:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015649.456530:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1786015649.644304:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015649.973861:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304497024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015649.973981:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015649.974324:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304497024 00000100:00100000:2.0:1786015649.974336:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304497024 00000100:00100000:2.0:1786015649.974418:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1786015649.974431:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304497024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015649.974488:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015649.974554:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304497024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015649.974562:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1786015649.975535:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304497024:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786015650.670751:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015650.675461:0:24344:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015650.675476:0:24344:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015650.676623:0:24344:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015650.677735:0:24344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015651.693391:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015652.420167:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015652.420214:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015652.420247:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015652.420291:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015652.420315:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015652.420339:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015652.420652:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015652.420697:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280747648 00000100:00100000:3.0:1786015652.420710:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280747648 00000100:00100000:3.0:1786015652.420805:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280748160 00000100:00100000:3.0:1786015652.420809:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280748160 00000100:00100000:3.0:1786015652.420833:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280747776 00000100:00100000:3.0:1786015652.420836:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280747776 00000100:00100000:3.0:1786015652.420852:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280748032 00000100:00100000:3.0:1786015652.420855:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280748032 00000100:00100000:3.0:1786015652.420876:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 663 00000100:00100000:3.0:1786015652.420889:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280747648:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015652.421095:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280747392 00000100:00100000:0.0:1786015652.421101:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280747392 00000100:00100000:0.0:1786015652.421141:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 674 00000100:00100000:0.0:1786015652.421150:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280747392:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015652.423286:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280747648:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 2383us (3052us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015652.423306:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 663 00000100:00100000:3.0:1786015652.423364:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 664 00000100:00100000:3.0:1786015652.423378:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280748160:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015652.428605:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280747904 00000100:00100000:2.0:1786015652.428632:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280747904 00000100:00100000:2.0:1786015652.428732:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280747520 00000100:00100000:2.0:1786015652.428736:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280747520 00000100:00100000:2.0:1786015652.428826:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 639 00000100:00100000:2.0:1786015652.428839:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2351:x1872772280747904:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015652.429233:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280747392:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 8078us (9075us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015652.429246:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 674 00000100:00100000:1.0:1786015652.433212:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 665 00000100:00100000:1.0:1786015652.433276:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+18:2351:x1872772280747776:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015652.433601:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+18:2351:x1872772280747776:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 367us (13258us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015652.433612:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 665 00000100:00100000:1.0:1786015652.433647:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 666 00000100:00100000:1.0:1786015652.433657:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280748032:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015652.433692:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280748032:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 37us (13040us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015652.433699:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 666 00000100:00080000:1.0:1786015652.433730:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015652.433737:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015652.433740:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015652.433793:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 640 00000100:00100000:1.0:1786015652.433803:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+108:2351:x1872772280747520:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015652.433841:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+108:2351:x1872772280747520:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 40us (13525us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015652.433849:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 640 00000100:00100000:3.0:1786015652.442384:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280748160:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 18978us (22058us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015652.442411:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 664 00000100:00100000:2.0:1786015652.448514:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2351:x1872772280747904:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 19658us (28246us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015652.448536:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 639 00010000:00010000:0.0:1786015652.720186:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015653.048881:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304497152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015653.048992:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1786015653.049632:0:24396:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015653.049639:0:24396:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015653.050208:0:24396:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015653.050221:0:24396:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015653.053787:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304497152 00000100:00100000:1.0:1786015653.053811:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304497152 00000100:00100000:1.0:1786015653.053917:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1786015653.053930:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304497152:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786015653.055950:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1786015653.058342:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015653.058550:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304497152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4614us (9549us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015653.058566:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1786015653.058749:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304497152:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786015653.744301:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015654.572284:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786015654.572324:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304497280:0@lo:400:kworker.0 00000100:00100000:0.0:1786015654.572436:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015654.572552:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304497408:0@lo:400:kworker.0 00000100:00100000:0.0:1786015654.572594:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015654.572639:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304497408 00000100:00100000:0.0:1786015654.572650:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304497408 00000100:00100000:0.0:1786015654.572724:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:0.0:1786015654.572738:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304497408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015654.573044:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304497408:12345-0@lo:400:kworker.0 Request processed in 308us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015654.573053:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:0.0:1786015654.573107:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304497408:0@lo:400:kworker.0 00000100:00100000:0.0:1786015654.573158:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304497536:0@lo:400:kworker.0 00000100:00100000:0.0:1786015654.573187:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015654.573225:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304497536 00000100:00100000:0.0:1786015654.573229:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304497536 00000100:00100000:0.0:1786015654.573269:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:0.0:1786015654.573278:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304497536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015654.573320:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304497536:12345-0@lo:400:kworker.0 Request processed in 44us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015654.573327:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00080000:0.0:1786015654.573347:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015654.573375:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304497536:0@lo:400:kworker.0 00000100:00100000:0.0:1786015654.573414:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304497664:0@lo:400:kworker.0 00000100:00100000:0.0:1786015654.573450:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015654.573494:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304497664 00000100:00100000:0.0:1786015654.573498:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304497664 00000100:00100000:0.0:1786015654.573534:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1786015654.573543:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304497664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015654.573587:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304497664:12345-0@lo:400:kworker.0 Request processed in 46us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015654.573594:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1786015654.573624:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304497664:0@lo:400:kworker.0 00000100:00100000:0.0:1786015654.573658:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786015654.573666:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304497792:0@lo:400:kworker.0 00000100:00100000:0.0:1786015654.573692:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015654.573736:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304497920:0@lo:400:kworker.0 00000100:00100000:3.0:1786015654.573966:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304497280 00000100:00100000:3.0:1786015654.573972:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304497280 00000100:00100000:3.0:1786015654.574009:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:3.0:1786015654.574017:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304497280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015654.574075:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304497280:12345-0@lo:400:kworker.0 Request processed in 60us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015654.574083:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:2.0:1786015654.574217:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304497792 00000100:00100000:2.0:1786015654.574222:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304497792 00000100:00100000:2.0:1786015654.574281:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:2.0:1786015654.574289:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304497792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015654.574333:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304497792:12345-0@lo:400:kworker.0 Request processed in 46us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015654.574340:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00080000:3.0:1786015654.574398:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015654.574736:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015654.574822:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304497792:0@lo:400:kworker.0 00000100:00100000:0.0:1786015654.574837:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304497280:0@lo:400:kworker.0 00000100:00100000:2.0:1786015654.575186:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304497920 00000100:00100000:2.0:1786015654.575193:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304497920 00000100:00100000:2.0:1786015654.575250:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:2.0:1786015654.575259:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304497920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015654.575325:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304497920:12345-0@lo:400:kworker.0 Request processed in 67us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015654.575333:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:2.0:1786015654.575371:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304497920:0@lo:400:kworker.0 00000100:00080000:0.0:1786015654.575465:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1786015654.776182:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015655.095055:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786015655.095088:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304498048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015655.095297:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015655.103448:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304498048 00000100:00100000:1.0:1786015655.103469:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304498048 00000100:00100000:1.0:1786015655.107644:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1786015655.107677:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304498048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015655.107739:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015655.107892:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304498048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 231us (12594us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015655.107902:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1786015655.108063:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304498048:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1786015655.318367:0:24447:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015655.318383:0:24447:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015655.319265:0:24447:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015655.319285:0:24447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015655.796500:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015656.300700:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015656.300715:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015656.302143:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015656.302168:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015656.812491:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015657.452971:0:24498:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015657.452984:0:24498:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015657.454109:0:24498:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015657.454127:0:24498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015657.534476:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015657.534547:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015657.534643:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280748288 00000100:00100000:1.0:1786015657.534656:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280748288 00000100:00100000:1.0:1786015657.534738:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 676 00000100:00100000:1.0:1786015657.534751:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280748288:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015657.534888:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280748288:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 140us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015657.534898:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 676 00000100:00100000:0.0:1786015657.535129:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280748416 00000100:00100000:0.0:1786015657.535136:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280748416 00000100:00100000:0.0:1786015657.535201:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 644 00000100:00100000:0.0:1786015657.535211:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+108:2354:x1872772280748416:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015657.535253:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+108:2354:x1872772280748416:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 45us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015657.535275:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 644 00000100:00080000:1.0:1786015657.536040:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015657.536966:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015657.537011:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015657.537044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015657.537075:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015657.537100:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015657.537199:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280748672 00000100:00100000:3.0:1786015657.537217:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280748672 00000100:00100000:3.0:1786015657.537290:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280748928 00000100:00100000:3.0:1786015657.537293:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280748928 00000100:00100000:3.0:1786015657.537313:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280748544 00000100:00100000:3.0:1786015657.537316:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280748544 00000100:00100000:3.0:1786015657.537327:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280749056 00000100:00100000:3.0:1786015657.537330:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280749056 00000100:00100000:3.0:1786015657.537349:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 669 00000100:00100000:3.0:1786015657.537360:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280748672:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015657.537459:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 670 00000100:00100000:0.0:1786015657.537469:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280748928:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015657.537529:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 671 00000100:00100000:1.0:1786015657.537540:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280748544:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015657.541490:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280748672:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 4108us (4511us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015657.541514:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 669 00000100:00100000:3.0:1786015657.541567:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 672 00000100:00100000:3.0:1786015657.541585:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280749056:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015657.541656:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280749056:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 81us (4556us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015657.541663:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 672 00000100:00080000:3.0:1786015657.541703:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786015657.541709:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015657.546133:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280748928:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 8646us (9100us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015657.546154:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 670 00000100:00100000:0.0:1786015657.546229:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280748800 00000100:00100000:0.0:1786015657.546246:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280748800 00000100:00100000:0.0:1786015657.546331:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 645 00000100:00100000:0.0:1786015657.546342:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280748800:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015657.546420:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280748800:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 80us (9344us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015657.546426:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 645 00000100:00080000:0.0:1786015657.546549:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015657.552956:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280748544:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 15388us (15879us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015657.552980:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 671 00010000:00010000:2.0:1786015657.836275:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015658.157839:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015658.157871:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304498176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015658.157991:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015658.158989:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304498176 00000100:00100000:0.0:1786015658.159005:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304498176 00000100:00100000:0.0:1786015658.159111:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1786015658.159126:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b7e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304498176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015658.159181:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015658.159279:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b7e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304498176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015658.159289:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1786015658.159336:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304498176:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786015658.159848:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786015658.860499:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015659.680187:0:24550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015659.680199:0:24550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015659.680603:0:24550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015659.680611:0:24550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015659.692954:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304498560:0@lo:400:kworker.0 00000100:00100000:0.0:1786015659.692954:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304498432:0@lo:400:kworker.0 00000100:00100000:1.0:1786015659.693210:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304498304:0@lo:400:kworker.0 00000100:00100000:3.0:1786015659.695554:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304498688:0@lo:400:kworker.0 00000100:00100000:2.0:1786015659.695713:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015659.695848:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304498560 00000100:00100000:2.0:1786015659.695861:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304498560 00000100:00100000:2.0:1786015659.695962:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:2.0:1786015659.695976:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304498560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015659.696049:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304498560:12345-0@lo:400:kworker.0 Request processed in 77us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015659.696059:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:2.0:1786015659.696123:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304498560:0@lo:400:kworker.0 00000100:00080000:2.0:1786015659.698870:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015659.701311:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015659.701392:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304498944:0@lo:400:kworker.0 00000100:00100000:0.0:1786015659.701442:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015659.701469:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304498432 00000100:00100000:2.0:1786015659.701482:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304498432 00000100:00100000:2.0:1786015659.701547:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:2.0:1786015659.701556:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304498432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015659.701634:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304498432:12345-0@lo:400:kworker.0 Request processed in 78us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015659.701643:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:2.0:1786015659.701710:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304498432:0@lo:400:kworker.0 00000100:00100000:2.0:1786015659.701874:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304498944 00000100:00100000:2.0:1786015659.701879:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304498944 00000100:00100000:2.0:1786015659.701931:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:2.0:1786015659.701938:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304498944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015659.701976:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304498944:12345-0@lo:400:kworker.0 Request processed in 39us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015659.701982:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00080000:2.0:1786015659.702000:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015659.702019:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304498944:0@lo:400:kworker.0 00000100:00100000:1.0:1786015659.703000:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015659.703065:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304498816:0@lo:400:kworker.0 00000100:00100000:1.0:1786015659.703116:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015659.703997:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015659.704059:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304498688 00000100:00100000:3.0:1786015659.704069:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304498688 00000100:00100000:3.0:1786015659.704178:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:3.0:1786015659.704188:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304498688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015659.704246:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304498688:12345-0@lo:400:kworker.0 Request processed in 60us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015659.704253:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:3.0:1786015659.704296:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304498688:0@lo:400:kworker.0 00000100:00100000:1.0:1786015659.704579:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304498304 00000100:00100000:1.0:1786015659.704584:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304498304 00000100:00100000:1.0:1786015659.705197:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:1.0:1786015659.705209:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304498304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015659.705289:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304498304:12345-0@lo:400:kworker.0 Request processed in 84us (2527us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015659.705296:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1786015659.705378:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304498304:0@lo:400:kworker.0 00000100:00100000:1.0:1786015659.705574:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304498816 00000100:00100000:1.0:1786015659.705581:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304498816 00000100:00100000:1.0:1786015659.705679:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:1.0:1786015659.705687:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304498816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015659.705734:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304498816:12345-0@lo:400:kworker.0 Request processed in 48us (2617us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015659.705741:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:1.0:1786015659.705793:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304498816:0@lo:400:kworker.0 00000100:00080000:2.0:1786015659.706102:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786015659.884261:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015660.204571:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786015660.205266:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304499072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015660.205359:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015660.206348:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304499072 00000100:00100000:0.0:1786015660.206362:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304499072 00000100:00100000:0.0:1786015660.206436:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1786015660.206448:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304499072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015660.206506:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015660.206634:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304499072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 187us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015660.206643:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1786015660.211314:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304499072:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786015660.908119:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015661.680310:0:24601:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015661.680325:0:24601:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015661.685245:0:24601:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015661.685277:0:24601:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786015661.933293:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015662.656426:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015662.656495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015662.657048:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280749312 00000100:00100000:0.0:1786015662.657065:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280749312 00000100:00100000:0.0:1786015662.657291:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 649 00000100:00100000:0.0:1786015662.657308:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+108:2352:x1872772280749312:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015662.657422:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+108:2352:x1872772280749312:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 120us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015662.657430:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 649 00000100:00100000:2.0:1786015662.658425:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280749184 00000100:00100000:2.0:1786015662.658436:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280749184 00000100:00100000:2.0:1786015662.658494:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 678 00000100:00100000:2.0:1786015662.658504:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280749184:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015662.658574:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280749184:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 72us (2166us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015662.658582:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 678 00000100:00100000:0.0:1786015662.661632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015662.661837:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015662.661860:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015662.661899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015662.661922:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015662.662011:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280749568 00000100:00100000:0.0:1786015662.662023:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280749568 00000100:00100000:1.0:1786015662.662087:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280749824 00000100:00100000:1.0:1786015662.662092:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280749824 00000100:00100000:2.0:1786015662.662289:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280749440 00000100:00100000:2.0:1786015662.662295:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280749440 00000100:00080000:3.0:1786015662.663135:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786015662.663169:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015662.663173:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015662.663219:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280749696 00000100:00100000:3.0:1786015662.663227:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280749696 00000100:00100000:3.0:1786015662.663308:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 650 00000100:00100000:3.0:1786015662.663321:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2351:x1872772280749696:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015662.663438:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2351:x1872772280749696:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 118us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015662.663447:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 650 00000100:00080000:3.0:1786015662.663472:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015662.663500:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280749952 00000100:00100000:3.0:1786015662.663504:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280749952 00000100:00100000:3.0:1786015662.663537:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 675 00000100:00100000:3.0:1786015662.663544:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280749952:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015662.663573:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280749952:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015662.663579:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 675 00000100:00080000:3.0:1786015662.663597:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015662.669403:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 676 00000100:00100000:0.0:1786015662.669426:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+18:2351:x1872772280749568:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015662.669539:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+18:2351:x1872772280749568:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 121us (7918us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015662.669548:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 676 00000100:00100000:1.0:1786015662.670072:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 677 00000100:00100000:1.0:1786015662.670085:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280749824:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015662.670153:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280749824:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 71us (8315us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015662.670161:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 677 00000100:00100000:2.0:1786015662.673224:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 678 00000100:00100000:2.0:1786015662.673244:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280749440:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015662.673415:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280749440:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 175us (11552us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015662.673425:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 678 00010000:00010000:0.0:1786015662.962468:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015663.276469:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015663.276506:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304499200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015663.276613:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015663.276709:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304499200 00000100:00100000:3.0:1786015663.276720:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304499200 00000100:00100000:3.0:1786015663.276826:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1786015663.276837:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304499200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015663.276901:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015663.276954:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304499200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (341us total) trans 0 rc 0/0 00000100:00080000:2.0:1786015663.277349:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015663.280051:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1786015663.280159:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304499200:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1786015663.958672:0:24652:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015663.958688:0:24652:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015663.960304:0:24652:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015663.961067:0:24652:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015663.983976:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015664.812455:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304499456:0@lo:400:kworker.0 00000100:00100000:2.0:1786015664.812559:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015664.812644:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304499968:0@lo:400:kworker.0 00000100:00100000:2.0:1786015664.812676:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015664.812722:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1786015664.812729:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304499328:0@lo:400:kworker.0 00000100:00100000:2.0:1786015664.812798:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015664.812824:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304499840:0@lo:400:kworker.0 00000100:00100000:2.0:1786015664.812850:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015664.812895:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304499968 00000100:00100000:2.0:1786015664.812904:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304499968 00000100:00100000:2.0:1786015664.812973:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1786015664.812985:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304499968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015664.813046:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304499968:12345-0@lo:400:kworker.0 Request processed in 64us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015664.813054:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1786015664.813236:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304499328 00000100:00100000:2.0:1786015664.813241:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304499328 00000100:00100000:2.0:1786015664.813274:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1786015664.813281:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304499328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015664.813316:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304499328:12345-0@lo:400:kworker.0 Request processed in 36us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015664.813321:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1786015664.813352:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304499456 00000100:00100000:2.0:1786015664.813356:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304499456 00000100:00100000:2.0:1786015664.813384:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304499840 00000100:00100000:2.0:1786015664.813388:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304499840 00000100:00100000:2.0:1786015664.813412:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:2.0:1786015664.813418:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304499456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015664.813451:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304499456:12345-0@lo:400:kworker.0 Request processed in 32us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015664.813458:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:2.0:1786015664.813470:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:2.0:1786015664.813476:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304499840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015664.813504:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304499840:12345-0@lo:400:kworker.0 Request processed in 27us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015664.813510:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00080000:2.0:1786015664.813527:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786015664.813532:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015664.813574:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304499328:0@lo:400:kworker.0 00000100:00100000:2.0:1786015664.813590:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304499840:0@lo:400:kworker.0 00000100:00100000:2.0:1786015664.813599:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304499456:0@lo:400:kworker.0 00000100:00100000:2.0:1786015664.813608:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304499968:0@lo:400:kworker.0 00000100:00100000:3.0:1786015664.813964:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304499584:0@lo:400:kworker.0 00000100:00100000:3.0:1786015664.814008:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015664.814048:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015664.814055:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304499712:0@lo:400:kworker.0 00000100:00100000:3.0:1786015664.814089:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015664.814124:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304499712 00000100:00100000:3.0:1786015664.814129:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304499712 00000100:00100000:3.0:1786015664.814164:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1786015664.814172:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304499712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015664.814215:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304499712:12345-0@lo:400:kworker.0 Request processed in 44us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015664.814222:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1786015664.814243:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304499584 00000100:00100000:3.0:1786015664.814246:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304499584 00000100:00100000:3.0:1786015664.814272:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:3.0:1786015664.814277:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304499584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015664.814309:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304499584:12345-0@lo:400:kworker.0 Request processed in 31us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015664.814315:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:3.0:1786015664.814347:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304499712:0@lo:400:kworker.0 00000100:00100000:3.0:1786015664.814357:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304499584:0@lo:400:kworker.0 00000100:00080000:2.0:1786015664.814699:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786015665.004177:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015665.324295:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aeba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304500096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015665.324402:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015665.324551:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304500096 00000100:00100000:2.0:1786015665.324564:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304500096 00000100:00100000:2.0:1786015665.324636:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1786015665.324647:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304500096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015665.324697:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015665.324753:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304500096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015665.324782:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1786015665.324946:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aeba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304500096:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786015666.028118:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015666.092642:0:24706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015666.092657:0:24706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015666.094011:0:24706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015666.094103:0:24706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1786015666.540194:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015666.540210:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015666.541142:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015666.541158:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015667.053782:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015667.780280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015667.780317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015667.780338:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015667.780365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015667.780384:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015667.780403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015667.780445:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015667.780475:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280750208 00000100:00100000:2.0:1786015667.780486:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280750208 00000100:00100000:2.0:1786015667.780543:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280750592 00000100:00100000:2.0:1786015667.780558:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280750592 00000100:00100000:2.0:1786015667.780585:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 654 00000100:00100000:2.0:1786015667.780595:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280750208:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015667.780672:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280750208:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 78us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015667.780680:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 654 00000100:00100000:2.0:1786015667.780699:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 655 00000100:00100000:2.0:1786015667.780706:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280750592:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015667.780732:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280750592:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015667.780739:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 655 00000100:00100000:2.0:1786015667.780757:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280750464 00000100:00100000:2.0:1786015667.780780:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280750464 00000100:00100000:2.0:1786015667.780807:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280750720 00000100:00100000:2.0:1786015667.780810:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280750720 00000100:00100000:2.0:1786015667.780823:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280750336 00000100:00100000:2.0:1786015667.780825:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280750336 00000100:00100000:2.0:1786015667.780850:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280750848 00000100:00100000:2.0:1786015667.780853:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280750848 00000100:00100000:2.0:1786015667.780870:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 681 00000100:00100000:2.0:1786015667.780877:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280750464:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015667.780901:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280750464:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015667.780907:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 681 00000100:00100000:2.0:1786015667.780918:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 682 00000100:00100000:2.0:1786015667.780924:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280750720:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015667.780945:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280750720:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015667.780950:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 682 00000100:00100000:2.0:1786015667.780959:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 683 00000100:00100000:2.0:1786015667.780964:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aeba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280750336:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015667.780985:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aeba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280750336:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015667.780990:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 683 00000100:00100000:2.0:1786015667.780999:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 684 00000100:00100000:2.0:1786015667.781004:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280750848:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015667.781026:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280750848:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015667.781030:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 684 00000100:00080000:2.0:1786015667.781052:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015667.781056:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015667.781058:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015667.782618:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280750080 00000100:00100000:1.0:1786015667.782630:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280750080 00000100:00100000:1.0:1786015667.782671:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 680 00000100:00100000:1.0:1786015667.782679:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280750080:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015667.782733:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280750080:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 54us (2367us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015667.782740:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 680 00010000:00010000:0.0:1786015668.076045:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015668.389086:0:24757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015668.389099:0:24757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015668.389617:0:24757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015668.389628:0:24757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015668.409223:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304500224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015668.409594:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015668.409956:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304500224 00000100:00100000:3.0:1786015668.409965:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304500224 00000100:00100000:3.0:1786015668.410045:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1786015668.410056:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304500224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015668.410092:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015668.410162:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304500224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015668.410169:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1786015668.410216:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304500224:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786015668.410501:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786015669.100263:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015669.932468:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304500352:0@lo:400:kworker.0 00000100:00100000:3.0:1786015669.932620:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015669.932691:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304500864:0@lo:400:kworker.0 00000100:00100000:3.0:1786015669.932724:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015669.932754:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786015669.932782:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304500480:0@lo:400:kworker.0 00000100:00100000:3.0:1786015669.932818:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015669.932838:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304500992:0@lo:400:kworker.0 00000100:00100000:3.0:1786015669.932865:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015669.932893:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304500608:0@lo:400:kworker.0 00000100:00100000:3.0:1786015669.932916:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015669.932935:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015669.932941:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304500736:0@lo:400:kworker.0 00000100:00100000:3.0:1786015669.932966:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015669.932994:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304500864 00000100:00100000:0.0:1786015669.933002:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304500864 00000100:00100000:0.0:1786015669.933065:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304500480 00000100:00100000:0.0:1786015669.933070:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304500480 00000100:00100000:0.0:1786015669.933090:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304500608 00000100:00100000:0.0:1786015669.933092:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304500608 00000100:00100000:2.0:1786015669.933101:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304500352 00000100:00100000:2.0:1786015669.933105:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304500352 00000100:00100000:0.0:1786015669.933112:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1786015669.933121:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304500864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015669.933131:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:2.0:1786015669.933138:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304500352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015669.939289:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304500352:12345-0@lo:400:kworker.0 Request processed in 6139us (6658us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015669.939318:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:2.0:1786015669.939850:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:2.0:1786015669.939865:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304500480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015669.941688:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304500992 00000100:00100000:3.0:1786015669.941703:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304500992 00000100:00100000:3.0:1786015669.941787:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304500736 00000100:00100000:3.0:1786015669.941791:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304500736 00000100:00100000:3.0:1786015669.941829:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1786015669.941839:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304500992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015669.951412:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:1.0:1786015669.951439:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304500608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015669.951556:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304500608:12345-0@lo:400:kworker.0 Request processed in 130us (18638us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015669.951564:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00080000:1.0:1786015669.951606:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015669.951613:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015669.951714:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1786015669.951724:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304500736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015669.951788:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304500736:12345-0@lo:400:kworker.0 Request processed in 66us (18820us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015669.951794:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:0.0:1786015669.952157:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304500864:12345-0@lo:400:kworker.0 Request processed in 19034us (19429us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015669.952166:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:1.0:1786015669.952632:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304500736:0@lo:400:kworker.0 00000100:00100000:1.0:1786015669.952646:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304500608:0@lo:400:kworker.0 00000100:00100000:2.0:1786015669.953236:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304500480:12345-0@lo:400:kworker.0 Request processed in 13373us (20424us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015669.953246:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1786015669.956513:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304500992:12345-0@lo:400:kworker.0 Request processed in 14642us (23612us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015669.956539:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1786015669.957943:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304500480:0@lo:400:kworker.0 00000100:00100000:0.0:1786015669.958174:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304500992:0@lo:400:kworker.0 00000100:00100000:0.0:1786015669.958188:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304500352:0@lo:400:kworker.0 00000100:00100000:0.0:1786015669.958201:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304500864:0@lo:400:kworker.0 00010000:00010000:0.0:1786015670.126867:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015670.444095:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af0b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304501120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015670.444172:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015670.444254:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304501120 00000100:00100000:3.0:1786015670.444263:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304501120 00000100:00100000:3.0:1786015670.444312:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1786015670.444321:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304501120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015670.444377:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015670.444426:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304501120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015670.444434:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1786015670.444482:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af0b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304501120:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1786015670.528706:0:24808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015670.528718:0:24808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015670.529523:0:24808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015670.529537:0:24808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015671.151863:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015672.172596:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015672.671418:0:24860:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015672.671427:0:24860:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015672.673064:0:24860:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015672.673085:0:24860:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015672.904917:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015672.905025:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015672.905070:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015672.905093:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015672.905116:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015672.905138:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015672.905232:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015672.905267:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280751104 00000100:00100000:3.0:1786015672.905280:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280751104 00000100:00100000:3.0:1786015672.905352:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 659 00000100:00100000:3.0:1786015672.905364:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+108:2354:x1872772280751104:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015672.905451:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+108:2354:x1872772280751104:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 90us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015672.905459:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 659 00000100:00100000:3.0:1786015672.905478:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280751488 00000100:00100000:3.0:1786015672.905481:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280751488 00000100:00100000:3.0:1786015672.905505:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 660 00000100:00100000:3.0:1786015672.905512:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280751488:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015672.905540:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280751488:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015672.905546:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 660 00000100:00100000:3.0:1786015672.905563:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280751360 00000100:00100000:3.0:1786015672.905566:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280751360 00000100:00100000:3.0:1786015672.905607:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280751616 00000100:00100000:3.0:1786015672.905610:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280751616 00000100:00100000:3.0:1786015672.905624:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280751232 00000100:00100000:3.0:1786015672.905627:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280751232 00000100:00100000:3.0:1786015672.905639:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280751744 00000100:00100000:3.0:1786015672.905641:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280751744 00000100:00100000:3.0:1786015672.905655:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 687 00000100:00100000:3.0:1786015672.905662:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383949180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280751360:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015672.905689:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383949180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280751360:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015672.905694:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 687 00000100:00100000:3.0:1786015672.905705:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 688 00000100:00100000:3.0:1786015672.905709:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738394b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280751616:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015672.905732:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738394b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280751616:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015672.905738:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 688 00000100:00100000:3.0:1786015672.905748:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 689 00000100:00100000:3.0:1786015672.905753:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b897ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280751232:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015672.905911:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 690 00000100:00100000:0.0:1786015672.905921:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280751744:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015672.905951:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280751744:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015672.905957:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 690 00000100:00100000:3.0:1786015672.909591:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b897ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280751232:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 3824us (4462us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015672.909605:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 689 00000100:00080000:3.0:1786015672.909660:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786015672.909666:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015672.909669:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015672.910134:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280750976 00000100:00100000:3.0:1786015672.910145:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280750976 00000100:00100000:3.0:1786015672.910197:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 682 00000100:00100000:3.0:1786015672.910206:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280750976:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015672.910248:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280750976:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 42us (5221us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015672.910254:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 682 00010000:00010000:0.0:1786015673.197462:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015673.518363:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304501248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015673.518446:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015673.526821:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304501248 00000100:00100000:0.0:1786015673.526840:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304501248 00000100:00100000:0.0:1786015673.527184:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1786015673.527196:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304501248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015673.527259:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015673.527860:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304501248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 664us (9411us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015673.527869:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:3.0:1786015673.528590:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015673.529172:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304501248:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786015674.220811:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015674.552551:0:24911:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015674.552564:0:24911:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015674.553111:0:24911:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015674.553122:0:24911:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015675.053751:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304501632:0@lo:400:kworker.0 00000100:00100000:3.0:1786015675.053861:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015675.053953:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015675.053959:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304501760:0@lo:400:kworker.0 00000100:00100000:3.0:1786015675.053988:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015675.054026:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304501760 00000100:00100000:3.0:1786015675.054034:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304501760 00000100:00100000:3.0:1786015675.054091:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1786015675.054102:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304501760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015675.054159:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304501760:12345-0@lo:400:kworker.0 Request processed in 58us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015675.054166:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00080000:3.0:1786015675.054199:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015675.054236:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304501760:0@lo:400:kworker.0 00000100:00100000:0.0:1786015675.054251:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304501376:0@lo:400:kworker.0 00000100:00100000:0.0:1786015675.054305:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015675.054339:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304501888:0@lo:400:kworker.0 00000100:00100000:0.0:1786015675.054365:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015675.054383:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1786015675.054388:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304501504:0@lo:400:kworker.0 00000100:00100000:0.0:1786015675.054413:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015675.054433:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304502016:0@lo:400:kworker.0 00000100:00100000:0.0:1786015675.054455:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015675.054480:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304501632 00000100:00100000:0.0:1786015675.054483:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304501632 00000100:00100000:3.0:1786015675.054498:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304501376 00000100:00100000:3.0:1786015675.054502:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304501376 00000100:00100000:0.0:1786015675.054515:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304501888 00000100:00100000:0.0:1786015675.054518:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304501888 00000100:00100000:3.0:1786015675.054523:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1786015675.054529:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304501376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015675.054535:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304501504 00000100:00100000:0.0:1786015675.054537:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304501504 00000100:00100000:0.0:1786015675.054553:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:0.0:1786015675.054558:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304501632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015675.054567:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304501376:12345-0@lo:400:kworker.0 Request processed in 38us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015675.054573:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:0.0:1786015675.054591:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304501632:12345-0@lo:400:kworker.0 Request processed in 33us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015675.054597:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1786015675.054601:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:3.0:1786015675.054607:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304501888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015675.054609:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:0.0:1786015675.054613:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304501504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015675.054697:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304502016 00000100:00100000:2.0:1786015675.054702:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304502016 00000100:00100000:2.0:1786015675.054732:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:2.0:1786015675.054739:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304502016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015675.054876:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304501376:0@lo:400:kworker.0 00000100:00080000:1.0:1786015675.054903:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015675.054907:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015675.054926:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304501632:0@lo:400:kworker.0 00000100:00100000:3.0:1786015675.061136:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304501888:12345-0@lo:400:kworker.0 Request processed in 6515us (6756us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015675.061154:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1786015675.061622:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304501888:0@lo:400:kworker.0 00000100:00100000:2.0:1786015675.064754:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304502016:12345-0@lo:400:kworker.0 Request processed in 10003us (10285us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015675.064905:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304502016:0@lo:400:kworker.0 00000100:00100000:2.0:1786015675.065080:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1786015675.068133:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304501504:12345-0@lo:400:kworker.0 Request processed in 13506us (13707us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015675.068149:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:1.0:1786015675.068599:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304501504:0@lo:400:kworker.0 00010000:00010000:0.0:1786015675.245978:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015675.564141:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786015675.564169:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304502144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015675.564253:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015675.564445:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304502144 00000100:00100000:3.0:1786015675.564453:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304502144 00000100:00100000:3.0:1786015675.564508:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1786015675.564518:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304502144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015675.564564:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015675.564633:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304502144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015675.564641:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1786015675.565576:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304502144:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786015676.268899:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015676.719070:0:24962:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015676.719079:0:24962:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015676.720101:0:24962:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015676.720116:0:24962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1786015676.780985:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015676.780995:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015676.781554:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015676.781564:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015677.292527:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015678.021667:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015678.021702:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015678.021744:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015678.021855:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280752256 00000100:00100000:1.0:1786015678.021866:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280752256 00000100:00100000:1.0:1786015678.021938:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 693 00000100:00100000:1.0:1786015678.021948:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280752256:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015678.022008:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280752256:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 64us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015678.022505:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280752000 00000100:00100000:2.0:1786015678.022511:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280752000 00000100:00100000:2.0:1786015678.022552:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 664 00000100:00100000:2.0:1786015678.022560:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280752000:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015678.022591:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280752000:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015678.022596:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 664 00000100:00100000:0.0:1786015678.022781:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280751872 00000100:00100000:0.0:1786015678.022795:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280751872 00000100:00100000:0.0:1786015678.022830:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 684 00000100:00100000:0.0:1786015678.022838:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280751872:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015678.022866:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280751872:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015678.022872:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 684 00000100:00100000:1.0:1786015678.022989:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 693 00000100:00080000:1.0:1786015678.023012:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015678.023221:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015678.027039:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015678.031340:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015678.037195:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015678.038099:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015678.040202:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280752512 00000100:00100000:0.0:1786015678.040218:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280752512 00000100:00100000:0.0:1786015678.040304:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280752128 00000100:00100000:0.0:1786015678.040308:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280752128 00000100:00100000:0.0:1786015678.040344:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 694 00000100:00100000:0.0:1786015678.040356:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280752512:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015678.040445:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280752512:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 93us (13417us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015678.040451:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 694 00000100:00100000:0.0:1786015678.040464:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 695 00000100:00100000:0.0:1786015678.040468:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280752128:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015678.040485:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280752128:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 17us (9155us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015678.040490:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 695 00000100:00080000:0.0:1786015678.040514:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015678.041391:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280752384 00000100:00100000:0.0:1786015678.041401:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280752384 00000100:00100000:0.0:1786015678.041441:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 665 00000100:00100000:0.0:1786015678.041446:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2354:x1872772280752384:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015678.041484:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2354:x1872772280752384:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (4301us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015678.041489:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 665 00000100:00080000:0.0:1786015678.041509:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015678.044334:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280752640 00000100:00100000:0.0:1786015678.044349:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280752640 00000100:00100000:0.0:1786015678.044437:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 696 00000100:00100000:0.0:1786015678.044447:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280752640:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015678.044525:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280752640:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 81us (7293us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015678.044532:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 696 00000100:00080000:1.0:1786015678.045079:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786015678.322345:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015678.613696:0:25013:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015678.613705:0:25013:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015678.614263:0:25013:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015678.614273:0:25013:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015678.639268:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304502272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015678.639342:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015678.639444:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304502272 00000100:00100000:0.0:1786015678.639452:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304502272 00000100:00100000:0.0:1786015678.639513:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1786015678.639522:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304502272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015678.639560:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015678.639606:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304502272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015678.639614:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:2.0:1786015678.639661:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015678.639698:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304502272:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786015679.342529:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015680.173417:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304502656:0@lo:400:kworker.0 00000100:00100000:1.0:1786015680.173499:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015680.173562:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015680.173969:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304502784:0@lo:400:kworker.0 00000100:00100000:1.0:1786015680.174009:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015680.174082:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304502656 00000100:00100000:1.0:1786015680.174090:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304502656 00000100:00100000:1.0:1786015680.174154:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:1.0:1786015680.174165:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304502656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015680.174223:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304502656:12345-0@lo:400:kworker.0 Request processed in 60us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015680.174230:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:1.0:1786015680.174276:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304502656:0@lo:400:kworker.0 00000100:00100000:1.0:1786015680.174308:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304502784 00000100:00100000:1.0:1786015680.174311:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304502784 00000100:00100000:1.0:1786015680.174340:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1786015680.174346:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304502784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015680.174386:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304502784:12345-0@lo:400:kworker.0 Request processed in 40us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015680.174393:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1786015680.174416:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304502784:0@lo:400:kworker.0 00000100:00100000:3.0:1786015680.175753:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304502528:0@lo:400:kworker.0 00000100:00100000:3.0:1786015680.175851:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015680.175913:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304503040:0@lo:400:kworker.0 00000100:00100000:3.0:1786015680.175952:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015680.175987:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786015680.175994:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304502400:0@lo:400:kworker.0 00000100:00100000:3.0:1786015680.176030:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015680.176055:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304502912:0@lo:400:kworker.0 00000100:00100000:3.0:1786015680.176078:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786015680.176288:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015680.176299:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015680.176309:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304502528 00000100:00100000:2.0:1786015680.176315:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304502912 00000100:00100000:1.0:1786015680.176320:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304502528 00000100:00100000:2.0:1786015680.176322:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304502912 00000100:00100000:1.0:1786015680.176375:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:1.0:1786015680.176387:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304502528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015680.176454:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304502528:12345-0@lo:400:kworker.0 Request processed in 70us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015680.176462:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:1.0:1786015680.176503:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304502528:0@lo:400:kworker.0 00000100:00100000:2.0:1786015680.176551:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:2.0:1786015680.177035:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304502912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015680.177092:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304502912:12345-0@lo:400:kworker.0 Request processed in 533us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015680.177160:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304502912:0@lo:400:kworker.0 00000100:00100000:1.0:1786015680.178848:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304503040 00000100:00100000:1.0:1786015680.178861:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304503040 00000100:00100000:1.0:1786015680.178918:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1786015680.178929:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304503040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015680.179030:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304503040:12345-0@lo:400:kworker.0 Request processed in 102us (3075us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015680.179037:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1786015680.179092:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304503040:0@lo:400:kworker.0 00000100:00100000:2.0:1786015680.180579:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:2.0:1786015680.180628:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304502400 00000100:00100000:2.0:1786015680.180637:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304502400 00000100:00100000:2.0:1786015680.180683:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:2.0:1786015680.180692:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304502400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015680.180801:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304502400:12345-0@lo:400:kworker.0 Request processed in 110us (4769us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015680.180809:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00080000:2.0:1786015680.180843:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015680.180849:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015680.182015:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304502400:0@lo:400:kworker.0 00010000:00010000:3.0:1786015680.364004:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015680.628755:0:25065:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015680.628787:0:25065:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015680.629835:0:25065:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015680.629846:0:25065:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015680.685144:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786015680.685168:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304503168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015680.685241:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015680.685896:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304503168 00000100:00100000:3.0:1786015680.685906:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304503168 00000100:00100000:3.0:1786015680.685959:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1786015680.685968:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304503168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015680.686006:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015680.686076:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304503168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015680.686084:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1786015680.686178:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304503168:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786015681.391613:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015682.412063:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015682.765749:0:25116:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015682.765945:0:25116:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015682.766621:0:25116:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015682.766632:0:25116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015683.135663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015683.135719:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015683.135802:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015683.135830:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015683.135850:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015683.135880:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015683.135901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015683.135929:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280752768 00000100:00100000:0.0:1786015683.135939:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280752768 00000100:00100000:0.0:1786015683.135988:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 686 00000100:00100000:0.0:1786015683.135998:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b0350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280752768:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015683.136070:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b0350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280752768:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 74us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015683.136077:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 686 00000100:00100000:0.0:1786015683.136108:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280753152 00000100:00100000:0.0:1786015683.136111:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280753152 00000100:00100000:0.0:1786015683.136138:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280753408 00000100:00100000:0.0:1786015683.136140:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280753408 00000100:00100000:0.0:1786015683.136152:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280753024 00000100:00100000:0.0:1786015683.136154:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280753024 00000100:00100000:0.0:1786015683.136165:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280753536 00000100:00100000:0.0:1786015683.136167:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280753536 00000100:00100000:0.0:1786015683.136180:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 699 00000100:00100000:0.0:1786015683.136186:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280753152:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015683.136214:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280753152:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015683.136220:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 699 00000100:00100000:0.0:1786015683.136231:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 700 00000100:00100000:0.0:1786015683.136237:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280753408:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015683.136257:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280753408:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015683.136262:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 700 00000100:00100000:0.0:1786015683.136270:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 701 00000100:00100000:0.0:1786015683.136276:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280753024:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015683.136296:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280753024:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015683.136301:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 701 00000100:00100000:0.0:1786015683.136311:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 702 00000100:00100000:0.0:1786015683.136317:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280753536:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015683.136337:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280753536:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015683.136342:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 702 00000100:00100000:0.0:1786015683.136359:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280752896 00000100:00100000:0.0:1786015683.136362:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280752896 00000100:00100000:0.0:1786015683.136382:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280753280 00000100:00100000:0.0:1786015683.136385:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280753280 00000100:00100000:0.0:1786015683.136400:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 669 00000100:00100000:0.0:1786015683.136405:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+108:2354:x1872772280752896:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015683.136429:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+108:2354:x1872772280752896:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015683.136435:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 669 00000100:00100000:0.0:1786015683.136446:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 670 00000100:00100000:0.0:1786015683.136452:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2354:x1872772280753280:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015683.136470:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2354:x1872772280753280:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 19us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015683.136475:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 670 00000100:00080000:0.0:1786015683.136494:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015683.136498:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015683.136499:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786015683.439953:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015683.756568:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015683.756600:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304503296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015683.756700:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015683.757028:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304503296 00000100:00100000:3.0:1786015683.757037:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304503296 00000100:00100000:3.0:1786015683.757104:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1786015683.757113:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304503296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015683.757148:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015683.757211:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304503296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015683.757219:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:3.0:1786015683.757244:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015683.758502:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304503296:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786015684.465496:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015684.713380:0:25167:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015684.713390:0:25167:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015684.714354:0:25167:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015684.714369:0:25167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015685.292327:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304503808:0@lo:400:kworker.0 00000100:00100000:3.0:1786015685.292497:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304503552:0@lo:400:kworker.0 00000100:00100000:1.0:1786015685.292573:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304503424:0@lo:400:kworker.0 00000100:00100000:0.0:1786015685.292677:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304503680:0@lo:400:kworker.0 00000100:00100000:3.0:1786015685.293210:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015685.293282:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304504064:0@lo:400:kworker.0 00000100:00100000:3.0:1786015685.293309:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015685.293389:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304503552 00000100:00100000:3.0:1786015685.293397:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304503552 00000100:00100000:3.0:1786015685.293578:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1786015685.293588:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304503552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015685.293668:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304503552:12345-0@lo:400:kworker.0 Request processed in 73us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015685.293675:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1786015685.294077:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304503552:0@lo:400:kworker.0 00000100:00100000:3.0:1786015685.294120:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304504064 00000100:00100000:3.0:1786015685.294124:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304504064 00000100:00100000:3.0:1786015685.294166:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1786015685.294173:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304504064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015685.294216:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304504064:12345-0@lo:400:kworker.0 Request processed in 43us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015685.294222:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00080000:3.0:1786015685.294238:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015685.294257:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304504064:0@lo:400:kworker.0 00000100:00100000:1.0:1786015685.294772:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015685.294823:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304503936:0@lo:400:kworker.0 00000100:00100000:1.0:1786015685.295041:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015685.295082:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304503936 00000100:00100000:1.0:1786015685.295087:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304503936 00000100:00100000:1.0:1786015685.295125:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:1.0:1786015685.295134:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304503936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015685.295178:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304503936:12345-0@lo:400:kworker.0 Request processed in 46us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015685.295184:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00080000:1.0:1786015685.295206:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015685.295225:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304503936:0@lo:400:kworker.0 00000100:00100000:2.0:1786015685.295335:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015685.295530:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304503424 00000100:00100000:3.0:1786015685.295535:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304503424 00000100:00100000:3.0:1786015685.295574:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:3.0:1786015685.295581:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304503424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015685.295629:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304503424:12345-0@lo:400:kworker.0 Request processed in 49us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015685.295636:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:1.0:1786015685.295786:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304503808 00000100:00100000:1.0:1786015685.295790:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304503808 00000100:00100000:1.0:1786015685.295986:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1786015685.295995:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304503808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015685.296037:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304503808:12345-0@lo:400:kworker.0 Request processed in 44us (701us total) trans 0 rc 0/0 00000100:00080000:3.0:1786015685.296134:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015685.296174:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304503808:0@lo:400:kworker.0 00000100:00100000:0.0:1786015685.296566:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015685.296674:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304503424:0@lo:400:kworker.0 00000100:00100000:1.0:1786015685.297090:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:3.0:1786015685.297151:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304503680 00000100:00100000:3.0:1786015685.297157:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304503680 00000100:00100000:3.0:1786015685.297209:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1786015685.297216:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304503680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015685.297283:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304503680:12345-0@lo:400:kworker.0 Request processed in 67us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015685.297289:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1786015685.297525:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304503680:0@lo:400:kworker.0 00000100:00080000:1.0:1786015685.297580:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786015685.484131:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015685.804792:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304504192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015685.804883:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015685.804979:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304504192 00000100:00100000:1.0:1786015685.804987:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304504192 00000100:00100000:1.0:1786015685.805043:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1786015685.805053:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304504192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015685.805089:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015685.805148:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304504192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015685.805156:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1786015685.805199:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304504192:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786015686.509045:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015686.800262:0:25218:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015686.800274:0:25218:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015686.801375:0:25218:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015686.802067:0:25218:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1786015687.022484:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015687.022494:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015687.023394:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015687.023409:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015687.533247:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015688.255888:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015688.256044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015688.256079:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015688.256120:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015688.256145:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015688.256165:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015688.256222:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280754048 00000100:00100000:2.0:1786015688.256232:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280754048 00000100:00100000:2.0:1786015688.256288:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280754304 00000100:00100000:2.0:1786015688.256292:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280754304 00000100:00100000:2.0:1786015688.256307:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280753920 00000100:00100000:2.0:1786015688.256310:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280753920 00000100:00100000:2.0:1786015688.256331:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 705 00000100:00100000:2.0:1786015688.256340:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280754048:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015688.256414:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280754048:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 75us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015688.256422:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 705 00000100:00100000:2.0:1786015688.256439:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 706 00000100:00100000:2.0:1786015688.256447:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280754304:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015688.256474:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280754304:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015688.256480:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 706 00000100:00100000:3.0:1786015688.256492:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 707 00000100:00100000:3.0:1786015688.256506:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280753920:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015688.256580:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280753920:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 70us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015688.256587:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 707 00000100:00100000:2.0:1786015688.256626:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280753664 00000100:00100000:2.0:1786015688.256641:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280753664 00000100:00100000:2.0:1786015688.256671:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 688 00000100:00100000:2.0:1786015688.256679:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280753664:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015688.256706:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280753664:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015688.256711:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 688 00000100:00100000:0.0:1786015688.257809:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015688.257891:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280753792 00000100:00100000:1.0:1786015688.257900:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280753792 00000100:00100000:3.0:1786015688.258031:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280754432 00000100:00100000:3.0:1786015688.258037:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280754432 00000100:00100000:3.0:1786015688.258069:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 708 00000100:00100000:3.0:1786015688.258078:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280754432:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015688.258131:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280754432:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 54us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015688.258138:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 708 00000100:00100000:2.0:1786015688.258409:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280754176 00000100:00100000:2.0:1786015688.258415:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280754176 00000100:00100000:2.0:1786015688.258456:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 674 00000100:00100000:2.0:1786015688.258464:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280753792:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015688.258497:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280753792:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 34us (2619us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015688.258504:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 674 00000100:00100000:2.0:1786015688.258518:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 675 00000100:00100000:2.0:1786015688.258525:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280754176:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015688.258563:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280754176:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (2396us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015688.258570:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 675 00000100:00080000:0.0:1786015688.258984:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015688.258991:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015688.258993:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786015688.556085:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015688.812349:0:25270:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015688.812359:0:25270:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015688.815117:0:25270:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015688.815137:0:25270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015688.877549:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304504320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015688.877638:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015688.877714:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304504320 00000100:00100000:0.0:1786015688.877722:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304504320 00000100:00100000:0.0:1786015688.877814:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1786015688.877822:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304504320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015688.877854:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015688.877897:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304504320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015688.877904:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:0.0:1786015688.877924:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015688.877955:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304504320:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786015689.582443:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015690.417334:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304504448:0@lo:400:kworker.0 00000100:00100000:0.0:1786015690.417413:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015690.417470:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304504960:0@lo:400:kworker.0 00000100:00100000:0.0:1786015690.417500:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015690.417529:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1786015690.417536:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304504576:0@lo:400:kworker.0 00000100:00100000:0.0:1786015690.417559:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015690.417577:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304505088:0@lo:400:kworker.0 00000100:00100000:0.0:1786015690.417603:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015690.417641:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304504704:0@lo:400:kworker.0 00000100:00100000:0.0:1786015690.417682:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015690.417703:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015690.417709:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304504832:0@lo:400:kworker.0 00000100:00100000:0.0:1786015690.417732:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015690.417791:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304504960 00000100:00100000:0.0:1786015690.417798:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304504960 00000100:00100000:0.0:1786015690.417852:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304504576 00000100:00100000:0.0:1786015690.417856:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304504576 00000100:00100000:0.0:1786015690.417877:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304504704 00000100:00100000:0.0:1786015690.417880:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304504704 00000100:00100000:0.0:1786015690.417902:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:0.0:1786015690.417911:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304504960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015690.417965:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304504960:12345-0@lo:400:kworker.0 Request processed in 55us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015690.417972:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:0.0:1786015690.417989:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:0.0:1786015690.417995:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304504576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015690.418022:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304504576:12345-0@lo:400:kworker.0 Request processed in 27us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015690.418032:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:0.0:1786015690.418042:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:0.0:1786015690.418048:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304504704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015690.418076:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304504704:12345-0@lo:400:kworker.0 Request processed in 27us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015690.418081:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:0.0:1786015690.418101:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304505088 00000100:00100000:0.0:1786015690.418105:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304505088 00000100:00100000:0.0:1786015690.418130:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304504832 00000100:00100000:0.0:1786015690.418133:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304504832 00000100:00100000:0.0:1786015690.418151:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1786015690.418158:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c103c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304505088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015690.418187:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c103c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304505088:12345-0@lo:400:kworker.0 Request processed in 30us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015690.418193:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1786015690.418204:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:0.0:1786015690.418210:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304504832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015690.418233:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304504832:12345-0@lo:400:kworker.0 Request processed in 24us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015690.418238:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00080000:0.0:1786015690.418258:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015690.418263:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015690.418265:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015690.418303:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304504832:0@lo:400:kworker.0 00000100:00100000:0.0:1786015690.418313:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304504704:0@lo:400:kworker.0 00000100:00100000:0.0:1786015690.418344:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304504576:0@lo:400:kworker.0 00000100:00100000:0.0:1786015690.418354:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304505088:0@lo:400:kworker.0 00000100:00100000:0.0:1786015690.418362:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304504960:0@lo:400:kworker.0 00000100:00100000:3.0:1786015690.418497:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304504448 00000100:00100000:3.0:1786015690.418502:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304504448 00000100:00100000:3.0:1786015690.418530:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1786015690.418537:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304504448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015690.418587:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304504448:12345-0@lo:400:kworker.0 Request processed in 50us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015690.418593:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:0.0:1786015690.418742:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304504448:0@lo:400:kworker.0 00010000:00010000:1.0:1786015690.604127:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015690.794440:0:25321:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015690.794450:0:25321:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015690.796249:0:25321:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015690.796263:0:25321:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015690.926000:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738374a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304505216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015690.926078:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015690.926192:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304505216 00000100:00100000:2.0:1786015690.926203:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304505216 00000100:00100000:2.0:1786015690.926480:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1786015690.926491:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304505216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786015690.926527:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015690.926578:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304505216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015690.926586:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1786015690.926912:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738374a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304505216:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786015691.629988:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786015692.653635:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015692.721201:0:25372:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015692.721210:0:25372:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015692.722369:0:25372:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015692.722383:0:25372:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015693.381266:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015693.381322:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015693.381354:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015693.381390:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015693.381405:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015693.381427:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015693.381449:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015693.381474:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280754816 00000100:00100000:1.0:1786015693.381483:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280754816 00000100:00100000:1.0:1786015693.381533:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280755328 00000100:00100000:1.0:1786015693.381535:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280755328 00000100:00100000:1.0:1786015693.381550:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280754944 00000100:00100000:1.0:1786015693.381553:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280754944 00000100:00100000:1.0:1786015693.381564:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280755200 00000100:00100000:1.0:1786015693.381567:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280755200 00000100:00100000:1.0:1786015693.381581:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 711 00000100:00100000:1.0:1786015693.381604:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280754816:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015693.381685:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280754816:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 71us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015693.381692:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 711 00000100:00100000:1.0:1786015693.381708:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 712 00000100:00100000:1.0:1786015693.381715:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280755328:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015693.381738:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280755328:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015693.381744:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 712 00000100:00100000:1.0:1786015693.382025:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 713 00000100:00100000:1.0:1786015693.382033:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280754944:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015693.382063:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280754944:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015693.382068:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 713 00000100:00100000:1.0:1786015693.382080:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 714 00000100:00100000:1.0:1786015693.382086:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aea9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280755200:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015693.382108:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aea9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280755200:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015693.382113:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 714 00000100:00100000:2.0:1786015693.382919:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280754560 00000100:00100000:2.0:1786015693.382927:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280754560 00000100:00100000:2.0:1786015693.382971:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 690 00000100:00100000:2.0:1786015693.382979:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280754560:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015693.383016:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280754560:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 39us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015693.383023:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 690 00000100:00100000:0.0:1786015693.383326:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280754688 00000100:00100000:0.0:1786015693.383332:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280754688 00000100:00100000:0.0:1786015693.383378:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280755072 00000100:00100000:0.0:1786015693.383381:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280755072 00000100:00100000:0.0:1786015693.383409:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 679 00000100:00100000:0.0:1786015693.383417:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+108:2354:x1872772280754688:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015693.383452:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+108:2354:x1872772280754688:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 35us (2196us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015693.383457:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 679 00000100:00100000:0.0:1786015693.383471:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 680 00000100:00100000:0.0:1786015693.383476:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aee5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280755072:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015693.383498:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aee5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280755072:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (2107us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015693.383507:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 680 00000100:00080000:0.0:1786015693.383534:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015693.383538:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015693.383540:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786015693.676149:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015694.013127:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304505344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015694.013199:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015694.013277:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304505344 00000100:00100000:3.0:1786015694.013286:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304505344 00000100:00100000:3.0:1786015694.013336:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1786015694.013344:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304505344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015694.013379:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015694.013423:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304505344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015694.013431:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:3.0:1786015694.013454:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015694.013494:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304505344:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1786015694.591813:0:25424:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015694.591825:0:25424:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015694.592359:0:25424:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015694.592370:0:25424:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015694.706971:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015695.532134:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304505856:0@lo:400:kworker.0 00000100:00100000:2.0:1786015695.532209:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015695.532274:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786015695.532280:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c0cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304505728:0@lo:400:kworker.0 00000100:00100000:2.0:1786015695.532309:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015695.532393:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b738374a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304505600:0@lo:400:kworker.0 00000100:00100000:3.0:1786015695.532424:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015695.532459:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304506112:0@lo:400:kworker.0 00000100:00100000:3.0:1786015695.532482:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015695.532500:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786015695.532520:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304505472:0@lo:400:kworker.0 00000100:00100000:3.0:1786015695.532550:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015695.532611:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304505984:0@lo:400:kworker.0 00000100:00100000:3.0:1786015695.532633:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015695.532850:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304505728 00000100:00100000:0.0:1786015695.532859:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304505728 00000100:00100000:0.0:1786015695.532921:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304505600 00000100:00100000:0.0:1786015695.532924:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304505600 00000100:00100000:0.0:1786015695.532943:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304505984 00000100:00100000:0.0:1786015695.532946:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304505984 00000100:00100000:0.0:1786015695.532962:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1786015695.532971:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304505728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015695.533041:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304505728:12345-0@lo:400:kworker.0 Request processed in 71us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015695.533049:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1786015695.533068:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:0.0:1786015695.533074:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304505600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015695.533102:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304505600:12345-0@lo:400:kworker.0 Request processed in 28us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015695.533107:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:0.0:1786015695.533116:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:0.0:1786015695.533121:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304505984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015695.533143:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304505984:12345-0@lo:400:kworker.0 Request processed in 22us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015695.533148:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:0.0:1786015695.533164:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304505472 00000100:00100000:0.0:1786015695.533166:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304505472 00000100:00100000:0.0:1786015695.533185:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1786015695.533189:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304505472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015695.533214:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304505472:12345-0@lo:400:kworker.0 Request processed in 24us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015695.533219:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1786015695.533272:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304505728:0@lo:400:kworker.0 00000100:00080000:3.0:1786015695.533385:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015695.533403:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304505472:0@lo:400:kworker.0 00000100:00100000:3.0:1786015695.533413:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304505984:0@lo:400:kworker.0 00000100:00100000:3.0:1786015695.533420:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b738374a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304505600:0@lo:400:kworker.0 00000100:00100000:1.0:1786015695.533738:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304505856 00000100:00100000:1.0:1786015695.533743:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304505856 00000100:00100000:1.0:1786015695.533810:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304506112 00000100:00100000:1.0:1786015695.533814:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304506112 00000100:00100000:1.0:1786015695.533854:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1786015695.533861:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304505856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015695.533909:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304505856:12345-0@lo:400:kworker.0 Request processed in 49us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015695.533916:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1786015695.533927:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1786015695.533934:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304506112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015695.533964:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304506112:12345-0@lo:400:kworker.0 Request processed in 31us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015695.533969:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1786015695.534011:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c0cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304505856:0@lo:400:kworker.0 00000100:00080000:3.0:1786015695.534118:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015695.534139:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381cc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304506112:0@lo:400:kworker.0 00010000:00010000:2.0:1786015695.725085:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015696.043986:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786015696.044011:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf4bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304506240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015696.044084:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015696.052574:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304506240 00000100:00100000:1.0:1786015696.052592:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304506240 00000100:00100000:1.0:1786015696.055912:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1786015696.055934:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304506240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015696.055987:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015696.056086:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304506240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (12000us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015696.056093:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1786015696.056177:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf4bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304506240:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1786015696.439501:0:25475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015696.439514:0:25475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015696.442865:0:25475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015696.442888:0:25475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015696.748665:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015697.260084:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015697.260095:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015697.260661:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015697.260670:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015697.775225:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015698.451512:0:25526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015698.451522:0:25526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015698.452215:0:25526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015698.452222:0:25526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015698.502887:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015698.502934:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015698.502963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015698.502983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015698.503000:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015698.503018:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015698.503041:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015698.503070:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280755712 00000100:00100000:1.0:1786015698.503080:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280755712 00000100:00100000:1.0:1786015698.503133:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280756224 00000100:00100000:1.0:1786015698.503137:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280756224 00000100:00100000:1.0:1786015698.503155:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280755840 00000100:00100000:1.0:1786015698.503158:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280755840 00000100:00100000:1.0:1786015698.503171:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280756096 00000100:00100000:1.0:1786015698.503174:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280756096 00000100:00100000:1.0:1786015698.503190:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 717 00000100:00100000:1.0:1786015698.503199:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280755712:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015698.503264:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280755712:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 66us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015698.503272:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 717 00000100:00100000:1.0:1786015698.503289:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 718 00000100:00100000:1.0:1786015698.503297:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280756224:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015698.503320:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280756224:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015698.503327:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 718 00000100:00100000:1.0:1786015698.503338:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 719 00000100:00100000:1.0:1786015698.503345:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280755840:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015698.503366:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280755840:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015698.503372:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 719 00000100:00100000:1.0:1786015698.503383:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 720 00000100:00100000:1.0:1786015698.503388:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280756096:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015698.503409:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280756096:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015698.503415:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 720 00000100:00100000:1.0:1786015698.503433:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280755968 00000100:00100000:1.0:1786015698.503436:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280755968 00000100:00100000:1.0:1786015698.503462:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280755584 00000100:00100000:1.0:1786015698.503465:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280755584 00000100:00100000:1.0:1786015698.503487:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 684 00000100:00100000:1.0:1786015698.503493:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2354:x1872772280755968:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015698.503520:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2354:x1872772280755968:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015698.503527:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 684 00000100:00100000:1.0:1786015698.503550:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 685 00000100:00100000:1.0:1786015698.503556:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+108:2354:x1872772280755584:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015698.503577:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+108:2354:x1872772280755584:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015698.503583:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 685 00000100:00080000:1.0:1786015698.503617:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015698.503622:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015698.503624:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015698.504848:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280755456 00000100:00100000:2.0:1786015698.504858:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280755456 00000100:00100000:2.0:1786015698.504922:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 692 00000100:00100000:2.0:1786015698.504934:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280755456:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015698.504994:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280755456:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 65us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015698.505000:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 692 00010000:00010000:1.0:1786015698.797529:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015699.116193:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015699.116219:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aa5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304506368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015699.116298:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015699.116378:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304506368 00000100:00100000:0.0:1786015699.116386:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304506368 00000100:00100000:0.0:1786015699.116439:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1786015699.116448:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304506368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015699.116483:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015699.116539:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304506368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015699.116545:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1786015699.116588:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aa5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304506368:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786015699.118247:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786015699.820365:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015700.428149:0:25579:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015700.428158:0:25579:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015700.433141:0:25579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015700.433162:0:25579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015700.652173:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304506752:0@lo:400:kworker.0 00000100:00100000:1.0:1786015700.652243:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015700.652310:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015700.652316:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b73824f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304506880:0@lo:400:kworker.0 00000100:00100000:1.0:1786015700.652344:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015700.652382:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304506880 00000100:00100000:1.0:1786015700.652389:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304506880 00000100:00100000:1.0:1786015700.652437:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:1.0:1786015700.652446:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304506880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015700.652500:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304506880:12345-0@lo:400:kworker.0 Request processed in 55us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015700.652507:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:1.0:1786015700.652569:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304506880:0@lo:400:kworker.0 00000100:00100000:0.0:1786015700.652644:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304506496:0@lo:400:kworker.0 00000100:00100000:0.0:1786015700.652683:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015700.652718:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304507008:0@lo:400:kworker.0 00000100:00100000:0.0:1786015700.652740:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015700.652757:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1786015700.652787:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74c1223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304506624:0@lo:400:kworker.0 00000100:00100000:0.0:1786015700.652811:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015700.652826:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf39dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304507136:0@lo:400:kworker.0 00000100:00100000:0.0:1786015700.652847:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015700.652938:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304506752 00000100:00100000:2.0:1786015700.652943:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304506752 00000100:00100000:2.0:1786015700.652976:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304507008 00000100:00100000:2.0:1786015700.652979:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304507008 00000100:00100000:2.0:1786015700.652995:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304506624 00000100:00100000:2.0:1786015700.652998:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304506624 00000100:00100000:2.0:1786015700.653010:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:2.0:1786015700.653016:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304506752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015700.653058:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304506752:12345-0@lo:400:kworker.0 Request processed in 42us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015700.653064:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:2.0:1786015700.653077:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:2.0:1786015700.653083:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304507008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015700.653116:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304507008:12345-0@lo:400:kworker.0 Request processed in 33us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015700.653121:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:2.0:1786015700.653132:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:2.0:1786015700.653137:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304506624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015700.653163:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304506624:12345-0@lo:400:kworker.0 Request processed in 26us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015700.653169:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:2.0:1786015700.653202:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74c1223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304506624:0@lo:400:kworker.0 00000100:00100000:2.0:1786015700.653212:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304507008:0@lo:400:kworker.0 00000100:00100000:2.0:1786015700.653235:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b73824f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304506752:0@lo:400:kworker.0 00000100:00080000:0.0:1786015700.653287:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015700.653347:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304506496 00000100:00100000:1.0:1786015700.653351:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304506496 00000100:00100000:1.0:1786015700.653383:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1786015700.653389:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304506496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015700.653431:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304506496:12345-0@lo:400:kworker.0 Request processed in 42us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015700.653437:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1786015700.653468:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304507136 00000100:00100000:1.0:1786015700.653472:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304507136 00000100:00100000:1.0:1786015700.653500:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:1.0:1786015700.653505:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c0cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304507136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015700.653545:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c0cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304507136:12345-0@lo:400:kworker.0 Request processed in 40us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015700.653551:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00080000:1.0:1786015700.653567:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015700.653621:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf39dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304507136:0@lo:400:kworker.0 00000100:00100000:0.0:1786015700.653629:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304506496:0@lo:400:kworker.0 00010000:00010000:0.0:1786015700.846505:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015701.165427:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786015701.165459:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304507264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015701.165555:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015701.165651:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304507264 00000100:00100000:3.0:1786015701.165659:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304507264 00000100:00100000:3.0:1786015701.165707:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1786015701.165722:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304507264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786015701.165793:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015701.165857:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304507264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015701.165865:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1786015701.165924:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304507264:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786015701.868728:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015702.699382:0:25631:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015702.699391:0:25631:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015702.701964:0:25631:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015702.701986:0:25631:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015702.892973:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015703.616317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015703.616362:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015703.616518:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280756352 00000100:00100000:0.0:1786015703.616528:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280756352 00000100:00100000:0.0:1786015703.616589:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 694 00000100:00100000:0.0:1786015703.616601:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280756352:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015703.616681:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280756352:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 83us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015703.616689:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 694 00000100:00100000:1.0:1786015703.617439:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015703.617475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015703.617526:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280756864 00000100:00100000:3.0:1786015703.617532:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280756864 00000100:00100000:3.0:1786015703.617588:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 689 00000100:00100000:3.0:1786015703.617596:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280756864:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015703.617663:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2353:x1872772280756864:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 67us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015703.617670:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 689 00000100:00080000:0.0:1786015703.621148:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015703.628253:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015703.628279:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015703.628336:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280756480 00000100:00100000:0.0:1786015703.628346:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280756480 00000100:00100000:0.0:1786015703.628411:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 690 00000100:00100000:0.0:1786015703.628481:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280756480:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015703.628583:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+108:2353:x1872772280756480:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 95us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015703.628591:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 690 00000100:00080000:0.0:1786015703.628617:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015703.631632:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280756608 00000100:00100000:2.0:1786015703.631649:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280756608 00000100:00100000:2.0:1786015703.631739:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280757120 00000100:00100000:2.0:1786015703.631743:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280757120 00000100:00100000:2.0:1786015703.631785:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 723 00000100:00100000:2.0:1786015703.631797:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280756608:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015703.631891:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280756608:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 97us (15528us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015703.631898:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 723 00000100:00100000:2.0:1786015703.632017:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 724 00000100:00100000:2.0:1786015703.632025:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf39c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280757120:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015703.632056:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf39c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280757120:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (14581us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015703.632061:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 724 00000100:00080000:0.0:1786015703.633549:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015703.633558:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015703.639048:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015703.639475:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280756736 00000100:00100000:2.0:1786015703.639495:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280756736 00000100:00100000:2.0:1786015703.639565:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280756992 00000100:00100000:2.0:1786015703.639577:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280756992 00000100:00100000:2.0:1786015703.639615:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 725 00000100:00100000:2.0:1786015703.639625:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280756736:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015703.640015:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b73824f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280756736:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 390us (11733us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015703.640023:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 725 00000100:00100000:2.0:1786015703.640041:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 726 00000100:00100000:2.0:1786015703.640048:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280756992:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015703.640074:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280756992:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015703.640248:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 726 00000100:00080000:0.0:1786015703.640478:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015703.640482:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1786015703.915994:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015704.237230:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304507392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015704.237313:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015704.237400:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304507392 00000100:00100000:1.0:1786015704.237409:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304507392 00000100:00100000:1.0:1786015704.237469:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1786015704.237477:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304507392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015704.237531:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015704.237576:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304507392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015704.237583:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:1.0:1786015704.237605:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015704.237641:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304507392:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1786015704.889099:0:25682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015704.889160:0:25682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015704.889728:0:25682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015704.889735:0:25682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786015704.940394:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015705.772727:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304507776:0@lo:400:kworker.0 00000100:00100000:1.0:1786015705.772836:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015705.772897:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015705.772903:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304507904:0@lo:400:kworker.0 00000100:00100000:1.0:1786015705.772926:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015705.773094:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304507648:0@lo:400:kworker.0 00000100:00100000:3.0:1786015705.773123:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015705.773156:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304508160:0@lo:400:kworker.0 00000100:00100000:3.0:1786015705.773186:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015705.773206:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786015705.773211:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304507520:0@lo:400:kworker.0 00000100:00100000:3.0:1786015705.773237:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015705.773255:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304508032:0@lo:400:kworker.0 00000100:00100000:3.0:1786015705.773272:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015705.773297:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304507904 00000100:00100000:3.0:1786015705.773303:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304507904 00000100:00100000:3.0:1786015705.773338:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304508160 00000100:00100000:3.0:1786015705.773341:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304508160 00000100:00100000:3.0:1786015705.773366:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:3.0:1786015705.773373:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304507904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015705.773431:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304507904:12345-0@lo:400:kworker.0 Request processed in 58us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015705.773438:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:3.0:1786015705.773452:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:3.0:1786015705.773458:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7383aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304508160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015705.773499:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7383aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304508160:12345-0@lo:400:kworker.0 Request processed in 41us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015705.773505:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:3.0:1786015705.773522:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304507776 00000100:00100000:3.0:1786015705.773524:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304507776 00000100:00100000:3.0:1786015705.773544:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304507648 00000100:00100000:3.0:1786015705.773546:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304507648 00000100:00100000:3.0:1786015705.773557:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304508032 00000100:00100000:3.0:1786015705.773559:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304508032 00000100:00100000:3.0:1786015705.773570:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1786015705.773576:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304507776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015705.773602:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304507776:12345-0@lo:400:kworker.0 Request processed in 26us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015705.773612:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1786015705.773623:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:3.0:1786015705.773629:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304507648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015705.773667:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304507648:12345-0@lo:400:kworker.0 Request processed in 38us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015705.773673:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:3.0:1786015705.773683:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:3.0:1786015705.773689:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b738374a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304508032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015705.773711:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b738374a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304508032:12345-0@lo:400:kworker.0 Request processed in 23us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015705.773716:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:3.0:1786015705.773747:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304508032:0@lo:400:kworker.0 00000100:00100000:3.0:1786015705.773756:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304507648:0@lo:400:kworker.0 00000100:00100000:3.0:1786015705.773788:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304508160:0@lo:400:kworker.0 00000100:00080000:1.0:1786015705.774112:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015705.774117:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015705.774136:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304507904:0@lo:400:kworker.0 00000100:00100000:1.0:1786015705.774146:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304507776:0@lo:400:kworker.0 00000100:00100000:2.0:1786015705.774504:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304507520 00000100:00100000:2.0:1786015705.774510:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304507520 00000100:00100000:2.0:1786015705.774563:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:2.0:1786015705.774570:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304507520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015705.774623:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304507520:12345-0@lo:400:kworker.0 Request processed in 54us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015705.774641:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:3.0:1786015705.776351:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304507520:0@lo:400:kworker.0 00010000:00010000:0.0:1786015705.972010:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015706.284170:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304508288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015706.284293:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015706.284646:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304508288 00000100:00100000:0.0:1786015706.284660:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304508288 00000100:00100000:0.0:1786015706.284716:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1786015706.284725:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304508288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015706.284784:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015706.284875:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304508288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015706.284883:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1786015706.285036:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304508288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786015706.992335:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015707.010017:0:25733:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015707.010028:0:25733:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015707.011029:0:25733:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015707.011041:0:25733:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1786015707.502384:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015707.502393:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015707.503467:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015707.503478:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786015708.012883:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015708.737829:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015708.737905:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015708.737979:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280757376 00000100:00100000:1.0:1786015708.737990:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280757376 00000100:00100000:1.0:1786015708.738108:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 694 00000100:00100000:1.0:1786015708.738120:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c1223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+108:2352:x1872772280757376:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015708.738200:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c1223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+108:2352:x1872772280757376:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 82us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015708.738209:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 694 00000100:00100000:3.0:1786015708.738456:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280757248 00000100:00100000:3.0:1786015708.738461:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280757248 00000100:00100000:3.0:1786015708.738499:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 696 00000100:00100000:3.0:1786015708.738507:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280757248:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015708.738543:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280757248:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015708.738549:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 696 00000100:00080000:2.0:1786015708.738789:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015708.739189:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015708.739221:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015708.739249:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015708.739305:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280757504 00000100:00100000:3.0:1786015708.739311:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280757504 00000100:00100000:3.0:1786015708.739351:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280758016 00000100:00100000:3.0:1786015708.739354:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280758016 00000100:00100000:3.0:1786015708.739378:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 729 00000100:00100000:3.0:1786015708.739386:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280757504:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015708.739427:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280757504:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 41us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015708.739434:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 729 00000100:00100000:3.0:1786015708.739457:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 730 00000100:00100000:3.0:1786015708.739463:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280758016:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015708.739488:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280758016:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015708.739494:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 730 00000100:00080000:2.0:1786015708.739632:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015708.739636:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015708.739710:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280757760 00000100:00100000:1.0:1786015708.739714:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280757760 00000100:00100000:1.0:1786015708.739791:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 695 00000100:00100000:1.0:1786015708.739799:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2351:x1872772280757760:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015708.739827:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2351:x1872772280757760:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015708.739834:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 695 00000100:00080000:2.0:1786015708.740074:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015708.748703:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015708.748747:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015708.749116:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280757632 00000100:00100000:0.0:1786015708.749127:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280757632 00000100:00100000:0.0:1786015708.749180:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280757888 00000100:00100000:0.0:1786015708.749183:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280757888 00000100:00100000:0.0:1786015708.749207:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 731 00000100:00100000:0.0:1786015708.749217:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2352:x1872772280757632:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015708.749308:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2352:x1872772280757632:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 92us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015708.749316:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 731 00000100:00100000:0.0:1786015708.749332:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 732 00000100:00100000:0.0:1786015708.749339:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280757888:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015708.749363:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280757888:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015708.749370:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 732 00000100:00080000:2.0:1786015708.749481:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015708.749486:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1786015708.829587:0:25785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015708.829599:0:25785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015708.830127:0:25785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015708.830135:0:25785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786015709.043795:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015709.356109:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304508416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015709.356209:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015709.356277:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304508416 00000100:00100000:0.0:1786015709.356287:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304508416 00000100:00080000:2.0:1786015709.356316:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015709.356359:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1786015709.356371:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304508416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015709.356407:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015709.356490:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304508416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015709.356498:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1786015709.356548:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304508416:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786015710.063189:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015710.899942:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304508800:0@lo:400:kworker.0 00000100:00100000:3.0:1786015710.900026:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015710.900086:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015710.900093:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304508928:0@lo:400:kworker.0 00000100:00100000:3.0:1786015710.900120:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015710.900155:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304508800 00000100:00100000:3.0:1786015710.900163:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304508800 00000100:00100000:3.0:1786015710.900215:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:3.0:1786015710.900223:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304508800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015710.900273:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304508800:12345-0@lo:400:kworker.0 Request processed in 51us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015710.900280:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:3.0:1786015710.900303:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304508928 00000100:00100000:3.0:1786015710.900307:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304508928 00000100:00100000:3.0:1786015710.900331:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:3.0:1786015710.900337:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304508928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015710.900366:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304508928:12345-0@lo:400:kworker.0 Request processed in 29us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015710.900371:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00080000:3.0:1786015710.900384:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015710.900432:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304508928:0@lo:400:kworker.0 00000100:00100000:3.0:1786015710.900442:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304508800:0@lo:400:kworker.0 00000100:00100000:1.0:1786015710.900676:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304508672:0@lo:400:kworker.0 00000100:00100000:1.0:1786015710.900713:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015710.900740:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304509184:0@lo:400:kworker.0 00000100:00100000:1.0:1786015710.900781:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015710.900800:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1786015710.900805:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7383749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304508544:0@lo:400:kworker.0 00000100:00100000:1.0:1786015710.900835:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015710.900859:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304509056:0@lo:400:kworker.0 00000100:00100000:1.0:1786015710.900895:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015710.900923:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304508672 00000100:00100000:1.0:1786015710.900927:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304508672 00000100:00100000:1.0:1786015710.900953:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304509056 00000100:00100000:1.0:1786015710.900956:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304509056 00000100:00100000:1.0:1786015710.900975:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1786015710.900981:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa52b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304508672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015710.901019:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa52b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304508672:12345-0@lo:400:kworker.0 Request processed in 38us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015710.901026:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1786015710.902287:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1786015710.902302:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304509056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015710.902359:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304509056:12345-0@lo:400:kworker.0 Request processed in 62us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015710.902366:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1786015710.902399:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304508544 00000100:00100000:1.0:1786015710.902404:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304508544 00000100:00100000:1.0:1786015710.902453:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1786015710.902459:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304508544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015710.902491:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304508544:12345-0@lo:400:kworker.0 Request processed in 32us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015710.902497:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1786015710.902543:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7383749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304508544:0@lo:400:kworker.0 00000100:00100000:1.0:1786015710.902557:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304509056:0@lo:400:kworker.0 00000100:00100000:1.0:1786015710.902570:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304508672:0@lo:400:kworker.0 00000100:00100000:0.0:1786015710.906380:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304509184 00000100:00100000:0.0:1786015710.906401:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304509184 00000100:00100000:0.0:1786015710.906493:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:0.0:1786015710.906514:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304509184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015710.906631:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304509184:12345-0@lo:400:kworker.0 Request processed in 129us (5848us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015710.906639:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:0.0:1786015710.906689:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304509184:0@lo:400:kworker.0 00000100:00080000:3.0:1786015710.907683:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015710.907691:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1786015710.985545:0:25836:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015710.985556:0:25836:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015710.986090:0:25836:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015710.986099:0:25836:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015711.083931:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015711.404200:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304509312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015711.404291:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015711.404498:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304509312 00000100:00100000:1.0:1786015711.404507:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304509312 00000100:00100000:1.0:1786015711.404562:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1786015711.404572:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304509312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015711.404613:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015711.404682:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304509312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015711.404690:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1786015711.405221:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304509312:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786015712.109021:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015713.088889:0:25887:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015713.088901:0:25887:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015713.089552:0:25887:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015713.089563:0:25887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786015713.133711:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015713.856090:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015713.856139:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015713.856171:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015713.856198:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015713.856225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015713.856243:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015713.856268:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015713.856296:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280758400 00000100:00100000:1.0:1786015713.856306:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280758400 00000100:00100000:1.0:1786015713.856360:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280758912 00000100:00100000:1.0:1786015713.856365:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280758912 00000100:00100000:1.0:1786015713.856382:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280758528 00000100:00100000:1.0:1786015713.856385:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280758528 00000100:00100000:1.0:1786015713.856414:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280758784 00000100:00100000:1.0:1786015713.856417:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280758784 00000100:00100000:1.0:1786015713.856433:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 735 00000100:00100000:1.0:1786015713.856443:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2352:x1872772280758400:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015713.856670:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2352:x1872772280758400:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 227us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015713.856679:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 735 00000100:00100000:1.0:1786015713.856697:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 736 00000100:00100000:1.0:1786015713.856704:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280758912:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015713.856730:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280758912:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015713.856736:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 736 00000100:00100000:1.0:1786015713.856748:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 737 00000100:00100000:1.0:1786015713.856754:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+18:2352:x1872772280758528:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015713.856996:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+18:2352:x1872772280758528:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 241us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015713.857003:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 737 00000100:00100000:1.0:1786015713.857016:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 738 00000100:00100000:1.0:1786015713.857023:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280758784:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015713.857050:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280758784:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015713.857056:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 738 00000100:00100000:1.0:1786015713.857074:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280758656 00000100:00100000:1.0:1786015713.857078:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280758656 00000100:00100000:1.0:1786015713.857106:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280758272 00000100:00100000:1.0:1786015713.857110:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280758272 00000100:00100000:0.0:1786015713.857119:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 699 00000100:00100000:0.0:1786015713.857128:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2352:x1872772280758656:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015713.857158:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2352:x1872772280758656:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (987us total) trans 0 rc 0/0 00000100:00080000:3.0:1786015713.857234:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015713.857239:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015713.857242:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015713.857995:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 700 00000100:00100000:1.0:1786015713.858006:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+108:2352:x1872772280758272:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015713.858054:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+108:2352:x1872772280758272:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 51us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015713.858061:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 700 00000100:00100000:2.0:1786015713.858142:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280758144 00000100:00100000:2.0:1786015713.858148:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280758144 00000100:00100000:2.0:1786015713.858190:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 698 00000100:00100000:2.0:1786015713.858197:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280758144:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015713.858229:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280758144:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 34us (2152us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015713.858235:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 698 00000100:00100000:0.0:1786015713.872606:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 699 00010000:00010000:1.0:1786015714.156125:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015714.476327:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304509440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015714.476413:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015714.476712:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304509440 00000100:00100000:0.0:1786015714.476722:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304509440 00000100:00080000:3.0:1786015714.476930:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015714.478582:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1786015714.478615:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304509440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015714.478658:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015714.478748:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304509440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (2334us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015714.478910:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304509440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015714.492319:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000040:00080000:2.0:1786015715.090532:0:25938:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015715.090547:0:25938:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015715.097052:0:25938:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015715.097076:0:25938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015715.180979:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015716.012449:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304509952:0@lo:400:kworker.0 00000100:00100000:0.0:1786015716.012525:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015716.012679:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304509824:0@lo:400:kworker.0 00000100:00100000:3.0:1786015716.012730:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015716.012848:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304509824 00000100:00100000:3.0:1786015716.012856:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304509824 00000100:00100000:3.0:1786015716.013222:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:3.0:1786015716.013234:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304509824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015716.013298:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304509824:12345-0@lo:400:kworker.0 Request processed in 68us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015716.013305:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00080000:3.0:1786015716.013329:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015716.013378:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304509824:0@lo:400:kworker.0 00000100:00100000:3.0:1786015716.013433:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304509952 00000100:00100000:3.0:1786015716.013437:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304509952 00000100:00100000:3.0:1786015716.013490:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1786015716.013497:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304509952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015716.013530:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304509952:12345-0@lo:400:kworker.0 Request processed in 34us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015716.013535:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00080000:3.0:1786015716.013547:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015716.013665:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304509568:0@lo:400:kworker.0 00000100:00100000:2.0:1786015716.013715:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015716.013746:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304510080:0@lo:400:kworker.0 00000100:00100000:2.0:1786015716.014010:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015716.014034:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786015716.014039:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304509696:0@lo:400:kworker.0 00000100:00100000:2.0:1786015716.014061:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015716.014077:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304510208:0@lo:400:kworker.0 00000100:00100000:2.0:1786015716.014099:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015716.014126:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304509568 00000100:00100000:2.0:1786015716.014130:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304509568 00000100:00100000:2.0:1786015716.014158:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:2.0:1786015716.014164:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304509568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015716.014201:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304509568:12345-0@lo:400:kworker.0 Request processed in 37us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015716.014206:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:2.0:1786015716.014249:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304510080 00000100:00100000:2.0:1786015716.014253:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304510080 00000100:00100000:2.0:1786015716.014286:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304509696 00000100:00100000:2.0:1786015716.014289:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304509696 00000100:00100000:2.0:1786015716.014310:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:2.0:1786015716.014317:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304510080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015716.014350:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304510080:12345-0@lo:400:kworker.0 Request processed in 34us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015716.014356:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:2.0:1786015716.014380:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:2.0:1786015716.014388:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304509696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015716.014415:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304509696:12345-0@lo:400:kworker.0 Request processed in 29us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015716.014420:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:2.0:1786015716.014441:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304510208 00000100:00100000:2.0:1786015716.014444:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304510208 00000100:00100000:2.0:1786015716.014472:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:2.0:1786015716.014479:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304510208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015716.014510:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304510208:12345-0@lo:400:kworker.0 Request processed in 32us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015716.014515:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00080000:3.0:1786015716.014683:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015716.014969:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304509952:0@lo:400:kworker.0 00000100:00080000:3.0:1786015716.015161:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015716.016432:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304509696:0@lo:400:kworker.0 00000100:00100000:2.0:1786015716.016472:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304510208:0@lo:400:kworker.0 00000100:00100000:2.0:1786015716.016484:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304509568:0@lo:400:kworker.0 00000100:00100000:2.0:1786015716.016497:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304510080:0@lo:400:kworker.0 00010000:00010000:2.0:1786015716.207301:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015716.524118:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786015716.524153:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304510336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015716.524253:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015716.524390:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304510336 00000100:00100000:1.0:1786015716.524403:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304510336 00000100:00100000:1.0:1786015716.524479:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1786015716.524491:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304510336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015716.524552:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015716.524626:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304510336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015716.524635:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1786015716.524699:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304510336:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786015717.232593:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015717.499089:0:25990:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015717.499102:0:25990:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015717.502224:0:25990:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015717.502246:0:25990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1786015717.745020:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015717.745031:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015717.747232:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015717.747255:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015718.254541:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015718.980391:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015718.980449:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015718.980475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015718.980494:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015718.980510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015718.980549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015718.980568:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015718.980613:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280759552 00000100:00100000:1.0:1786015718.980626:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280759552 00000100:00100000:1.0:1786015718.980684:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280759168 00000100:00100000:1.0:1786015718.980688:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280759168 00000100:00100000:1.0:1786015718.980712:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 704 00000100:00100000:1.0:1786015718.980722:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2354:x1872772280759552:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015718.980826:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2354:x1872772280759552:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 105us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015718.980834:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 704 00000100:00100000:1.0:1786015718.980853:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 705 00000100:00100000:1.0:1786015718.980860:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+108:2354:x1872772280759168:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015718.980885:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+108:2354:x1872772280759168:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015718.980891:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 705 00000100:00100000:1.0:1786015718.980917:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280759296 00000100:00100000:1.0:1786015718.980920:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280759296 00000100:00100000:3.0:1786015718.981163:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280759040 00000100:00100000:3.0:1786015718.981169:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280759040 00000100:00100000:3.0:1786015718.981201:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 700 00000100:00100000:3.0:1786015718.981208:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280759040:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015718.981236:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280759040:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015718.981242:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 700 00000100:00100000:3.0:1786015718.981272:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280759424 00000100:00100000:3.0:1786015718.981288:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280759424 00000100:00100000:3.0:1786015718.981314:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280759680 00000100:00100000:3.0:1786015718.981318:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280759680 00000100:00100000:3.0:1786015718.981335:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 741 00000100:00100000:3.0:1786015718.981351:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280759296:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015718.981377:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280759296:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015718.981383:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 741 00000100:00100000:3.0:1786015718.981395:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 742 00000100:00100000:3.0:1786015718.981401:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280759424:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015718.981424:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280759424:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015718.981430:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 742 00000100:00100000:3.0:1786015718.981441:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 743 00000100:00100000:3.0:1786015718.981446:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280759680:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015718.981466:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280759680:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 19us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015718.981471:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 743 00000100:00080000:3.0:1786015718.981494:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015718.981499:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786015718.981502:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015718.982147:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280759808 00000100:00100000:1.0:1786015718.982156:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280759808 00000100:00100000:1.0:1786015718.982204:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 744 00000100:00100000:1.0:1786015718.982213:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280759808:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015718.982262:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280759808:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 50us (1766us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015718.982268:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 744 00000100:00080000:3.0:1786015718.983068:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786015719.290972:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015719.596164:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015719.596197:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304510464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015719.596304:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015719.596619:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304510464 00000100:00100000:0.0:1786015719.596628:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304510464 00000100:00100000:0.0:1786015719.596705:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1786015719.596715:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304510464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015719.596757:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015719.596845:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304510464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015719.596852:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1786015719.596912:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304510464:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786015719.597147:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1786015719.800128:0:26041:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015719.800138:0:26041:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015719.803261:0:26041:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015719.804988:0:26041:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786015720.300051:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015721.135621:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304510848:0@lo:400:kworker.0 00000100:00100000:0.0:1786015721.135706:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015721.135794:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015721.135802:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304510976:0@lo:400:kworker.0 00000100:00100000:0.0:1786015721.135834:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015721.135871:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304510848 00000100:00100000:0.0:1786015721.135880:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304510848 00000100:00100000:0.0:1786015721.135946:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:0.0:1786015721.135957:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304510848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015721.136020:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304510848:12345-0@lo:400:kworker.0 Request processed in 66us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015721.136029:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:0.0:1786015721.136078:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304510976 00000100:00100000:0.0:1786015721.136082:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304510976 00000100:00100000:0.0:1786015721.136113:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:0.0:1786015721.136120:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304510976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015721.136154:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304510976:12345-0@lo:400:kworker.0 Request processed in 35us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015721.136161:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00080000:0.0:1786015721.136177:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015721.136183:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015721.136216:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304510976:0@lo:400:kworker.0 00000100:00100000:0.0:1786015721.136228:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304510848:0@lo:400:kworker.0 00000100:00100000:0.0:1786015721.137668:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304510720:0@lo:400:kworker.0 00000100:00100000:0.0:1786015721.137725:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015721.137777:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304511232:0@lo:400:kworker.0 00000100:00100000:0.0:1786015721.137804:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015721.137828:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1786015721.137835:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304510592:0@lo:400:kworker.0 00000100:00100000:0.0:1786015721.137864:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015721.137895:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304511104:0@lo:400:kworker.0 00000100:00100000:0.0:1786015721.137916:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015721.137949:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304510720 00000100:00100000:0.0:1786015721.137957:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304510720 00000100:00100000:0.0:1786015721.137993:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304511104 00000100:00100000:0.0:1786015721.137996:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304511104 00000100:00100000:0.0:1786015721.138026:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1786015721.138475:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304510592 00000100:00100000:2.0:1786015721.138481:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304510592 00000100:00100000:2.0:1786015721.138522:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:2.0:1786015721.138529:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304510592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015721.138606:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304510592:12345-0@lo:400:kworker.0 Request processed in 77us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015721.138614:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:2.0:1786015721.138681:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304510592:0@lo:400:kworker.0 00000100:00100000:2.0:1786015721.138730:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1786015721.138739:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304511104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015721.138797:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304511104:12345-0@lo:400:kworker.0 Request processed in 59us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015721.138804:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1786015721.138830:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304511232 00000100:00100000:2.0:1786015721.138834:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304511232 00000100:00100000:2.0:1786015721.138864:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:2.0:1786015721.138871:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304511232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015721.138903:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304511232:12345-0@lo:400:kworker.0 Request processed in 32us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015721.138909:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00080000:2.0:1786015721.138927:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015721.138931:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015721.138950:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304511104:0@lo:400:kworker.0 00000100:00100000:2.0:1786015721.138960:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304511232:0@lo:400:kworker.0 00000100:00100000:0.0:1786015721.140832:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304510720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015721.140956:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304510720:12345-0@lo:400:kworker.0 Request processed in 2922us (3229us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015721.140966:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1786015721.143099:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304510720:0@lo:400:kworker.0 00010000:00010000:3.0:1786015721.323964:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015721.644018:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786015721.644047:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304511360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015721.644148:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015721.644365:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304511360 00000100:00100000:1.0:1786015721.644378:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304511360 00000100:00100000:1.0:1786015721.644446:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1786015721.644456:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304511360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015721.644507:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015721.644565:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304511360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015721.644574:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1786015721.644814:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304511360:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1786015721.820246:0:26093:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015721.820257:0:26093:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015721.823436:0:26093:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015721.823474:0:26093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015722.349605:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015723.372087:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015724.059309:0:26145:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015724.059322:0:26145:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015724.060862:0:26145:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015724.060883:0:26145:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015724.110559:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015724.110613:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015724.110641:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015724.110663:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015724.110680:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015724.110697:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015724.110724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015724.110755:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280759936 00000100:00100000:3.0:1786015724.110784:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280759936 00000100:00100000:3.0:1786015724.110838:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 702 00000100:00100000:3.0:1786015724.110848:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b03a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280759936:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015724.110922:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b03a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280759936:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 75us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015724.110929:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 702 00000100:00100000:3.0:1786015724.110965:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280760192 00000100:00100000:3.0:1786015724.110968:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280760192 00000100:00100000:3.0:1786015724.111005:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280760704 00000100:00100000:3.0:1786015724.111008:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280760704 00000100:00100000:3.0:1786015724.111025:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280760320 00000100:00100000:3.0:1786015724.111028:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280760320 00000100:00100000:3.0:1786015724.111041:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280760576 00000100:00100000:3.0:1786015724.111044:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280760576 00000100:00100000:3.0:1786015724.111058:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 747 00000100:00100000:3.0:1786015724.111063:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280760192:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015724.111091:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280760192:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015724.111098:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 747 00000100:00100000:3.0:1786015724.111111:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 748 00000100:00100000:3.0:1786015724.111116:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280760704:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015724.111139:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280760704:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015724.111144:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 748 00000100:00100000:3.0:1786015724.111155:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 749 00000100:00100000:3.0:1786015724.111160:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2351:x1872772280760320:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015724.111182:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2351:x1872772280760320:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015724.111188:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 749 00000100:00100000:3.0:1786015724.111197:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 750 00000100:00100000:3.0:1786015724.111203:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280760576:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015724.111225:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280760576:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015724.111231:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 750 00000100:00100000:3.0:1786015724.111249:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280760448 00000100:00100000:3.0:1786015724.111254:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280760448 00000100:00100000:3.0:1786015724.111283:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280760064 00000100:00100000:3.0:1786015724.111286:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280760064 00000100:00100000:3.0:1786015724.111320:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 709 00000100:00100000:3.0:1786015724.111327:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2351:x1872772280760448:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015724.111367:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2351:x1872772280760448:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 40us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015724.111374:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 709 00000100:00100000:3.0:1786015724.111386:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 710 00000100:00100000:3.0:1786015724.111393:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+108:2351:x1872772280760064:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015724.111416:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+108:2351:x1872772280760064:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015724.111423:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 710 00000100:00080000:3.0:1786015724.111609:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015724.111615:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015724.111618:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786015724.397092:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015724.720087:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015724.720221:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304511488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015724.720337:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015724.720544:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304511488 00000100:00100000:1.0:1786015724.720553:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304511488 00000100:00100000:1.0:1786015724.720624:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1786015724.720634:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304511488:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786015724.721441:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1786015724.721848:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015724.722114:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304511488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1479us (1773us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015724.722123:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1786015724.722250:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304511488:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786015725.430498:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015726.243729:0:26196:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015726.243741:0:26196:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015726.245935:0:26196:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015726.245956:0:26196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015726.253008:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304511616:0@lo:400:kworker.0 00000100:00100000:2.0:1786015726.253087:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015726.253237:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304511616 00000100:00100000:0.0:1786015726.253246:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304511616 00000100:00100000:0.0:1786015726.253314:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1786015726.253326:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aa9f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304511616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015726.253794:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304512000:0@lo:400:kworker.0 00000100:00100000:3.0:1786015726.253830:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015726.253862:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786015726.253869:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304511872:0@lo:400:kworker.0 00000100:00100000:3.0:1786015726.253896:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015726.253928:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304512000 00000100:00100000:3.0:1786015726.253932:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304512000 00000100:00100000:3.0:1786015726.253976:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1786015726.253984:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304512000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015726.254024:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304512000:12345-0@lo:400:kworker.0 Request processed in 41us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015726.254031:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1786015726.254054:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304511872 00000100:00100000:3.0:1786015726.254057:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304511872 00000100:00100000:3.0:1786015726.254085:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:3.0:1786015726.254092:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304511872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015726.254124:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304511872:12345-0@lo:400:kworker.0 Request processed in 32us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015726.254129:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00080000:3.0:1786015726.254147:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015726.254152:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015726.254289:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aa9f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304511616:12345-0@lo:400:kworker.0 Request processed in 964us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015726.254296:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1786015726.255316:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304511872:0@lo:400:kworker.0 00000100:00100000:3.0:1786015726.255345:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304512000:0@lo:400:kworker.0 00000100:00100000:1.0:1786015726.256869:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304511744:0@lo:400:kworker.0 00000100:00100000:1.0:1786015726.256952:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015726.256993:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304512256:0@lo:400:kworker.0 00000100:00100000:1.0:1786015726.257019:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015726.257049:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786015726.257055:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304512128:0@lo:400:kworker.0 00000100:00100000:1.0:1786015726.257078:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015726.257116:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304512256 00000100:00100000:1.0:1786015726.257126:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304512256 00000100:00100000:1.0:1786015726.257209:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:1.0:1786015726.257219:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304512256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015726.257295:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304512256:12345-0@lo:400:kworker.0 Request processed in 77us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015726.257303:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:1.0:1786015726.257326:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304511744 00000100:00100000:1.0:1786015726.257330:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304511744 00000100:00100000:1.0:1786015726.257353:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304512128 00000100:00100000:1.0:1786015726.257368:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304512128 00000100:00100000:1.0:1786015726.257392:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1786015726.257398:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304511744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015726.257429:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304511744:12345-0@lo:400:kworker.0 Request processed in 32us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015726.257439:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1786015726.257462:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:1.0:1786015726.257468:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304512128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015726.257497:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304512128:12345-0@lo:400:kworker.0 Request processed in 29us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015726.257504:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00080000:1.0:1786015726.257526:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015726.257530:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015726.257559:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304512128:0@lo:400:kworker.0 00000100:00100000:1.0:1786015726.257571:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304511744:0@lo:400:kworker.0 00000100:00100000:1.0:1786015726.257579:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74aef00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304512256:0@lo:400:kworker.0 00000100:00100000:2.0:1786015726.260807:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304511616:0@lo:400:kworker.0 00010000:00010000:3.0:1786015726.444925:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015726.766195:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786015726.766220:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304512384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015726.766308:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015726.766503:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304512384 00000100:00100000:1.0:1786015726.766512:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304512384 00000100:00100000:1.0:1786015726.766569:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1786015726.766579:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304512384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015726.766616:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015726.766892:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304512384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 314us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015726.766901:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1786015726.766951:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304512384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015726.976385:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015726.976555:0:17038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280760832 00000100:00100000:0.0:1786015726.976566:0:17038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280760832 00000100:00100000:0.0:1786015726.976655:0:17038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 85 00000100:00100000:0.0:1786015726.976666:0:17038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748821cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+108:2352:x1872772280760832:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786015726.976682:0:17038:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 16 locks, starting at 0 00010000:00010000:0.0:1786015726.976751:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4200/0xb1a5ef690c4fe81f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e789d expref: 108 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015726.976809:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b74a0440100) 00010000:00010000:0.0:1786015726.976826:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4400/0xb1a5ef690c4fe5d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e77f5 expref: 107 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015726.976836:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8b749802ec00) 00010000:00010000:0.0:1786015726.976881:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9200/0xb1a5ef690c4fe547 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e77d2 expref: 106 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015726.976897:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4c00/0xb1a5ef690c4fe436 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x51/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7785 expref: 105 pid: 5796 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015726.976905:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b749802e700) 00010000:00010000:0.0:1786015726.976912:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4a00/0xb1a5ef690c4fe2fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7723 expref: 104 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015726.976921:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff8b749802e500) 00010000:00010000:0.0:1786015726.976929:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5e00/0xb1a5ef690c4fe268 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7700 expref: 103 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015726.976941:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813be600/0xb1a5ef690c4fe126 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e76c1 expref: 102 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015726.976955:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b749802ee00) 00010000:00010000:0.0:1786015726.976963:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5200/0xb1a5ef690c4fe0f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e76b3 expref: 101 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015726.976971:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b749802e900) 00010000:00010000:0.0:1786015726.977001:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73813bfe00/0xb1a5ef690c4fe08c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e769e expref: 100 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015726.977011:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8b7485765800) 00010000:00010000:0.0:1786015726.977022:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e6e00/0xb1a5ef690c4fde4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e75f6 expref: 99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015726.977033:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b74b0022700) 00010000:00010000:0.0:1786015726.977054:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74aa828e00/0xb1a5ef690c4fdce9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e758d expref: 98 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015726.977064:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8b74b0022800) 00010000:00010000:0.0:1786015726.977076:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060600/0xb1a5ef690c4fdbf4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7539 expref: 97 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015726.977085:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8b7482d4be00) 00010000:00010000:0.0:1786015726.977093:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7c00/0xb1a5ef690c4fdac0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e74e5 expref: 96 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015726.977106:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488060e00/0xb1a5ef690c4fda26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e74c9 expref: 95 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015726.977118:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7488061600/0xb1a5ef690c4fd938 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7498 expref: 94 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015726.977127:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b7485765b00) 00010000:00010000:0.0:1786015726.977148:0:17038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74813a0400/0xb1a5ef690c4fd907 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e748a expref: 93 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786015726.977158:0:17038:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b749802eb00) 00010000:00010000:0.0:1786015726.977164:0:17038:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786015726.977236:0:17038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748821cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41677fca-39fb-471c-b582-96bce6540a36+92:2352:x1872772280760832:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 573us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015726.977244:0:17038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 85 00000100:00080000:1.0:1786015726.978164:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786015727.468049:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015727.980141:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015727.980152:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015727.980714:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015727.980725:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015728.494347:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015728.578731:0:26247:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015728.578742:0:26247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015728.579621:0:26247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015728.579634:0:26247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015729.215207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015729.215266:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015729.215296:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280760960 00000100:00100000:0.0:1786015729.215299:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015729.215308:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280760960 00000100:00100000:0.0:1786015729.215338:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015729.215359:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015729.215363:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 704 00000100:00100000:3.0:1786015729.215375:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280760960:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015729.215377:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015729.215400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015729.215457:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280760960:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 84us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015729.215460:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280761216 00000100:00100000:0.0:1786015729.215463:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280761216 00000100:00100000:3.0:1786015729.215464:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 704 00000100:00100000:0.0:1786015729.215493:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280761728 00000100:00100000:3.0:1786015729.215497:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280761344 00000100:00100000:0.0:1786015729.215497:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280761728 00000100:00100000:3.0:1786015729.215500:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280761344 00000100:00100000:0.0:1786015729.215513:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280761600 00000100:00100000:0.0:1786015729.215515:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280761600 00000100:00100000:3.0:1786015729.215516:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 753 00000100:00100000:3.0:1786015729.215522:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280761216:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015729.215529:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 754 00000100:00100000:0.0:1786015729.215545:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280761728:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015729.215550:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280761216:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015729.215556:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 753 00000100:00100000:3.0:1786015729.215569:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 755 00000100:00100000:0.0:1786015729.215569:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280761728:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 35us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015729.215574:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2351:x1872772280761344:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015729.215577:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 754 00000100:00100000:3.0:1786015729.215595:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2351:x1872772280761344:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015729.215599:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 756 00000100:00100000:3.0:1786015729.215602:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 755 00000100:00100000:0.0:1786015729.215604:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280761600:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015729.215629:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280761600:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015729.215635:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 756 00000100:00100000:1.0:1786015729.216142:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280761472 00000100:00100000:1.0:1786015729.216148:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280761472 00000100:00100000:1.0:1786015729.216193:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280761088 00000100:00100000:1.0:1786015729.216196:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280761088 00000100:00100000:1.0:1786015729.216226:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 714 00000100:00100000:1.0:1786015729.216234:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2351:x1872772280761472:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015729.216286:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2351:x1872772280761472:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 53us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015729.216293:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 714 00000100:00100000:1.0:1786015729.216318:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 715 00000100:00100000:1.0:1786015729.216325:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+92:2351:x1872772280761088:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015729.216351:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+92:2351:x1872772280761088:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015729.216357:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 715 00000100:00080000:1.0:1786015729.216375:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015729.216380:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015729.216382:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786015729.516325:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015729.836940:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304512512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015729.837027:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015729.837125:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304512512 00000100:00100000:0.0:1786015729.837132:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304512512 00000100:00100000:0.0:1786015729.837190:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1786015729.837199:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304512512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015729.837249:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015729.837303:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304512512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015729.837311:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:0.0:1786015729.837348:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015729.837383:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304512512:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786015730.540316:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015730.810448:0:26299:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015730.810460:0:26299:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015730.812310:0:26299:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015730.812331:0:26299:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015731.373461:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304512896:0@lo:400:kworker.0 00000100:00100000:0.0:1786015731.373563:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015731.373648:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786015731.373655:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304513024:0@lo:400:kworker.0 00000100:00100000:0.0:1786015731.373683:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015731.374500:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304512640:0@lo:400:kworker.0 00000100:00100000:2.0:1786015731.374568:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015731.374607:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7488259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304513152:0@lo:400:kworker.0 00000100:00100000:2.0:1786015731.374633:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015731.374656:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786015731.374663:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304512768:0@lo:400:kworker.0 00000100:00100000:2.0:1786015731.374686:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015731.374702:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b748825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304513280:0@lo:400:kworker.0 00000100:00100000:2.0:1786015731.374723:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015731.374872:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304512640 00000100:00100000:0.0:1786015731.374881:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304512640 00000100:00100000:0.0:1786015731.374937:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:0.0:1786015731.374945:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304512640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015731.375003:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304512640:12345-0@lo:400:kworker.0 Request processed in 59us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015731.375011:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:3.0:1786015731.375112:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304513024 00000100:00100000:3.0:1786015731.375118:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304513024 00000100:00100000:3.0:1786015731.375165:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304513280 00000100:00100000:3.0:1786015731.375169:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304513280 00000100:00100000:3.0:1786015731.375191:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:3.0:1786015731.375198:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304513024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015731.375244:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304512896 00000100:00100000:1.0:1786015731.375250:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304512896 00000100:00100000:3.0:1786015731.375264:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304513024:12345-0@lo:400:kworker.0 Request processed in 65us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015731.375273:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:1.0:1786015731.375294:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304513152 00000100:00100000:1.0:1786015731.375298:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304513152 00000100:00100000:3.0:1786015731.375301:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:3.0:1786015731.375311:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304513280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015731.375324:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304512768 00000100:00100000:1.0:1786015731.375329:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304512768 00000100:00100000:3.0:1786015731.375348:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304513280:12345-0@lo:400:kworker.0 Request processed in 38us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015731.375353:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:3.0:1786015731.375364:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:1.0:1786015731.375368:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304512896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015731.375418:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304513024:0@lo:400:kworker.0 00000100:00100000:3.0:1786015731.375435:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304512896:0@lo:400:kworker.0 00000100:00100000:1.0:1786015731.375435:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304512896:12345-0@lo:400:kworker.0 Request processed in 70us (1870us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015731.375459:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1786015731.375476:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1786015731.375483:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304513152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015731.375504:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1786015731.375515:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304512768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015731.375521:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304513152:12345-0@lo:400:kworker.0 Request processed in 37us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015731.375528:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00080000:0.0:1786015731.375738:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015731.375744:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015731.375747:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015731.376016:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304512768:12345-0@lo:400:kworker.0 Request processed in 503us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015731.376022:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:2.0:1786015731.376180:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304512768:0@lo:400:kworker.0 00000100:00100000:2.0:1786015731.376192:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b748825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304513280:0@lo:400:kworker.0 00000100:00100000:2.0:1786015731.376201:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304512640:0@lo:400:kworker.0 00000100:00100000:2.0:1786015731.376210:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7488259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304513152:0@lo:400:kworker.0 00010000:00010000:1.0:1786015731.564062:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015731.884231:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786015731.884256:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7488258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304513408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015731.884344:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015731.884791:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304513408 00000100:00100000:1.0:1786015731.884801:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304513408 00000100:00100000:1.0:1786015731.884858:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1786015731.884868:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304513408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015731.884909:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015731.884972:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304513408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015731.884980:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1786015731.885351:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7488258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304513408:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786015732.600014:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015732.926664:0:26350:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015732.926674:0:26350:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015732.930358:0:26350:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015732.930379:0:26350:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786015733.611944:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015734.172431:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015734.172539:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280761856 00000100:00100000:2.0:1786015734.172562:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280761856 00000100:00100000:2.0:1786015734.172668:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 86 00000100:00100000:2.0:1786015734.172686:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+53:2354:x1872772280761856:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786015734.172705:0:6607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 16 locks, starting at 0 00000100:00080000:1.0:1786015734.174286:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786015734.182614:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73819bb400/0xb1a5ef690c4ffa63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7dc1 expref: 53 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015734.182649:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8b74b0022400) 00010000:00010000:2.0:1786015734.182661:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b7381934000/0xb1a5ef690c4ff8d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d3c expref: 52 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015734.182672:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8b7482d4b900) 00010000:00010000:2.0:1786015734.182681:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b5a00/0xb1a5ef690c4ff864 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7d19 expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015734.182693:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8b74b0022100) 00010000:00010000:2.0:1786015734.182701:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74c2179e00/0xb1a5ef690c4ff706 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ca2 expref: 50 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015734.182711:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff8b74b0022a00) 00010000:00010000:2.0:1786015734.182719:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73830a1800/0xb1a5ef690c4ff696 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c7f expref: 49 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015734.182729:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8b74938ba800) 00010000:00010000:2.0:1786015734.182737:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4600/0xb1a5ef690c4ff570 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c1d expref: 48 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015734.182745:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8b749802ef00) 00010000:00010000:2.0:1786015734.182753:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4000/0xb1a5ef690c4ff52a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7c08 expref: 47 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015734.182807:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8b749802e200) 00010000:00010000:2.0:1786015734.182816:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f8400/0xb1a5ef690c4fee0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x16:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7a1e expref: 46 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015734.182826:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x16:0x0].0x0 (ffff8b7482d4ba00) 00010000:00010000:2.0:1786015734.182835:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f8800/0xb1a5ef690c4feb60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7961 expref: 45 pid: 5796 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015734.182844:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8b74b0022e00) 00010000:00010000:2.0:1786015734.182852:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f8e00/0xb1a5ef690c4feb83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x12:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7968 expref: 44 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015734.182861:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff8b7485765a00) 00010000:00010000:2.0:1786015734.182868:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386b800/0xb1a5ef690c4fe74d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e785e expref: 43 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015734.182878:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8b749802ec00) 00010000:00010000:2.0:1786015734.182912:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7400/0xb1a5ef690c4fe46e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x51/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e778c expref: 42 pid: 5795 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015734.182922:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b749802e700) 00010000:00010000:2.0:1786015734.182942:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf3b4800/0xb1a5ef690c4fe491 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7793 expref: 41 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015734.182958:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff8b749802e500) 00010000:00010000:2.0:1786015734.182969:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74aa828200/0xb1a5ef690c4fdfc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e765f expref: 40 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015734.182978:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b74b0022700) 00010000:00010000:2.0:1786015734.182989:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74813a1e00/0xb1a5ef690c4fdbb5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e752b expref: 39 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015734.182999:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b749802e100) 00010000:00010000:2.0:1786015734.183010:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74aa828400/0xb1a5ef690c4fdb8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e751d expref: 38 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786015734.183019:0:6607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8b7482d4be00) 00010000:00010000:2.0:1786015734.183025:0:6607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786015734.183111:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2354:x1872772280761856:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 10432us (10690us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015734.183122:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 86 00000100:00100000:0.0:1786015734.353386:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015734.353425:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015734.353457:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015734.353481:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015734.353499:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015734.353519:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015734.353694:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280762368 00000100:00100000:2.0:1786015734.353705:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280762368 00000100:00100000:2.0:1786015734.353777:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280762624 00000100:00100000:2.0:1786015734.353781:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280762624 00000100:00100000:2.0:1786015734.353800:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280762240 00000100:00100000:2.0:1786015734.353803:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280762240 00000100:00100000:2.0:1786015734.353814:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280762496 00000100:00100000:2.0:1786015734.353816:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280762496 00000100:00100000:2.0:1786015734.353832:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 759 00000100:00100000:2.0:1786015734.353842:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+18:2351:x1872772280762368:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015734.353937:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+18:2351:x1872772280762368:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 97us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015734.353945:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 759 00000100:00100000:2.0:1786015734.353961:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 760 00000100:00100000:2.0:1786015734.353967:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280762624:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015734.353990:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280762624:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015734.353995:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 760 00000100:00100000:2.0:1786015734.354007:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 761 00000100:00100000:2.0:1786015734.354013:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280762240:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015734.354033:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280762240:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015734.354038:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 761 00000100:00100000:2.0:1786015734.354048:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 762 00000100:00100000:2.0:1786015734.354053:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280762496:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015734.354072:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280762496:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 19us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015734.354077:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 762 00000100:00100000:3.0:1786015734.354561:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280761984 00000100:00100000:3.0:1786015734.354568:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280761984 00000100:00100000:3.0:1786015734.354612:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 706 00000100:00100000:3.0:1786015734.354620:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280761984:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015734.354659:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280761984:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 39us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015734.354666:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 706 00000100:00080000:0.0:1786015734.355007:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015734.355013:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015734.355365:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280762112 00000100:00100000:1.0:1786015734.355379:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280762112 00000100:00100000:1.0:1786015734.355502:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 719 00000100:00100000:1.0:1786015734.355511:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+92:2351:x1872772280762112:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015734.356125:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+92:2351:x1872772280762112:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 613us (2757us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015734.356134:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 719 00000100:00080000:0.0:1786015734.357298:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786015734.636282:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015734.958093:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786015734.958119:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304513536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015734.958234:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015734.958471:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304513536 00000100:00100000:2.0:1786015734.958481:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304513536 00000100:00100000:2.0:1786015734.958549:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1786015734.958559:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304513536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015734.958596:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015734.959818:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304513536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1251us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015734.959831:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00080000:2.0:1786015734.959865:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015734.959930:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304513536:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1786015735.232009:0:26401:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015735.232020:0:26401:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015735.232543:0:26401:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015735.232561:0:26401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015735.661483:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015736.503683:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304513920:0@lo:400:kworker.0 00000100:00100000:3.0:1786015736.503782:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015736.503858:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015736.503865:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304514048:0@lo:400:kworker.0 00000100:00100000:3.0:1786015736.503895:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015736.503936:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304513920 00000100:00100000:3.0:1786015736.503944:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304513920 00000100:00100000:3.0:1786015736.504006:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:3.0:1786015736.504017:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304513920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015736.504099:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304513920:12345-0@lo:400:kworker.0 Request processed in 84us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015736.504107:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:3.0:1786015736.504134:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304514048 00000100:00100000:3.0:1786015736.504138:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304514048 00000100:00100000:3.0:1786015736.504167:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1786015736.504186:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304514048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015736.504219:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304514048:12345-0@lo:400:kworker.0 Request processed in 35us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015736.504225:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00080000:3.0:1786015736.504241:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786015736.504246:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015736.504290:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304514048:0@lo:400:kworker.0 00000100:00100000:3.0:1786015736.504304:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304513920:0@lo:400:kworker.0 00000100:00100000:2.0:1786015736.504549:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304513664:0@lo:400:kworker.0 00000100:00100000:2.0:1786015736.504588:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015736.504614:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304514176:0@lo:400:kworker.0 00000100:00100000:2.0:1786015736.504638:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015736.504668:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786015736.504674:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304513792:0@lo:400:kworker.0 00000100:00100000:2.0:1786015736.504699:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015736.504714:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304514304:0@lo:400:kworker.0 00000100:00100000:2.0:1786015736.504735:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015736.504924:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304514176 00000100:00100000:1.0:1786015736.504930:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304514176 00000100:00100000:1.0:1786015736.504983:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304513792 00000100:00100000:1.0:1786015736.504987:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304513792 00000100:00100000:1.0:1786015736.505003:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:1.0:1786015736.505010:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304514176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015736.505067:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304514176:12345-0@lo:400:kworker.0 Request processed in 57us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015736.505074:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:1.0:1786015736.505088:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:1.0:1786015736.505094:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304513792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015736.505121:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304513792:12345-0@lo:400:kworker.0 Request processed in 27us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015736.505126:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:1.0:1786015736.505158:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304513792:0@lo:400:kworker.0 00000100:00100000:1.0:1786015736.505168:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304514176:0@lo:400:kworker.0 00000100:00080000:2.0:1786015736.505658:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015736.505797:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304513664 00000100:00100000:3.0:1786015736.505804:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304513664 00000100:00100000:3.0:1786015736.505845:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:3.0:1786015736.505852:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304513664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015736.505910:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304513664:12345-0@lo:400:kworker.0 Request processed in 59us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015736.505916:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:3.0:1786015736.505950:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304514304 00000100:00100000:3.0:1786015736.505954:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304514304 00000100:00100000:3.0:1786015736.505983:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:3.0:1786015736.505989:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304514304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015736.506019:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304514304:12345-0@lo:400:kworker.0 Request processed in 31us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015736.506024:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00080000:3.0:1786015736.506053:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015736.507237:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304514304:0@lo:400:kworker.0 00000100:00100000:1.0:1786015736.507252:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304513664:0@lo:400:kworker.0 00010000:00010000:1.0:1786015736.685267:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015737.008598:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786015737.008625:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304514432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786015737.008699:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015737.008780:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304514432 00000100:00100000:0.0:1786015737.008790:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304514432 00000100:00100000:0.0:1786015737.008845:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1786015737.008855:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304514432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015737.008890:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015737.008936:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304514432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015737.008942:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1786015737.008993:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304514432:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1786015737.198579:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015737.198588:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015737.201206:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015737.201228:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1786015737.202295:0:26453:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015737.202303:0:26453:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015737.203450:0:26453:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015737.203467:0:26453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786015737.707951:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786015738.733919:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015739.233446:0:26504:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015739.233457:0:26504:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015739.237560:0:26504:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015739.237594:0:26504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015739.454735:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015739.454802:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280762752 00000100:00100000:2.0:1786015739.454812:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015739.454815:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280762752 00000100:00100000:2.0:1786015739.454841:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015739.454870:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015739.454870:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 708 00000100:00100000:0.0:1786015739.454879:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280762752:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015739.454962:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280763264 00000100:00100000:1.0:1786015739.454967:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280763264 00000100:00100000:0.0:1786015739.454970:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280762752:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 92us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015739.454978:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 708 00000100:00100000:1.0:1786015739.455050:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 723 00000100:00100000:1.0:1786015739.455058:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2354:x1872772280763264:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015739.455091:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2354:x1872772280763264:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 35us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015739.455098:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 723 00000100:00100000:0.0:1786015739.456520:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015739.456549:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015739.456583:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015739.456651:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280763008 00000100:00100000:2.0:1786015739.456659:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280763008 00000100:00100000:2.0:1786015739.456715:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280763520 00000100:00100000:2.0:1786015739.456719:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280763520 00000100:00100000:2.0:1786015739.456738:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280763136 00000100:00100000:2.0:1786015739.456741:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280763136 00000100:00100000:2.0:1786015739.456756:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280763392 00000100:00100000:2.0:1786015739.456776:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280763392 00000100:00100000:2.0:1786015739.456795:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 765 00000100:00100000:2.0:1786015739.456803:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280763008:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015739.456825:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280762880 00000100:00100000:1.0:1786015739.456830:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280762880 00000100:00100000:2.0:1786015739.456862:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280763008:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 59us (2049us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015739.456863:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 724 00000100:00100000:2.0:1786015739.456869:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 765 00000100:00100000:1.0:1786015739.456870:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+92:2353:x1872772280762880:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015739.456883:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 766 00000100:00100000:2.0:1786015739.456889:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280763520:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015739.456896:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+92:2353:x1872772280762880:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015739.456902:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 724 00000100:00100000:2.0:1786015739.456908:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280763520:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015739.456913:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 766 00000100:00100000:2.0:1786015739.456923:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 767 00000100:00100000:2.0:1786015739.456929:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280763136:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015739.456965:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280763136:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 37us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015739.456975:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 767 00000100:00100000:2.0:1786015739.456988:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 768 00000100:00100000:2.0:1786015739.456995:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280763392:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015739.457019:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280763392:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015739.457025:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 768 00000100:00080000:3.0:1786015739.457291:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015739.457296:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786015739.457299:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786015739.758329:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015740.076204:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304514560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015740.076289:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015740.076646:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304514560 00000100:00100000:2.0:1786015740.076655:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304514560 00000100:00100000:2.0:1786015740.076730:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1786015740.076750:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304514560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015740.076805:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015740.076949:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304514560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 209us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015740.076957:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:1.0:1786015740.077019:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015740.077067:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304514560:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786015740.781647:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015741.233636:0:26555:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015741.233644:0:26555:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015741.234168:0:26555:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015741.234179:0:26555:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786015741.612263:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7488259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304514944:0@lo:400:kworker.0 00000100:00100000:0.0:1786015741.612337:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015741.612731:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b748825a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304514816:0@lo:400:kworker.0 00000100:00100000:3.0:1786015741.612780:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015741.612887:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7488259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304514688:0@lo:400:kworker.0 00000100:00100000:2.0:1786015741.612926:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015741.612977:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304514688 00000100:00100000:2.0:1786015741.612986:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304514688 00000100:00100000:2.0:1786015741.613031:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:2.0:1786015741.613053:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304514688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015741.613101:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304514688:12345-0@lo:400:kworker.0 Request processed in 62us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015741.613108:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:2.0:1786015741.613166:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7488259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304514688:0@lo:400:kworker.0 00000100:00100000:1.0:1786015741.614014:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b748825aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304515200:0@lo:400:kworker.0 00000100:00100000:0.0:1786015741.614305:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7488258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304515072:0@lo:400:kworker.0 00000100:00100000:0.0:1786015741.614346:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015741.614386:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304515072 00000100:00100000:0.0:1786015741.614391:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304515072 00000100:00100000:0.0:1786015741.614432:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:0.0:1786015741.614440:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304515072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015741.614640:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304515072:12345-0@lo:400:kworker.0 Request processed in 199us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015741.614648:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:0.0:1786015741.614684:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7488258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304515072:0@lo:400:kworker.0 00000100:00100000:1.0:1786015741.615219:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015741.620537:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786015741.620559:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b748825b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304515328:0@lo:400:kworker.0 00000100:00100000:1.0:1786015741.620618:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015741.620678:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304515328 00000100:00100000:1.0:1786015741.620686:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304515328 00000100:00100000:1.0:1786015741.620745:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:1.0:1786015741.620754:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304515328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015741.620842:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304515328:12345-0@lo:400:kworker.0 Request processed in 89us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015741.620852:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00080000:1.0:1786015741.621202:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015741.621241:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b748825b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304515328:0@lo:400:kworker.0 00000100:00100000:2.0:1786015741.621393:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304514944 00000100:00100000:2.0:1786015741.621399:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304514944 00000100:00100000:2.0:1786015741.621472:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304514816 00000100:00100000:2.0:1786015741.621476:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304514816 00000100:00100000:2.0:1786015741.621497:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304515200 00000100:00100000:2.0:1786015741.621501:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304515200 00000100:00100000:2.0:1786015741.621516:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1786015741.621524:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304514944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015741.621575:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304514944:12345-0@lo:400:kworker.0 Request processed in 52us (9238us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015741.621581:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1786015741.621595:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1786015741.621600:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304514816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015741.621630:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304514816:12345-0@lo:400:kworker.0 Request processed in 30us (8849us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015741.621635:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1786015741.621646:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:2.0:1786015741.621652:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304515200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015741.621686:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304515200:12345-0@lo:400:kworker.0 Request processed in 33us (6476us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015741.621694:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:2.0:1786015741.621736:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b748825aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304515200:0@lo:400:kworker.0 00000100:00100000:2.0:1786015741.621817:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b748825a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304514816:0@lo:400:kworker.0 00000100:00100000:0.0:1786015741.622589:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7488259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304514944:0@lo:400:kworker.0 00000100:00080000:1.0:1786015741.622671:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786015741.804311:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015742.124150:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786015742.124182:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304515456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015742.124284:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015742.124445:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304515456 00000100:00100000:0.0:1786015742.124465:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304515456 00000100:00100000:0.0:1786015742.124530:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1786015742.124540:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304515456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015742.124596:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015742.124655:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304515456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015742.124662:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1786015742.124712:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304515456:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786015742.832040:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015743.326153:0:26606:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015743.326165:0:26606:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015743.326752:0:26606:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015743.328464:0:26606:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015743.852060:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015744.576368:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015744.576412:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015744.576438:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015744.576470:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015744.576493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015744.576522:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015744.576547:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015744.576575:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280763648 00000100:00100000:0.0:1786015744.576585:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280763648 00000100:00100000:0.0:1786015744.576636:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 710 00000100:00100000:0.0:1786015744.576647:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280763648:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015744.576739:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280763648:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 94us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015744.576748:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 710 00000100:00100000:0.0:1786015744.577205:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280763904 00000100:00100000:0.0:1786015744.577210:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280763904 00000100:00100000:0.0:1786015744.577246:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280764416 00000100:00100000:0.0:1786015744.577249:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280764416 00000100:00100000:0.0:1786015744.577266:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280764032 00000100:00100000:0.0:1786015744.577326:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280764032 00000100:00100000:0.0:1786015744.577348:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280764288 00000100:00100000:0.0:1786015744.577351:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280764288 00000100:00100000:0.0:1786015744.577368:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 771 00000100:00100000:0.0:1786015744.577375:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+17:2352:x1872772280763904:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015744.577412:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+17:2352:x1872772280763904:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 36us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015744.577419:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 771 00000100:00100000:0.0:1786015744.577431:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 772 00000100:00100000:0.0:1786015744.577437:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280764416:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015744.577595:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280764416:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 155us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015744.577602:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 772 00000100:00100000:0.0:1786015744.577615:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 773 00000100:00100000:0.0:1786015744.577621:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+18:2352:x1872772280764032:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015744.577645:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:41677fca-39fb-471c-b582-96bce6540a36+18:2352:x1872772280764032:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015744.577650:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 773 00000100:00100000:0.0:1786015744.578396:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 774 00000100:00100000:0.0:1786015744.578406:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280764288:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015744.578444:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280764288:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015744.578450:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 774 00000100:00100000:0.0:1786015744.578598:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280764160 00000100:00100000:0.0:1786015744.578604:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280764160 00000100:00100000:0.0:1786015744.578649:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280763776 00000100:00100000:0.0:1786015744.578652:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280763776 00000100:00100000:0.0:1786015744.578674:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 728 00000100:00100000:0.0:1786015744.578681:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2352:x1872772280764160:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015744.578712:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2352:x1872772280764160:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (2273us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015744.578719:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 728 00000100:00100000:0.0:1786015744.578732:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 729 00000100:00100000:0.0:1786015744.578738:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+92:2352:x1872772280763776:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015744.578924:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+92:2352:x1872772280763776:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 185us (2429us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015744.578931:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 729 00000100:00080000:0.0:1786015744.580859:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015744.580868:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015744.580872:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786015744.876062:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015745.201544:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304515584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015745.201635:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015745.201717:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304515584 00000100:00100000:0.0:1786015745.201725:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304515584 00000100:00100000:0.0:1786015745.201796:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1786015745.201805:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304515584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015745.201845:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015745.201891:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304515584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015745.201898:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:0.0:1786015745.201920:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015745.201970:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304515584:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1786015745.452055:0:26658:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015745.452066:0:26658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015745.457054:0:26658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015745.457077:0:26658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786015745.904501:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015746.733110:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7488258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304515712:0@lo:400:kworker.0 00000100:00100000:1.0:1786015746.733186:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015746.733244:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b748825a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304516224:0@lo:400:kworker.0 00000100:00100000:1.0:1786015746.733272:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015746.733301:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786015746.733307:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7488259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304515840:0@lo:400:kworker.0 00000100:00100000:1.0:1786015746.733328:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015746.733345:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b748825aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304516352:0@lo:400:kworker.0 00000100:00100000:1.0:1786015746.733365:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015746.733395:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b748825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304515968:0@lo:400:kworker.0 00000100:00100000:1.0:1786015746.733419:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015746.733438:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015746.733444:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7488259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304516096:0@lo:400:kworker.0 00000100:00100000:1.0:1786015746.733463:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015746.733497:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304515712 00000100:00100000:1.0:1786015746.733504:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304515712 00000100:00100000:1.0:1786015746.733550:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1786015746.733557:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304515712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015746.733610:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304515712:12345-0@lo:400:kworker.0 Request processed in 53us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015746.733618:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1786015746.733668:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304516224 00000100:00100000:1.0:1786015746.733672:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304516224 00000100:00100000:1.0:1786015746.733706:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304515840 00000100:00100000:1.0:1786015746.733709:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304515840 00000100:00100000:1.0:1786015746.733725:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304515968 00000100:00100000:1.0:1786015746.733728:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304515968 00000100:00100000:1.0:1786015746.733743:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:1.0:1786015746.733749:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304516224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015746.733806:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304516224:12345-0@lo:400:kworker.0 Request processed in 56us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015746.733812:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:1.0:1786015746.733826:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:1.0:1786015746.733831:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304515840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015746.733856:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304515840:12345-0@lo:400:kworker.0 Request processed in 26us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015746.733862:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:1.0:1786015746.733873:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:1.0:1786015746.733878:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304515968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015746.733906:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304515968:12345-0@lo:400:kworker.0 Request processed in 28us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015746.733912:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:1.0:1786015746.733930:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304516352 00000100:00100000:1.0:1786015746.733934:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304516352 00000100:00100000:1.0:1786015746.733958:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304516096 00000100:00100000:1.0:1786015746.733961:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304516096 00000100:00100000:1.0:1786015746.733981:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:1.0:1786015746.733987:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304516352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015746.734019:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304516352:12345-0@lo:400:kworker.0 Request processed in 32us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015746.734025:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:1.0:1786015746.734037:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:1.0:1786015746.734043:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304516096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015746.734081:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304516096:12345-0@lo:400:kworker.0 Request processed in 28us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015746.734088:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00080000:1.0:1786015746.734115:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015746.734120:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015746.734164:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7488259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304516096:0@lo:400:kworker.0 00000100:00100000:1.0:1786015746.734175:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b748825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304515968:0@lo:400:kworker.0 00000100:00100000:1.0:1786015746.734209:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7488259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304515840:0@lo:400:kworker.0 00000100:00100000:1.0:1786015746.734219:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b748825aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304516352:0@lo:400:kworker.0 00000100:00100000:1.0:1786015746.734226:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7488258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304515712:0@lo:400:kworker.0 00000100:00100000:1.0:1786015746.734235:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b748825a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304516224:0@lo:400:kworker.0 00010000:00010000:3.0:1786015746.931373:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015747.245889:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304516480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015747.245981:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015747.246085:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304516480 00000100:00100000:1.0:1786015747.246096:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304516480 00000100:00100000:1.0:1786015747.246553:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1786015747.246566:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304516480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015747.246612:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015747.246671:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304516480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015747.246679:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1786015747.246741:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304516480:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1786015747.436752:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015747.437021:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015747.439088:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015747.439105:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1786015747.494226:0:26709:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015747.494238:0:26709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015747.495198:0:26709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015747.495212:0:26709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015747.949093:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015748.972546:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015749.591559:0:26760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015749.591568:0:26760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015749.592308:0:26760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015749.592319:0:26760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015749.694345:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015749.694402:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015749.694437:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015749.694464:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015749.694487:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015749.694508:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015749.694533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015749.694562:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280764928 00000100:00100000:1.0:1786015749.694581:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280764928 00000100:00100000:1.0:1786015749.694637:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280764800 00000100:00100000:1.0:1786015749.694640:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280764800 00000100:00100000:1.0:1786015749.694661:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280765184 00000100:00100000:1.0:1786015749.694664:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280765184 00000100:00100000:1.0:1786015749.694677:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280765312 00000100:00100000:1.0:1786015749.694680:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280765312 00000100:00100000:1.0:1786015749.694699:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 777 00000100:00100000:1.0:1786015749.694710:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+18:2352:x1872772280764928:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015749.694808:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+18:2352:x1872772280764928:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 99us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015749.694815:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 777 00000100:00100000:1.0:1786015749.694832:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 778 00000100:00100000:1.0:1786015749.694838:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280764800:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015749.694861:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280764800:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015749.694867:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 778 00000100:00100000:1.0:1786015749.694878:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 779 00000100:00100000:1.0:1786015749.694884:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280765184:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015749.694905:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2352:x1872772280765184:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015749.694911:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 779 00000100:00100000:1.0:1786015749.694922:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 780 00000100:00100000:1.0:1786015749.694929:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280765312:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015749.694951:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2352:x1872772280765312:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015749.694957:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 780 00000100:00100000:1.0:1786015749.694981:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280764672 00000100:00100000:1.0:1786015749.694985:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280764672 00000100:00100000:1.0:1786015749.695009:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280765056 00000100:00100000:1.0:1786015749.695012:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280765056 00000100:00100000:1.0:1786015749.695032:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 733 00000100:00100000:1.0:1786015749.695038:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74c11a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+92:2352:x1872772280764672:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015749.695077:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74c11a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+92:2352:x1872772280764672:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 39us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015749.695083:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 733 00000100:00100000:1.0:1786015749.695096:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 734 00000100:00100000:1.0:1786015749.695102:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2351:x1872772280765056:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015749.695122:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2351:x1872772280765056:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015749.695128:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 734 00000100:00080000:1.0:1786015749.695147:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015749.695150:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015749.695153:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015749.695419:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280764544 00000100:00100000:0.0:1786015749.695425:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280764544 00000100:00100000:0.0:1786015749.695460:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 712 00000100:00100000:0.0:1786015749.695467:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280764544:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015749.695502:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2351:x1872772280764544:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 36us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015749.695508:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 712 00010000:00010000:3.0:1786015749.995978:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015750.316075:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304516608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015750.316169:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015750.316275:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304516608 00000100:00100000:0.0:1786015750.316286:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304516608 00000100:00100000:0.0:1786015750.316359:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1786015750.316370:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304516608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786015750.316405:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015750.316463:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304516608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015750.316472:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1786015750.316541:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304516608:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786015750.317304:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786015751.020042:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015751.653567:0:26812:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015751.653576:0:26812:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015751.654459:0:26812:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015751.654471:0:26812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015751.851982:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304516992:0@lo:400:kworker.0 00000100:00100000:1.0:1786015751.852065:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015751.852129:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015751.852136:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304517120:0@lo:400:kworker.0 00000100:00100000:1.0:1786015751.852162:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015751.852197:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304516992 00000100:00100000:1.0:1786015751.852204:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304516992 00000100:00100000:1.0:1786015751.852256:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:1.0:1786015751.852265:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304516992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015751.852314:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304516992:12345-0@lo:400:kworker.0 Request processed in 51us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015751.852323:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:1.0:1786015751.852345:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304517120 00000100:00100000:1.0:1786015751.852348:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304517120 00000100:00100000:1.0:1786015751.852372:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:1.0:1786015751.852378:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304517120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015751.852409:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304517120:12345-0@lo:400:kworker.0 Request processed in 31us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015751.852415:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00080000:1.0:1786015751.852430:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015751.852466:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304517120:0@lo:400:kworker.0 00000100:00100000:1.0:1786015751.852478:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304516992:0@lo:400:kworker.0 00000100:00100000:3.0:1786015751.852559:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b748825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304516736:0@lo:400:kworker.0 00000100:00100000:3.0:1786015751.852598:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015751.852638:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381306680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304517248:0@lo:400:kworker.0 00000100:00100000:3.0:1786015751.852663:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015751.852681:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786015751.852686:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7488259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304516864:0@lo:400:kworker.0 00000100:00100000:3.0:1786015751.852708:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015751.852724:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304517376:0@lo:400:kworker.0 00000100:00100000:3.0:1786015751.852744:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015751.852901:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304516736 00000100:00100000:1.0:1786015751.852906:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304516736 00000100:00100000:1.0:1786015751.852938:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:1.0:1786015751.852945:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304516736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015751.852984:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304516736:12345-0@lo:400:kworker.0 Request processed in 40us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015751.852990:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:1.0:1786015751.853015:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304517248 00000100:00100000:1.0:1786015751.853018:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304517248 00000100:00100000:1.0:1786015751.853053:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304516864 00000100:00100000:1.0:1786015751.853056:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304516864 00000100:00100000:1.0:1786015751.853074:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:1.0:1786015751.853080:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304517248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015751.853110:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304517248:12345-0@lo:400:kworker.0 Request processed in 30us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015751.853119:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:1.0:1786015751.853130:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:1.0:1786015751.853136:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304516864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015751.853162:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304516864:12345-0@lo:400:kworker.0 Request processed in 26us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015751.853167:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:1.0:1786015751.853187:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304517376 00000100:00100000:1.0:1786015751.853191:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304517376 00000100:00100000:1.0:1786015751.853216:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:1.0:1786015751.853221:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304517376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015751.853250:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304517376:12345-0@lo:400:kworker.0 Request processed in 29us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015751.853255:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00080000:1.0:1786015751.853273:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015751.853276:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015751.853355:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7488259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304516864:0@lo:400:kworker.0 00000100:00100000:3.0:1786015751.853365:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304517376:0@lo:400:kworker.0 00000100:00100000:3.0:1786015751.853372:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b748825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304516736:0@lo:400:kworker.0 00000100:00100000:3.0:1786015751.853379:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381306680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304517248:0@lo:400:kworker.0 00010000:00010000:1.0:1786015752.044187:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015752.364288:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786015752.364322:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304517504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015752.364405:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015752.364739:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304517504 00000100:00100000:0.0:1786015752.364748:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304517504 00000100:00100000:0.0:1786015752.364834:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1786015752.364843:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304517504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015752.364877:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015752.364933:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304517504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015752.364945:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1786015752.365053:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304517504:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786015753.068342:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015753.583080:0:26863:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015753.583090:0:26863:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015753.586926:0:26863:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015753.586945:0:26863:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786015754.100035:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015754.818570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015754.818620:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015754.818622:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280765568 00000100:00100000:2.0:1786015754.818633:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280765568 00000100:00100000:1.0:1786015754.818654:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015754.818686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015754.818703:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 738 00000100:00100000:1.0:1786015754.818713:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015754.818719:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+92:2354:x1872772280765568:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015754.818738:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015754.818885:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+92:2354:x1872772280765568:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 171us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015754.818895:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 738 00000100:00100000:2.0:1786015754.818913:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280765952 00000100:00100000:2.0:1786015754.818917:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280765952 00000100:00100000:1.0:1786015754.818932:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015754.818949:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 739 00000100:00100000:2.0:1786015754.818957:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2354:x1872772280765952:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015754.818986:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2354:x1872772280765952:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015754.818993:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 739 00000100:00080000:2.0:1786015754.819025:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015754.819066:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280765824 00000100:00100000:1.0:1786015754.819071:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280765824 00000100:00100000:0.0:1786015754.819101:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280766080 00000100:00100000:0.0:1786015754.819107:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280766080 00000100:00100000:1.0:1786015754.819115:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280765696 00000100:00100000:1.0:1786015754.819119:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280765696 00000100:00080000:2.0:1786015754.819156:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015754.819160:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015754.819181:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280766208 00000100:00100000:0.0:1786015754.819184:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280766208 00000100:00080000:2.0:1786015754.819224:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786015754.819358:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 783 00000100:00100000:1.0:1786015754.819367:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aea9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280765824:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015754.819414:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aea9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280765824:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 48us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015754.819421:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 783 00000100:00100000:1.0:1786015754.819597:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 784 00000100:00100000:1.0:1786015754.819603:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280766080:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015754.819632:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280766080:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015754.819637:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 784 00000100:00100000:1.0:1786015754.819647:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 785 00000100:00100000:1.0:1786015754.819651:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280765696:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015754.819667:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280765696:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 16us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015754.819671:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 785 00000100:00100000:1.0:1786015754.819679:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 786 00000100:00100000:1.0:1786015754.819683:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280766208:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015754.819707:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280766208:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015754.819710:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 786 00000100:00100000:1.0:1786015754.819723:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280765440 00000100:00100000:1.0:1786015754.819725:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280765440 00000100:00100000:1.0:1786015754.819750:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 714 00000100:00100000:1.0:1786015754.819754:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280765440:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015754.819785:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280765440:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015754.819789:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 714 00010000:00010000:3.0:1786015755.115956:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786015755.343868:0:26914:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015755.343878:0:26914:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015755.344484:0:26914:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015755.344493:0:26914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015755.450817:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015755.450920:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304517632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015755.451000:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015755.464258:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304517632 00000100:00100000:3.0:1786015755.464275:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304517632 00000100:00100000:3.0:1786015755.464349:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1786015755.464359:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304517632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015755.464400:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015755.464510:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304517632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (13519us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015755.464518:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00080000:3.0:1786015755.464555:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786015755.464607:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304517632:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786015756.140085:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015756.979655:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304517888:0@lo:400:kworker.0 00000100:00100000:3.0:1786015756.979825:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015756.979881:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304518400:0@lo:400:kworker.0 00000100:00100000:3.0:1786015756.979907:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015756.979930:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786015756.979936:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304517760:0@lo:400:kworker.0 00000100:00100000:3.0:1786015756.979964:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015756.980006:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304518272:0@lo:400:kworker.0 00000100:00100000:3.0:1786015756.980028:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015756.980056:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304518016:0@lo:400:kworker.0 00000100:00100000:3.0:1786015756.980080:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015756.980098:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015756.980103:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304518144:0@lo:400:kworker.0 00000100:00100000:3.0:1786015756.980124:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015756.980514:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304517888 00000100:00100000:3.0:1786015756.980523:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304517888 00000100:00100000:3.0:1786015756.980614:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304518272 00000100:00100000:3.0:1786015756.980618:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304518272 00000100:00080000:1.0:1786015756.980676:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015756.984462:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304518016 00000100:00100000:2.0:1786015756.984480:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304518016 00000100:00100000:2.0:1786015756.984732:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:2.0:1786015756.984744:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304517888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015756.984876:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304517888:12345-0@lo:400:kworker.0 Request processed in 135us (5050us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015756.984883:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:2.0:1786015756.984901:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:2.0:1786015756.984908:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304518272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015756.984937:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304518272:12345-0@lo:400:kworker.0 Request processed in 31us (4909us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015756.984944:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:2.0:1786015756.984956:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:2.0:1786015756.984962:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304518016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015756.985016:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304518016:12345-0@lo:400:kworker.0 Request processed in 54us (4935us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015756.985022:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:2.0:1786015756.985088:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304518016:0@lo:400:kworker.0 00000100:00100000:3.0:1786015756.985337:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304518400 00000100:00100000:3.0:1786015756.985344:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304518400 00000100:00100000:3.0:1786015756.985376:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304518144 00000100:00100000:3.0:1786015756.985379:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304518144 00000100:00100000:3.0:1786015756.985409:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:3.0:1786015756.985417:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304518400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015756.985461:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304518400:12345-0@lo:400:kworker.0 Request processed in 45us (5553us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015756.985467:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:3.0:1786015756.985480:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:3.0:1786015756.985485:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b748825b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304518144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015756.985682:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b748825b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304518144:12345-0@lo:400:kworker.0 Request processed in 195us (5556us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015756.985689:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:3.0:1786015756.985712:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304517760 00000100:00100000:3.0:1786015756.985715:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304517760 00000100:00100000:3.0:1786015756.985739:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:3.0:1786015756.985746:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304517760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015756.985805:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304517760:12345-0@lo:400:kworker.0 Request processed in 59us (5839us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015756.985813:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:3.0:1786015756.985869:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304517760:0@lo:400:kworker.0 00000100:00100000:3.0:1786015756.985883:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304518272:0@lo:400:kworker.0 00000100:00100000:3.0:1786015756.985894:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304517888:0@lo:400:kworker.0 00000100:00100000:3.0:1786015756.985904:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304518400:0@lo:400:kworker.0 00000100:00080000:1.0:1786015756.986269:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786015756.986276:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015756.986955:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304518144:0@lo:400:kworker.0 00010000:00010000:2.0:1786015757.164936:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015757.393349:0:26966:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015757.393361:0:26966:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015757.394501:0:26966:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015757.394515:0:26966:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015757.485484:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304518528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015757.485555:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015757.485819:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304518528 00000100:00100000:0.0:1786015757.485829:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304518528 00000100:00100000:0.0:1786015757.485881:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1786015757.485890:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304518528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015757.485927:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015757.485992:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304518528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015757.485999:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1786015757.486098:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304518528:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1786015757.676402:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015757.677106:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015757.677645:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015757.677656:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786015758.188082:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015759.215506:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015759.538037:0:27018:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015759.538047:0:27018:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015759.538565:0:27018:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015759.538575:0:27018:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015759.935301:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015759.935346:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015759.935375:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015759.935404:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015759.935428:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015759.935509:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280766592 00000100:00100000:0.0:1786015759.935519:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280766592 00000100:00100000:0.0:1786015759.935583:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280767104 00000100:00100000:0.0:1786015759.935586:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280767104 00000100:00100000:0.0:1786015759.935611:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 789 00000100:00100000:0.0:1786015759.935621:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280766592:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015759.935709:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280766592:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 89us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015759.935718:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 789 00000100:00100000:0.0:1786015759.935735:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 790 00000100:00100000:0.0:1786015759.935742:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280767104:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015759.935807:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280767104:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 65us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015759.935814:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 790 00000100:00080000:2.0:1786015759.936591:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015759.936597:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015759.936717:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280766336 00000100:00100000:1.0:1786015759.936724:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280766336 00000100:00100000:1.0:1786015759.936800:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 716 00000100:00100000:1.0:1786015759.936808:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280766336:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015759.936852:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280766336:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 45us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015759.936859:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 716 00000100:00100000:3.0:1786015759.938124:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280766464 00000100:00100000:3.0:1786015759.938144:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280766464 00000100:00100000:3.0:1786015759.938197:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280766848 00000100:00100000:3.0:1786015759.938201:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280766848 00000100:00100000:3.0:1786015759.938242:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 743 00000100:00100000:3.0:1786015759.938252:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+92:2353:x1872772280766464:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015759.938313:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41677fca-39fb-471c-b582-96bce6540a36+92:2353:x1872772280766464:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 61us (2965us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015759.938320:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 743 00000100:00100000:3.0:1786015759.938333:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 744 00000100:00100000:3.0:1786015759.938340:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2354:x1872772280766848:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015759.938364:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af05fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2354:x1872772280766848:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (2960us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015759.938371:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 744 00000100:00080000:1.0:1786015759.939236:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786015759.943894:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015759.943937:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015759.944044:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280766720 00000100:00100000:2.0:1786015759.944055:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280766720 00000100:00100000:2.0:1786015759.944124:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280766976 00000100:00100000:2.0:1786015759.944128:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280766976 00000100:00100000:2.0:1786015759.944162:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 791 00000100:00100000:2.0:1786015759.944171:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280766720:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015759.944251:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280766720:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 80us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015759.944258:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 791 00000100:00100000:2.0:1786015759.944276:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 792 00000100:00100000:2.0:1786015759.944282:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280766976:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015759.944307:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280766976:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015759.944313:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 792 00000100:00080000:0.0:1786015759.945336:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015759.945343:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786015760.236656:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015760.556486:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304518656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786015760.556567:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015760.556698:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304518656 00000100:00100000:3.0:1786015760.556707:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304518656 00000100:00100000:3.0:1786015760.556782:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1786015760.556793:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304518656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786015760.556829:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1786015760.556879:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304518656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015760.556886:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00080000:1.0:1786015760.557542:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015760.557581:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304518656:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786015761.260028:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015761.563039:0:27069:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015761.563050:0:27069:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015761.563694:0:27069:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015761.563704:0:27069:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015762.093908:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304519040:0@lo:400:kworker.0 00000100:00100000:1.0:1786015762.094010:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015762.094359:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304519040 00000100:00100000:3.0:1786015762.094477:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304518784:0@lo:400:kworker.0 00000100:00100000:3.0:1786015762.094590:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015762.094632:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304519296:0@lo:400:kworker.0 00000100:00100000:3.0:1786015762.094668:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015762.094693:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786015762.094699:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304518912:0@lo:400:kworker.0 00000100:00100000:3.0:1786015762.094735:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015762.094753:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304519424:0@lo:400:kworker.0 00000100:00100000:3.0:1786015762.094803:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015762.094834:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304519296 00000100:00100000:3.0:1786015762.094839:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304519296 00000100:00100000:3.0:1786015762.094907:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304518912 00000100:00100000:3.0:1786015762.094911:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304518912 00000100:00100000:3.0:1786015762.094947:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:3.0:1786015762.094958:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7488259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304519296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015762.095021:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7488259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304519296:12345-0@lo:400:kworker.0 Request processed in 64us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015762.095028:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:3.0:1786015762.095046:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:3.0:1786015762.095053:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304518912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015762.095083:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1872772304518912:12345-0@lo:400:kworker.0 Request processed in 30us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015762.095089:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:0.0:1786015762.095335:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304518784 00000100:00100000:0.0:1786015762.095341:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304518784 00000100:00100000:0.0:1786015762.095380:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:0.0:1786015762.095387:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304518784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015762.095423:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3312:x1872772304518784:12345-0@lo:400:kworker.0 Request processed in 37us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015762.095430:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:2.0:1786015762.095610:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304519040 00000100:00100000:2.0:1786015762.095645:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:2.0:1786015762.095652:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304519040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015762.095689:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304519040:12345-0@lo:400:kworker.0 Request processed in 38us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015762.095695:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:1.0:1786015762.095865:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015762.095881:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74bf89e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304519168:0@lo:400:kworker.0 00000100:00100000:1.0:1786015762.095918:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786015762.100844:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015762.101319:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1872772304518912:0@lo:400:kworker.0 00000100:00100000:2.0:1786015762.101337:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3312:1872772304518784:0@lo:400:kworker.0 00000100:00100000:2.0:1786015762.101349:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304519296:0@lo:400:kworker.0 00000100:00100000:1.0:1786015762.102305:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304519040:0@lo:400:kworker.0 00000100:00100000:1.0:1786015762.102353:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304519424 00000100:00100000:1.0:1786015762.102359:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304519424 00000100:00100000:3.0:1786015762.102458:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304519168 00000100:00100000:3.0:1786015762.102463:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304519168 00000100:00100000:2.0:1786015762.102740:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:2.0:1786015762.102752:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304519168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015762.102856:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304519168:12345-0@lo:400:kworker.0 Request processed in 107us (6936us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015762.102863:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00080000:0.0:1786015762.103457:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015762.103462:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015762.103513:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304519168:0@lo:400:kworker.0 00000100:00100000:1.0:1786015762.103818:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:1.0:1786015762.103829:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304519424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015762.104278:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304519424:12345-0@lo:400:kworker.0 Request processed in 450us (9472us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015762.104286:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:3.0:1786015762.111477:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74bf89f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304519424:0@lo:400:kworker.0 00010000:00010000:3.0:1786015762.284347:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015762.604171:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786015762.604203:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304519552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015762.604288:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015762.604469:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304519552 00000100:00100000:0.0:1786015762.604477:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304519552 00000100:00100000:0.0:1786015762.604527:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1786015762.604537:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304519552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015762.604576:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015762.604630:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304519552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015762.604637:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1786015762.605205:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304519552:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786015763.312171:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015763.501941:0:27120:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015763.501953:0:27120:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015763.502870:0:27120:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015763.502884:0:27120:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015764.332090:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015765.055661:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015765.055729:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280767232 00000100:00100000:0.0:1786015765.055740:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280767232 00000100:00100000:0.0:1786015765.055839:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 718 00000100:00100000:0.0:1786015765.055849:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280767232:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015765.055940:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2353:x1872772280767232:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 92us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015765.055948:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 718 00000100:00100000:2.0:1786015765.060264:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015765.068278:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280767360 00000100:00100000:3.0:1786015765.068296:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280767360 00000100:00100000:2.0:1786015765.068639:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 748 00000100:00100000:2.0:1786015765.068654:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+92:2353:x1872772280767360:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015765.068757:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41677fca-39fb-471c-b582-96bce6540a36+92:2353:x1872772280767360:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 108us (8502us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015765.068784:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 748 00000100:00080000:0.0:1786015765.068855:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015765.075418:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015765.075463:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015765.075494:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015765.075532:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015765.075567:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280767616 00000100:00100000:2.0:1786015765.075574:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015765.075581:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280767616 00000100:00100000:2.0:1786015765.075601:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280767744 00000100:00100000:2.0:1786015765.075607:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280767744 00000100:00100000:1.0:1786015765.075657:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280767872 00000100:00100000:1.0:1786015765.075662:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280767872 00000100:00100000:2.0:1786015765.075663:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 749 00000100:00100000:2.0:1786015765.075676:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2354:x1872772280767744:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015765.075689:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280767488 00000100:00100000:1.0:1786015765.075694:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280767488 00000100:00100000:1.0:1786015765.075711:0:11384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280768000 00000100:00100000:1.0:1786015765.075714:0:11384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280768000 00000100:00100000:1.0:1786015765.075733:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 795 00000100:00100000:1.0:1786015765.075743:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280767616:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015765.075757:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2354:x1872772280767744:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 82us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015765.075795:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 749 00000100:00100000:1.0:1786015765.075821:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280767616:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 78us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015765.075829:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 795 00000100:00100000:1.0:1786015765.075848:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 796 00000100:00100000:1.0:1786015765.075857:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280767872:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015765.075884:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280767872:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015765.075891:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 796 00000100:00100000:1.0:1786015765.075914:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 797 00000100:00100000:1.0:1786015765.075922:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280767488:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015765.075999:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 798 00000100:00100000:0.0:1786015765.076010:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280768000:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015765.076782:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280767488:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 837us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015765.076791:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 797 00000100:00080000:1.0:1786015765.076822:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015765.076827:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786015765.076829:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015765.080452:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280768000:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 4429us (4864us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015765.080469:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 798 00010000:00010000:2.0:1786015765.357099:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015765.676811:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304519680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015765.676881:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015765.678081:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304519680 00000100:00100000:1.0:1786015765.678093:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304519680 00000100:00100000:1.0:1786015765.678291:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1786015765.678304:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304519680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015765.678343:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00080000:0.0:1786015765.683487:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015765.688119:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304519680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9811us (11230us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015765.688135:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1786015765.697433:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304519680:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1786015765.775130:0:27172:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015765.775142:0:27172:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015765.776138:0:27172:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015765.776153:0:27172:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786015766.380630:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015767.212528:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304519936:0@lo:400:kworker.0 00000100:00100000:2.0:1786015767.212605:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015767.212654:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304520448:0@lo:400:kworker.0 00000100:00100000:2.0:1786015767.212680:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015767.212706:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1786015767.212713:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304519808:0@lo:400:kworker.0 00000100:00100000:2.0:1786015767.212743:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015767.212789:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304520320:0@lo:400:kworker.0 00000100:00100000:2.0:1786015767.212814:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015767.212850:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304520064:0@lo:400:kworker.0 00000100:00100000:2.0:1786015767.212888:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015767.212907:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786015767.212912:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304520192:0@lo:400:kworker.0 00000100:00100000:2.0:1786015767.212937:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015767.212981:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304519936 00000100:00100000:2.0:1786015767.212990:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304519936 00000100:00100000:2.0:1786015767.213038:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304520320 00000100:00100000:2.0:1786015767.213042:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304520320 00000100:00100000:2.0:1786015767.213083:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304520064 00000100:00100000:2.0:1786015767.213086:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304520064 00000100:00100000:2.0:1786015767.213102:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:2.0:1786015767.213110:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304519936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015767.213162:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304519936:12345-0@lo:400:kworker.0 Request processed in 52us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015767.213170:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:2.0:1786015767.213187:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:2.0:1786015767.213192:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304520320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015767.213219:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304520320:12345-0@lo:400:kworker.0 Request processed in 27us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015767.213226:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:2.0:1786015767.213237:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:2.0:1786015767.213242:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304520064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015767.213269:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304520064:12345-0@lo:400:kworker.0 Request processed in 26us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015767.213275:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:2.0:1786015767.213293:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304520448 00000100:00100000:2.0:1786015767.213296:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304520448 00000100:00100000:2.0:1786015767.213324:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304520192 00000100:00100000:2.0:1786015767.213327:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304520192 00000100:00100000:2.0:1786015767.213346:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:2.0:1786015767.213352:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304520448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015767.213382:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304520448:12345-0@lo:400:kworker.0 Request processed in 30us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015767.213389:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:2.0:1786015767.213399:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:2.0:1786015767.213404:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304520192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015767.213428:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304520192:12345-0@lo:400:kworker.0 Request processed in 24us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015767.213434:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:2.0:1786015767.213450:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304519808 00000100:00100000:2.0:1786015767.213453:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304519808 00000100:00100000:2.0:1786015767.213477:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:2.0:1786015767.213483:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aabae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304519808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015767.213511:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aabae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304519808:12345-0@lo:400:kworker.0 Request processed in 28us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015767.213518:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00080000:2.0:1786015767.213551:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786015767.213555:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015767.213558:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015767.213585:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304519808:0@lo:400:kworker.0 00000100:00100000:2.0:1786015767.213600:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304520320:0@lo:400:kworker.0 00000100:00100000:2.0:1786015767.213611:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304519936:0@lo:400:kworker.0 00000100:00100000:2.0:1786015767.213619:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304520448:0@lo:400:kworker.0 00000100:00100000:2.0:1786015767.213654:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304520192:0@lo:400:kworker.0 00000100:00100000:2.0:1786015767.213664:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304520064:0@lo:400:kworker.0 00010000:00010000:0.0:1786015767.409356:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015767.731315:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304520576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015767.731416:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015767.732058:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304520576 00000100:00100000:0.0:1786015767.732071:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304520576 00000100:00100000:0.0:1786015767.732136:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1786015767.732149:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304520576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015767.732192:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015767.732252:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304520576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015767.732259:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1786015767.732311:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304520576:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1786015767.918112:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015767.918126:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015767.918699:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015767.918715:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1786015768.006524:0:27223:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015768.006537:0:27223:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015768.009320:0:27223:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015768.009350:0:27223:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015768.428035:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015769.452553:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015770.176366:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015770.176506:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280768128 00000100:00100000:1.0:1786015770.176521:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280768128 00000100:00100000:1.0:1786015770.176605:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 720 00000100:00100000:1.0:1786015770.176620:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74864ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280768128:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015770.177064:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74864ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280768128:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 446us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015770.177074:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 720 00000100:00100000:2.0:1786015770.185966:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015770.187664:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015770.187692:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015770.187712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015770.187742:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015770.190089:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015770.190126:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280768512 00000100:00100000:2.0:1786015770.190138:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280768512 00000100:00100000:2.0:1786015770.190200:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280768768 00000100:00100000:2.0:1786015770.190203:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280768768 00000100:00100000:2.0:1786015770.190220:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280768384 00000100:00100000:2.0:1786015770.190223:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280768384 00000100:00100000:2.0:1786015770.190235:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280768896 00000100:00100000:2.0:1786015770.190237:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280768896 00000100:00100000:2.0:1786015770.190255:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 801 00000100:00100000:2.0:1786015770.190266:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280768512:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015770.190362:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+18:2353:x1872772280768512:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 98us (2707us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015770.190370:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 801 00000100:00100000:2.0:1786015770.190389:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 802 00000100:00100000:2.0:1786015770.190395:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280768768:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015770.190467:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280768256 00000100:00100000:0.0:1786015770.190473:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280768256 00000100:00100000:0.0:1786015770.190517:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280768640 00000100:00100000:0.0:1786015770.190520:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280768640 00000100:00100000:0.0:1786015770.190541:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 753 00000100:00100000:0.0:1786015770.190548:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+92:2354:x1872772280768256:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015770.190578:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+92:2354:x1872772280768256:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (4629us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015770.190584:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 753 00000100:00100000:0.0:1786015770.190595:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 754 00000100:00100000:0.0:1786015770.190600:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2353:x1872772280768640:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015770.190618:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2353:x1872772280768640:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 18us (2876us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015770.190624:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 754 00000100:00100000:0.0:1786015770.190642:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 803 00000100:00100000:0.0:1786015770.190648:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280768384:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015770.190679:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2353:x1872772280768384:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (2954us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015770.190694:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 803 00000100:00100000:0.0:1786015770.190705:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 804 00000100:00100000:0.0:1786015770.190711:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280768896:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015770.190729:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2353:x1872772280768896:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 19us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015770.190735:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 804 00000100:00080000:0.0:1786015770.190807:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015770.190812:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015770.190814:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786015770.191459:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2353:x1872772280768768:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 1058us (3759us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015770.191468:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 802 00000040:00080000:1.0:1786015770.226754:0:27274:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015770.226800:0:27274:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015770.240794:0:27274:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015770.240821:0:27274:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786015770.476129:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015770.796239:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74af068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304520704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015770.796363:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015770.796683:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304520704 00000100:00100000:1.0:1786015770.796696:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304520704 00000100:00100000:1.0:1786015770.796788:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1786015770.796799:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304520704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786015770.796858:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00080000:2.0:1786015770.799533:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015770.799913:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304520704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3107us (3541us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015770.799930:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1786015770.804261:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74af068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304520704:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786015771.515514:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015772.151966:0:27325:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015772.151976:0:27325:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015772.158368:0:27325:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015772.158393:0:27325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786015772.338468:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304521088:0@lo:400:kworker.0 00000100:00100000:1.0:1786015772.338542:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015772.338612:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786015772.338618:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304521216:0@lo:400:kworker.0 00000100:00100000:1.0:1786015772.338646:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015772.338679:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304521088 00000100:00100000:1.0:1786015772.338685:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304521088 00000100:00100000:1.0:1786015772.338735:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:1.0:1786015772.338744:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304521088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015772.338816:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304521088:12345-0@lo:400:kworker.0 Request processed in 73us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015772.338824:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00080000:1.0:1786015772.338857:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015772.338893:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304521088:0@lo:400:kworker.0 00000100:00100000:0.0:1786015772.338967:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304520960:0@lo:400:kworker.0 00000100:00100000:0.0:1786015772.338999:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015772.339033:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304521472:0@lo:400:kworker.0 00000100:00100000:0.0:1786015772.339056:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015772.339075:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1786015772.339081:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304520832:0@lo:400:kworker.0 00000100:00100000:0.0:1786015772.339110:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015772.339132:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304521344:0@lo:400:kworker.0 00000100:00100000:0.0:1786015772.339153:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015772.339175:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304521216 00000100:00100000:0.0:1786015772.339178:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304521216 00000100:00100000:0.0:1786015772.339205:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304521472 00000100:00100000:0.0:1786015772.339208:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304521472 00000100:00100000:0.0:1786015772.339223:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:0.0:1786015772.339229:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304521216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015772.339261:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304521216:12345-0@lo:400:kworker.0 Request processed in 33us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015772.339267:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00100000:0.0:1786015772.339276:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:0.0:1786015772.339281:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304521472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015772.339304:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304521472:12345-0@lo:400:kworker.0 Request processed in 23us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015772.339309:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:0.0:1786015772.339323:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304520960 00000100:00100000:0.0:1786015772.339326:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304520960 00000100:00100000:0.0:1786015772.339341:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304521344 00000100:00100000:0.0:1786015772.339343:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304521344 00000100:00100000:0.0:1786015772.339356:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:0.0:1786015772.339360:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304520960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015772.339384:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304520960:12345-0@lo:400:kworker.0 Request processed in 23us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015772.339388:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:0.0:1786015772.339396:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:0.0:1786015772.339401:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304521344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015772.339420:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304521344:12345-0@lo:400:kworker.0 Request processed in 19us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015772.339424:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:0.0:1786015772.339441:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304520832 00000100:00100000:0.0:1786015772.339444:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304520832 00000100:00100000:0.0:1786015772.339467:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:0.0:1786015772.339473:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74864ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304520832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786015772.339500:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74864ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304520832:12345-0@lo:400:kworker.0 Request processed in 27us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015772.339506:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00080000:0.0:1786015772.339544:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786015772.339548:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786015772.339550:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786015772.339566:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304520832:0@lo:400:kworker.0 00000100:00100000:0.0:1786015772.339577:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304521344:0@lo:400:kworker.0 00000100:00100000:0.0:1786015772.339585:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304520960:0@lo:400:kworker.0 00000100:00100000:0.0:1786015772.339594:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304521472:0@lo:400:kworker.0 00000100:00100000:0.0:1786015772.339627:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304521216:0@lo:400:kworker.0 00010000:00010000:1.0:1786015772.524871:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015772.845328:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304521600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015772.845414:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015772.845998:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304521600 00000100:00100000:0.0:1786015772.846008:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304521600 00000100:00100000:0.0:1786015772.848316:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1786015772.848341:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304521600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786015772.848387:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1786015772.848478:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304521600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (3063us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015772.848485:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1786015772.848749:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304521600:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786015773.552075:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015774.159691:0:27377:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015774.159706:0:27377:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015774.160254:0:27377:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015774.160269:0:27377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786015774.573536:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015775.297673:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015775.297864:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015775.297942:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015775.298028:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015775.298063:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015775.298086:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015775.298184:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015775.298220:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280769408 00000100:00100000:2.0:1786015775.298234:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280769408 00000100:00100000:2.0:1786015775.298314:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280769664 00000100:00100000:2.0:1786015775.298318:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280769664 00000100:00100000:2.0:1786015775.298341:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280769280 00000100:00100000:2.0:1786015775.298344:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280769280 00000100:00100000:2.0:1786015775.298360:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280769792 00000100:00100000:2.0:1786015775.298362:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280769792 00000100:00100000:2.0:1786015775.298381:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 807 00000100:00100000:2.0:1786015775.298392:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+18:2351:x1872772280769408:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015775.298515:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+18:2351:x1872772280769408:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 121us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015775.298525:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 807 00000100:00100000:2.0:1786015775.298557:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 808 00000100:00100000:2.0:1786015775.298567:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280769664:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015775.298612:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2351:x1872772280769664:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 45us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015775.298621:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 808 00000100:00100000:2.0:1786015775.298640:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 809 00000100:00100000:2.0:1786015775.298649:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280769280:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015775.298684:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+17:2351:x1872772280769280:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 37us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015775.298691:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 809 00000100:00100000:2.0:1786015775.298705:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 810 00000100:00100000:2.0:1786015775.298711:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280769792:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015775.298745:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2351:x1872772280769792:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015775.298753:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 810 00000100:00100000:0.0:1786015775.299971:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280769152 00000100:00100000:0.0:1786015775.299994:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280769152 00000100:00100000:0.0:1786015775.300067:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280769536 00000100:00100000:0.0:1786015775.300072:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280769536 00000100:00100000:0.0:1786015775.300303:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 758 00000100:00100000:0.0:1786015775.300315:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74af06b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+92:2352:x1872772280769152:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015775.300406:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74af06b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41677fca-39fb-471c-b582-96bce6540a36+92:2352:x1872772280769152:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 93us (2543us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015775.300415:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 758 00000100:00100000:0.0:1786015775.300432:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 759 00000100:00100000:0.0:1786015775.300439:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2351:x1872772280769536:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015775.300466:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2351:x1872772280769536:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (2379us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015775.300472:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 759 00000100:00100000:1.0:1786015775.301149:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280769024 00000100:00100000:1.0:1786015775.301160:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280769024 00000100:00100000:1.0:1786015775.301209:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 722 00000100:00100000:1.0:1786015775.301217:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280769024:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015775.301259:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2352:x1872772280769024:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 43us (3609us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015775.301270:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 722 00000100:00080000:3.0:1786015775.301584:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786015775.301591:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786015775.301594:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786015775.598272:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786015775.916658:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786015775.916693:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304521728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786015775.916823:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015775.916920:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304521728 00000100:00100000:2.0:1786015775.916941:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304521728 00000100:00100000:2.0:1786015775.917264:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1786015775.917275:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304521728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015775.917324:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015775.917380:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304521728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015775.917389:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1786015775.917540:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304521728:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786015775.917692:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1786015776.257845:0:27428:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015776.257860:0:27428:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015776.258379:0:27428:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015776.258391:0:27428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015776.621380:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015777.134490:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015777.134508:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015777.135089:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015777.135104:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015777.453116:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304521984:0@lo:400:kworker.0 00000100:00100000:3.0:1786015777.453213:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015777.453284:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304522496:0@lo:400:kworker.0 00000100:00100000:3.0:1786015777.453313:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015777.453348:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786015777.453354:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304521856:0@lo:400:kworker.0 00000100:00100000:3.0:1786015777.453386:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015777.453409:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304522368:0@lo:400:kworker.0 00000100:00100000:3.0:1786015777.453431:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015777.453457:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304522240:0@lo:400:kworker.0 00000100:00100000:3.0:1786015777.453481:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015777.453496:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786015777.453501:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304522112:0@lo:400:kworker.0 00000100:00100000:3.0:1786015777.453520:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015777.453800:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304521984 00000100:00100000:3.0:1786015777.453810:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304521984 00000100:00100000:3.0:1786015777.453881:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304522368 00000100:00100000:3.0:1786015777.453884:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304522368 00000100:00100000:3.0:1786015777.453913:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304522112 00000100:00100000:3.0:1786015777.453915:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304522112 00000100:00100000:3.0:1786015777.453935:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:3.0:1786015777.453954:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304521984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015777.454172:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304521984:12345-0@lo:400:kworker.0 Request processed in 228us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015777.454180:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:3.0:1786015777.454201:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:3.0:1786015777.454207:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304522368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015777.454235:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304522368:12345-0@lo:400:kworker.0 Request processed in 29us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015777.454241:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:3.0:1786015777.454252:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:3.0:1786015777.454257:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304522112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015777.454285:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872772304522112:12345-0@lo:400:kworker.0 Request processed in 27us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015777.454290:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:3.0:1786015777.454311:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304521856 00000100:00100000:3.0:1786015777.454314:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304521856 00000100:00100000:3.0:1786015777.454400:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:3.0:1786015777.454408:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304521856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015777.454443:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304521856:12345-0@lo:400:kworker.0 Request processed in 35us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015777.454449:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00080000:3.0:1786015777.454489:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786015777.454527:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1872772304522112:0@lo:400:kworker.0 00000100:00100000:0.0:1786015777.455243:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304521856:0@lo:400:kworker.0 00000100:00100000:0.0:1786015777.455258:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304522368:0@lo:400:kworker.0 00000100:00100000:0.0:1786015777.455270:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304521984:0@lo:400:kworker.0 00000100:00100000:2.0:1786015777.455488:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304522496 00000100:00100000:2.0:1786015777.455495:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304522496 00000100:00100000:2.0:1786015777.455549:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304522240 00000100:00100000:2.0:1786015777.455552:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304522240 00000100:00100000:2.0:1786015777.455577:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00100000:2.0:1786015777.455585:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304522496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015777.455650:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304522496:12345-0@lo:400:kworker.0 Request processed in 67us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015777.455657:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00100000:2.0:1786015777.455670:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:2.0:1786015777.455676:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304522240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015777.455700:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304522240:12345-0@lo:400:kworker.0 Request processed in 25us (2218us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015777.455705:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00100000:2.0:1786015777.455743:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304522496:0@lo:400:kworker.0 00000100:00080000:0.0:1786015777.459824:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786015777.459838:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786015777.459922:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304522240:0@lo:400:kworker.0 00010000:00010000:0.0:1786015777.644095:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015777.966382:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304522624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786015777.966494:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015777.966629:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304522624 00000100:00100000:1.0:1786015777.966641:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304522624 00000100:00100000:1.0:1786015777.966711:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1786015777.966722:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304522624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015777.966801:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015777.969664:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304522624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2926us (3151us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015777.969683:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1786015777.970261:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304522624:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1786015778.492755:0:27479:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015778.492814:0:27479:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015778.495335:0:27479:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015778.495364:0:27479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786015778.671056:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786015779.692466:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015780.414317:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015780.414377:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015780.414407:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015780.414441:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015780.414462:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015780.414490:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015780.414516:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015780.414555:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280770304 00000100:00100000:1.0:1786015780.414569:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280770304 00000100:00100000:1.0:1786015780.414647:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280770560 00000100:00100000:1.0:1786015780.414650:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280770560 00000100:00100000:1.0:1786015780.414670:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280770176 00000100:00100000:1.0:1786015780.414673:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280770176 00000100:00100000:1.0:1786015780.414688:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280770688 00000100:00100000:1.0:1786015780.414691:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280770688 00000100:00100000:1.0:1786015780.414710:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 813 00000100:00100000:1.0:1786015780.414720:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280770304:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015780.414883:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280770304:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 163us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015780.414891:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 813 00000100:00100000:1.0:1786015780.414913:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 814 00000100:00100000:1.0:1786015780.414920:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280770560:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015780.415067:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280770560:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 148us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015780.415075:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 814 00000100:00100000:1.0:1786015780.415088:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 815 00000100:00100000:1.0:1786015780.415093:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280770176:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015780.415121:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280770176:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015780.415127:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 815 00000100:00100000:1.0:1786015780.415139:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 816 00000100:00100000:1.0:1786015780.415145:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280770688:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015780.415168:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280770688:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015780.415174:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 816 00000100:00080000:1.0:1786015780.415199:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786015780.415204:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786015780.415593:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280770048 00000100:00100000:3.0:1786015780.415600:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280770048 00000100:00100000:3.0:1786015780.415651:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280770432 00000100:00100000:3.0:1786015780.415655:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280770432 00000100:00100000:3.0:1786015780.415678:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 763 00000100:00100000:3.0:1786015780.415685:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+92:2354:x1872772280770048:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015780.415723:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41677fca-39fb-471c-b582-96bce6540a36+92:2354:x1872772280770048:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015780.415729:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 763 00000100:00100000:3.0:1786015780.415743:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 764 00000100:00100000:3.0:1786015780.415783:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2354:x1872772280770432:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015780.415811:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2354:x1872772280770432:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 62us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015780.415817:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 764 00000100:00100000:3.0:1786015780.415858:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280769920 00000100:00100000:3.0:1786015780.415861:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280769920 00000100:00100000:3.0:1786015780.415888:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 724 00000100:00100000:3.0:1786015780.415894:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280769920:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1786015780.415921:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280769920:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015780.415927:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 724 00000100:00080000:3.0:1786015780.415986:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1786015780.637127:0:27531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786015780.637145:0:27531:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786015780.648476:0:27531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786015780.648511:0:27531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786015780.721913:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015781.039188:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304522752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786015781.039304:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015781.039561:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304522752 00000100:00100000:2.0:1786015781.039590:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304522752 00000100:00100000:2.0:1786015781.039680:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1786015781.039692:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304522752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015781.039741:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015781.039835:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304522752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015781.039843:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1786015781.040999:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304522752:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786015781.041373:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786015781.740132:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786015782.572209:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786015782.572280:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304523008:0@lo:400:kworker.0 00000100:00100000:0.0:1786015782.572507:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015782.572578:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304522880:0@lo:400:kworker.0 00000100:00100000:0.0:1786015782.572611:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015782.572671:0:12526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304523008 00000100:00100000:1.0:1786015782.572680:0:12526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304523008 00000100:00100000:3.0:1786015782.572693:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304522880 00000100:00100000:3.0:1786015782.572697:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304522880 00000100:00100000:1.0:1786015782.572740:0:12526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:3.0:1786015782.572742:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:3.0:1786015782.572749:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304522880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015782.572750:0:12526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304523008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786015782.572834:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304522880:12345-0@lo:400:kworker.0 Request processed in 85us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015782.572841:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1786015782.573199:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304523136:0@lo:400:kworker.0 00000100:00100000:2.0:1786015782.573231:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015782.573253:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786015782.573258:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304523264:0@lo:400:kworker.0 00000100:00100000:2.0:1786015782.573284:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015782.573312:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304523136 00000100:00100000:2.0:1786015782.573316:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304523136 00000100:00100000:2.0:1786015782.573378:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:2.0:1786015782.573387:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304523136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015782.573425:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304523136:12345-0@lo:400:kworker.0 Request processed in 40us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015782.573432:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:2.0:1786015782.573452:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304523264 00000100:00100000:2.0:1786015782.573455:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304523264 00000100:00100000:2.0:1786015782.573481:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:2.0:1786015782.573487:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304523264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015782.573518:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304523264:12345-0@lo:400:kworker.0 Request processed in 31us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015782.573524:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00080000:2.0:1786015782.573539:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015782.573555:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304523392:0@lo:400:kworker.0 00000100:00100000:2.0:1786015782.573580:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015782.573600:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786015782.573606:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304523520:0@lo:400:kworker.0 00000100:00100000:2.0:1786015782.573627:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015782.573650:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304523392 00000100:00100000:2.0:1786015782.573653:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304523392 00000100:00100000:2.0:1786015782.573682:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:2.0:1786015782.573688:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304523392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015782.573720:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1872772304523392:12345-0@lo:400:kworker.0 Request processed in 32us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015782.573741:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:2.0:1786015782.573778:0:22346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304523520 00000100:00100000:2.0:1786015782.573782:0:22346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304523520 00000100:00100000:2.0:1786015782.573820:0:22346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:2.0:1786015782.573826:0:22346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304523520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015782.573857:0:22346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3312:x1872772304523520:12345-0@lo:400:kworker.0 Request processed in 31us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015782.573862:0:22346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00080000:2.0:1786015782.573880:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786015782.573883:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786015782.574234:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1872772304523520:0@lo:400:kworker.0 00000100:00100000:2.0:1786015782.574250:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1872772304523392:0@lo:400:kworker.0 00000100:00100000:2.0:1786015782.574287:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304523264:0@lo:400:kworker.0 00000100:00100000:2.0:1786015782.574297:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304523136:0@lo:400:kworker.0 00000100:00100000:1.0:1786015782.577857:0:12526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304523008:12345-0@lo:400:kworker.0 Request processed in 5097us (5339us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015782.577875:0:12526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00000100:00100000:0.0:1786015782.579618:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304523008:0@lo:400:kworker.0 00000100:00100000:0.0:1786015782.579649:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304522880:0@lo:400:kworker.0 00010000:00010000:2.0:1786015782.768085:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786015782.798210:0:27582:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786015782.798221:0:27582:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786015782.800221:0:27582:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1786015782.800238:0:27582:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786015783.084212:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7382e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304523648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786015783.084295:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015783.084590:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304523648 00000100:00100000:1.0:1786015783.084598:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304523648 00000100:00100000:1.0:1786015783.084655:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1786015783.084665:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304523648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015783.084699:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015783.084788:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304523648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015783.084795:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1786015783.084852:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7382e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304523648:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786015783.788165:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786015784.815821:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786015784.956393:0:27633:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786015784.956403:0:27633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786015784.957544:0:27633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786015784.957561:0:27633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786015785.542525:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015785.542578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015785.542611:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015785.542640:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015785.542659:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015785.542677:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015785.542715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1786015785.542861:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280771072 00000100:00100000:1.0:1786015785.542880:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280771072 00000100:00100000:1.0:1786015785.542955:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280771584 00000100:00100000:1.0:1786015785.542958:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280771584 00000100:00100000:1.0:1786015785.542982:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280771200 00000100:00100000:1.0:1786015785.542984:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280771200 00000100:00100000:1.0:1786015785.542999:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280771456 00000100:00100000:1.0:1786015785.543002:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280771456 00000100:00100000:1.0:1786015785.543016:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 819 00000100:00100000:1.0:1786015785.543025:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280771072:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015785.543107:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+17:2354:x1872772280771072:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 83us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015785.543115:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 819 00000100:00100000:1.0:1786015785.543132:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 820 00000100:00100000:1.0:1786015785.543138:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280771584:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015785.543164:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+11:2354:x1872772280771584:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015785.543171:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 820 00000100:00100000:1.0:1786015785.543182:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 821 00000100:00100000:1.0:1786015785.543188:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280771200:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015785.543211:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41677fca-39fb-471c-b582-96bce6540a36+18:2354:x1872772280771200:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015785.543218:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 821 00000100:00100000:1.0:1786015785.543228:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 822 00000100:00100000:1.0:1786015785.543235:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280771456:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1786015785.543257:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:60d0ccd6-6e87-411c-bc51-c64181e59585+9:2354:x1872772280771456:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015785.543264:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 822 00000100:00100000:0.0:1786015785.543756:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280770816 00000100:00100000:0.0:1786015785.543820:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280770816 00000100:00100000:0.0:1786015785.543859:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 726 00000100:00100000:0.0:1786015785.543867:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280770816:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1786015785.543921:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92d4c8ea-0e6b-40b1-8d8e-868c98bf719e+13:2354:x1872772280770816:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 55us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1786015785.543928:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 726 00000100:00080000:3.0:1786015785.544299:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015785.544304:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786015785.544370:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280771328 00000100:00100000:2.0:1786015785.544376:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280771328 00000100:00100000:2.0:1786015785.544435:0:7673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280770944 00000100:00100000:2.0:1786015785.544439:0:7673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280770944 00000100:00100000:2.0:1786015785.544471:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 768 00000100:00100000:2.0:1786015785.544481:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2354:x1872772280771328:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015785.544539:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60d0ccd6-6e87-411c-bc51-c64181e59585+37:2354:x1872772280771328:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 59us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015785.544546:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 768 00000100:00100000:2.0:1786015785.544559:0:7673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 769 00000100:00100000:2.0:1786015785.544565:0:7673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+92:2354:x1872772280770944:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1786015785.544590:0:7673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41677fca-39fb-471c-b582-96bce6540a36+92:2354:x1872772280770944:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015785.544596:0:7673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 769 00000100:00080000:3.0:1786015785.545386:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786015785.836603:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786015786.156293:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304523776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786015786.156474:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786015786.162015:0:16109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304523776 00000100:00100000:2.0:1786015786.162033:0:16109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304523776 00000100:00100000:2.0:1786015786.162145:0:16109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1786015786.162158:0:16109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304523776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786015786.162205:0:16109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1786015786.162312:0:16109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304523776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (5849us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015786.162321:0:16109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1786015786.162387:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304523776:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786015786.162547:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786015786.372758:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015786.373117:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280771840 00000100:00100000:0.0:1786015786.373131:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280771840 00000100:00100000:0.0:1786015786.373225:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 339 00000100:00100000:0.0:1786015786.373237:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+92:5568:x1872772280771840:12345-192.168.202.56@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1786015786.373558:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+93:5568:x1872772280771840:12345-192.168.202.56@tcp:35:ldlm_bl.0 Request processed in 323us (812us total) trans 4294968383 rc 0/0 00000100:00100000:0.0:1786015786.373569:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 339 00000100:00100000:2.0:1786015786.381963:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1786015786.382066:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280772096 00000100:00100000:0.0:1786015786.382078:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280772096 00000100:00100000:0.0:1786015786.382189:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 340 00000100:00100000:0.0:1786015786.382200:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74b8c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+93:5568:x1872772280772096:12345-192.168.202.56@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1786015786.382435:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74b8c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41677fca-39fb-471c-b582-96bce6540a36+94:5568:x1872772280772096:12345-192.168.202.56@tcp:35:ldlm_bl.0 Request processed in 237us (693us total) trans 4294968384 rc 0/0 00000100:00100000:0.0:1786015786.382443:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 340 00000100:00100000:1.0:1786015786.392556:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1786015786.392790:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280772352 00000100:00100000:2.0:1786015786.392806:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280772352 00000100:00100000:2.0:1786015786.393017:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 341 00000100:00100000:2.0:1786015786.393032:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74916a2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+94:5568:x1872772280772352:12345-192.168.202.56@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1786015786.393400:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74916a2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41677fca-39fb-471c-b582-96bce6540a36+95:5568:x1872772280772352:12345-192.168.202.56@tcp:35:ldlm_bl.0 Request processed in 369us (858us total) trans 4294968385 rc 0/0 00000100:00100000:2.0:1786015786.393409:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 341 00000100:00100000:1.0:1786015786.398925:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1786015786.399192:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772280772480 00000100:00100000:3.0:1786015786.399205:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772280772480 00000100:00100000:3.0:1786015786.399293:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 87 00000100:00100000:3.0:1786015786.399305:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7382e15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+95:2352:x1872772280772480:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786015786.399329:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 16 locks, starting at 0 00010000:00010000:3.0:1786015786.400488:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74bf9e7600/0xb1a5ef690c4ff2d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7b60 expref: 95 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015786.400522:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f8a00/0xb1a5ef690c4ff27c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7b52 expref: 94 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015786.400533:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff8b7482d4bc00) 00010000:00010000:3.0:1786015786.400544:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f8c00/0xb1a5ef690c4ff205 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7b28 expref: 93 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015786.400557:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f8600/0xb1a5ef690c4ff1f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7b21 expref: 92 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015786.400568:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74aa829800/0xb1a5ef690c4ff19c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7b13 expref: 91 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015786.400583:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff8b74a0440c00) 00010000:00010000:3.0:1786015786.400600:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74aa828000/0xb1a5ef690c4ff0e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x18:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7adb expref: 90 pid: 12526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015786.400611:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386ac00/0xb1a5ef690c4ff125 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x18:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7ae9 expref: 89 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015786.400624:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74aa828a00/0xb1a5ef690c4ff05a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7abf expref: 88 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015786.400633:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x18:0x0].0x0 (ffff8b74a0440000) 00010000:00010000:3.0:1786015786.400643:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f9c00/0xb1a5ef690c4feff1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7a95 expref: 87 pid: 7673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015786.400653:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff8b7482d4b300) 00010000:00010000:3.0:1786015786.400664:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74aa829400/0xb1a5ef690c4fef96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7a80 expref: 86 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015786.400678:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b73829f8000/0xb1a5ef690c4feebd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7a4f expref: 85 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015786.400686:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8b74a0440f00) 00010000:00010000:3.0:1786015786.400709:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a800/0xb1a5ef690c4fee38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x16:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e7a2c expref: 84 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015786.400718:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x16:0x0].0x0 (ffff8b7482d4ba00) 00010000:00010000:3.0:1786015786.400728:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a000/0xb1a5ef690c4fed43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e79ed expref: 83 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015786.400740:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74aa829600/0xb1a5ef690c4fed27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e79e6 expref: 82 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015786.400748:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8b74b0022e00) 00010000:00010000:3.0:1786015786.400773:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b74aa829c00/0xb1a5ef690c4fecda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x12:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e79d8 expref: 81 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015786.400788:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b738386a400/0xb1a5ef690c4fe98b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x12:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xdb3f0d9e45e78ce expref: 80 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786015786.400796:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff8b7485765a00) 00010000:00010000:3.0:1786015786.400803:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786015786.401393:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7382e15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41677fca-39fb-471c-b582-96bce6540a36+79:2352:x1872772280772480:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1584us (1978us total) trans 0 rc 0/0 00000100:00100000:3.0:1786015786.401406:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 87 00000001:00080000:3.0:1786015786.742643:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968384 is committed 00000001:00080000:3.0:1786015786.742671:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968385 is committed 00010000:00010000:0.0:1786015786.869203:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786015787.374976:0:11538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786015787.374987:0:11538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786015787.375510:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786015787.375523:0:11538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:1.0:1786015787.429272:0:27685:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_12u: @@@@@@ FAIL: request on 0x200000402:0x36:0x0 is not SUCCEED on mds1 00000100:00100000:3.0:1786015787.692167:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304524160:0@lo:400:kworker.0 00000100:00100000:3.0:1786015787.692247:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786015787.692332:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786015787.692339:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304524288:0@lo:400:kworker.0 00000100:00100000:3.0:1786015787.692370:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786015787.692453:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304524160 00000100:00100000:0.0:1786015787.692463:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304524160 00000100:00100000:1.0:1786015787.692549:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304524032:0@lo:400:kworker.0 00000100:00100000:1.0:1786015787.692577:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015787.692602:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304524544:0@lo:400:kworker.0 00000100:00100000:1.0:1786015787.692615:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015787.692628:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1786015787.692631:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b74b8f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304523904:0@lo:400:kworker.0 00000100:00100000:1.0:1786015787.692667:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015787.692705:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7384bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304524416:0@lo:400:kworker.0 00000100:00100000:1.0:1786015787.692729:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015787.692800:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304524288 00000100:00100000:1.0:1786015787.692804:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304524288 00000100:00100000:1.0:1786015787.692851:0:14547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304524544 00000100:00100000:1.0:1786015787.692855:0:14547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304524544 00000100:00100000:0.0:1786015787.695980:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304524032 00000100:00100000:0.0:1786015787.695992:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304524032 00000100:00100000:0.0:1786015787.696019:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304524416 00000100:00100000:0.0:1786015787.696022:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304524416 00000100:00100000:2.0:1786015787.696096:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:2.0:1786015787.696109:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b74aef01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304524160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015787.696200:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b74aef01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872772304524160:12345-0@lo:400:kworker.0 Request processed in 94us (3953us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015787.696208:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:2.0:1786015787.696225:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:2.0:1786015787.696232:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304524032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786015787.696269:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1872772304524032:12345-0@lo:400:kworker.0 Request processed in 38us (3691us total) trans 0 rc 0/0 00000100:00100000:2.0:1786015787.696275:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:2.0:1786015787.696324:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1872772304524032:0@lo:400:kworker.0 00000100:00100000:2.0:1786015787.696364:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1872772304524160:0@lo:400:kworker.0 00000100:00080000:3.0:1786015787.696852:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786015787.697016:0:5791:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786015787.697118:0:11384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:1.0:1786015787.697131:0:11384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7384fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304524288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015787.697188:0:11384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7384fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1872772304524288:12345-0@lo:400:kworker.0 Request processed in 62us (4818us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015787.697192:0:11384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:1.0:1786015787.697217:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304523904 00000100:00100000:1.0:1786015787.697223:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304523904 00000100:00100000:1.0:1786015787.697257:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1786015787.697264:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7485062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304523904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015787.697299:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7485062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdeb3036-8b25-46a3-8ddb-498aa3a750fb+19:3313:x1872772304523904:12345-0@lo:400:kworker.0 Request processed in 35us (4631us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015787.697308:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1786015787.697365:0:14547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:1.0:1786015787.697372:0:14547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304524544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015787.697407:0:14547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1872772304524544:12345-0@lo:400:kworker.0 Request processed in 35us (4789us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015787.697412:0:14547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:2.0:1786015787.697496:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1872772304524288:0@lo:400:kworker.0 00000100:00100000:2.0:1786015787.697516:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b74b8f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdeb3036-8b25-46a3-8ddb-498aa3a750fb:3313:1872772304523904:0@lo:400:kworker.0 00000100:00100000:2.0:1786015787.697522:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1872772304524544:0@lo:400:kworker.0 00000100:00100000:1.0:1786015787.701823:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:1.0:1786015787.701843:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304524416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786015787.702169:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1872772304524416:12345-0@lo:400:kworker.0 Request processed in 332us (9438us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015787.702179:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:2.0:1786015787.702275:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7384bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1872772304524416:0@lo:400:kworker.0 00010000:00010000:1.0:1786015787.884119:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786015788.204974:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786015788.205000:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8b7381f9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304524672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786015788.205082:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786015788.205171:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872772304524672 00000100:00100000:1.0:1786015788.205178:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872772304524672 00000100:00100000:1.0:1786015788.205238:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1786015788.205247:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304524672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786015788.205283:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1786015788.205330:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b7381942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872772304524672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1786015788.205337:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1786015788.205385:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8b7381f9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1872772304524672:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786015788.908783:0:8308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 69381 lines, 69381 kept, 0 dropped, 0 bad.